2026-04-27 07:53:31 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-04-27 07:53:31 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-04-27 07:53:31 [auto1.es] INFO: Starting spider auto1.es
2026-04-27 07:53:31 [scrapy.addons] INFO: Enabled addons:
[]
2026-04-27 07:53:31 [asyncio] DEBUG: Using selector: EpollSelector
2026-04-27 07:53:31 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-04-27 07:53:31 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-04-27 07:53:31 [scrapy.extensions.telnet] INFO: Telnet Password: 21ef4059ae26c82f
2026-04-27 07:53:31 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-04-27 07:53:31 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/2026-04-27T07_53_28.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-04-27 07:53:31 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:53:31 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:53:31 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-04-27 07:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-04-27 07:53:31 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-04-27 07:53:31 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-04-27 07:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:53:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2105
2026-04-27 07:53:32 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-04-27 07:53:32 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-04-27 07:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-04-27 07:53:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-04-27 07:53:33 [common.geocoding.geonames_geocoder] INFO: GeoNames geocoder loaded: 9 files, 94519 postal codes, 171568 cities
2026-04-27 07:53:33 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-27 07:53:33 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-04-27 07:53:33 [scrapy.core.engine] INFO: Spider opened
2026-04-27 07:53:33 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-04-27 07:53:33 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-04-27 07:53:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 341MiB
2026-04-27 07:53:33 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:53:33 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:53:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-04-27 07:53:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-04-27 07:53:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-04-27 07:53:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-04-27 07:53:43 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2010 | hits on page: 40
2026-04-27 07:53:43 [auto1.es] INFO: Found listing with ID: PP73553
2026-04-27 07:53:43 [auto1.es] INFO: Scrape type for PP73553: 1
2026-04-27 07:53:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:43 [auto1.es] INFO: Found listing with ID: GC71068
2026-04-27 07:53:43 [auto1.es] INFO: Scrape type for GC71068: 2
2026-04-27 07:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caaead4e-79f0-5e0c-b262-cca0a2355cfe with identifier: GC71068
2026-04-27 07:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caaead4e-79f0-5e0c-b262-cca0a2355cfe with scrape type 2
2026-04-27 07:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caaead4e-79f0-5e0c-b262-cca0a2355cfe with scrape type 2
2026-04-27 07:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: caaead4e-79f0-5e0c-b262-cca0a2355cfe, identifier: GC71068
2026-04-27 07:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: caaead4e-79f0-5e0c-b262-cca0a2355cfe with identifier: GC71068
2026-04-27 07:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-04-27 07:53:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-04-27 07:53:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: caaead4e-79f0-5e0c-b262-cca0a2355cfe with identifier: GC71068
2026-04-27 07:53:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: caaead4e-79f0-5e0c-b262-cca0a2355cfe with identifier: GC71068 to the API
2026-04-27 07:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-04-28T15:48:43Z',
'fuel_type': 'diesel',
'id': 'caaead4e-79f0-5e0c-b262-cca0a2355cfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC71068',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 179410,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-02-08',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-04-27 07:53:44 [auto1.es] INFO: Saving data for GC71068: {'auction_closing_time': 1777391323.0, 'created_time': 1776941064.232035, 'has_photos': True, 'last_price_update_time': 1777276424.85025}
2026-04-27 07:53:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:44 [auto1.es] INFO: Found listing with ID: YW33842
2026-04-27 07:53:44 [auto1.es] INFO: Scrape type for YW33842: 2
2026-04-27 07:53:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219f54e1-ea25-54da-a17f-5d68939b65f0 with identifier: YW33842
2026-04-27 07:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219f54e1-ea25-54da-a17f-5d68939b65f0 with scrape type 2
2026-04-27 07:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219f54e1-ea25-54da-a17f-5d68939b65f0 with scrape type 2
2026-04-27 07:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 219f54e1-ea25-54da-a17f-5d68939b65f0, identifier: YW33842
2026-04-27 07:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 219f54e1-ea25-54da-a17f-5d68939b65f0 with identifier: YW33842
2026-04-27 07:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-04-27 07:53:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 219f54e1-ea25-54da-a17f-5d68939b65f0 with identifier: YW33842
2026-04-27 07:53:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 219f54e1-ea25-54da-a17f-5d68939b65f0 with identifier: YW33842 to the API
2026-04-27 07:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-28T15:34:05Z',
'fuel_type': 'diesel',
'id': '219f54e1-ea25-54da-a17f-5d68939b65f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW33842',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 190311,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-02-27',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-04-27 07:53:45 [auto1.es] INFO: Saving data for YW33842: {'auction_closing_time': 1777390445.0, 'created_time': 1777018348.57554, 'has_photos': True, 'last_price_update_time': 1777276425.426472}
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: XH92934
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for XH92934: 1
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: EZ13692
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for EZ13692: 1
2026-04-27 07:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: BA75989
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for BA75989: 1
2026-04-27 07:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: XC28833
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for XC28833: 1
2026-04-27 07:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: PT61600
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for PT61600: 1
2026-04-27 07:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: MZ61367
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for MZ61367: 1
2026-04-27 07:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: XA80872
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for XA80872: 1
2026-04-27 07:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: GG13689
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for GG13689: 1
2026-04-27 07:53:45 [auto1.es] INFO: Found listing with ID: TD87284
2026-04-27 07:53:45 [auto1.es] INFO: Scrape type for TD87284: 2
2026-04-27 07:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3151500-bc90-5d53-8cbd-4d6aae5246a9 with identifier: TD87284
2026-04-27 07:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3151500-bc90-5d53-8cbd-4d6aae5246a9 with scrape type 2
2026-04-27 07:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3151500-bc90-5d53-8cbd-4d6aae5246a9 with scrape type 2
2026-04-27 07:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d3151500-bc90-5d53-8cbd-4d6aae5246a9, identifier: TD87284
2026-04-27 07:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d3151500-bc90-5d53-8cbd-4d6aae5246a9 with identifier: TD87284
2026-04-27 07:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-04-27 07:53:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d3151500-bc90-5d53-8cbd-4d6aae5246a9 with identifier: TD87284
2026-04-27 07:53:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d3151500-bc90-5d53-8cbd-4d6aae5246a9 with identifier: TD87284 to the API
2026-04-27 07:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:19:23Z',
'fuel_type': 'diesel',
'id': 'd3151500-bc90-5d53-8cbd-4d6aae5246a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD87284',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Mokka X',
'odometer': 188076,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-19',
'seller_name': None,
'title': 'Opel Mokka X 1.6 CDTI DPF Selective Start/Stop',
'transmission': 'manual',
'trim': 'Selective Start/Stop',
'year': 2017}
2026-04-27 07:53:46 [auto1.es] INFO: Saving data for TD87284: {'auction_closing_time': 1777389563.0, 'created_time': 1777018015.324342, 'has_photos': True, 'last_price_update_time': 1777276426.244817}
2026-04-27 07:53:46 [auto1.es] INFO: Found listing with ID: EJ79911
2026-04-27 07:53:46 [auto1.es] INFO: Scrape type for EJ79911: 2
2026-04-27 07:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7290738e-df74-5677-80c9-34fbc1399cdf with identifier: EJ79911
2026-04-27 07:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7290738e-df74-5677-80c9-34fbc1399cdf with scrape type 2
2026-04-27 07:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7290738e-df74-5677-80c9-34fbc1399cdf with scrape type 2
2026-04-27 07:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7290738e-df74-5677-80c9-34fbc1399cdf, identifier: EJ79911
2026-04-27 07:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7290738e-df74-5677-80c9-34fbc1399cdf with identifier: EJ79911
2026-04-27 07:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-04-27 07:53:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7290738e-df74-5677-80c9-34fbc1399cdf with identifier: EJ79911
2026-04-27 07:53:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7290738e-df74-5677-80c9-34fbc1399cdf with identifier: EJ79911 to the API
2026-04-27 07:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-04-28T15:07:54Z',
'fuel_type': 'diesel',
'id': '7290738e-df74-5677-80c9-34fbc1399cdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ79911',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 59622,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-12-19',
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.2 JTDM Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2023}
2026-04-27 07:53:46 [auto1.es] INFO: Saving data for EJ79911: {'auction_closing_time': 1777388874.0, 'created_time': 1777018616.580551, 'has_photos': True, 'last_price_update_time': 1777276426.885573}
2026-04-27 07:53:46 [auto1.es] INFO: Found listing with ID: SU38466
2026-04-27 07:53:46 [auto1.es] INFO: Scrape type for SU38466: 2
2026-04-27 07:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cd9b55-7ff8-5f44-aa42-f184d7b9365d with identifier: SU38466
2026-04-27 07:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cd9b55-7ff8-5f44-aa42-f184d7b9365d with scrape type 2
2026-04-27 07:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9cd9b55-7ff8-5f44-aa42-f184d7b9365d with scrape type 2
2026-04-27 07:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9cd9b55-7ff8-5f44-aa42-f184d7b9365d, identifier: SU38466
2026-04-27 07:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9cd9b55-7ff8-5f44-aa42-f184d7b9365d with identifier: SU38466
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-04-27 07:53:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9cd9b55-7ff8-5f44-aa42-f184d7b9365d with identifier: SU38466
2026-04-27 07:53:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9cd9b55-7ff8-5f44-aa42-f184d7b9365d with identifier: SU38466 to the API
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:58:39Z',
'fuel_type': 'diesel',
'id': 'f9cd9b55-7ff8-5f44-aa42-f184d7b9365d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU38466',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 71757,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-06-07',
'seller_name': None,
'title': 'Renault Grand Scenic 1.7 BLUE dCi Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2020}
2026-04-27 07:53:47 [auto1.es] INFO: Saving data for SU38466: {'auction_closing_time': 1777391919.0, 'created_time': 1777018797.0013, 'has_photos': True, 'last_price_update_time': 1777276427.447573}
2026-04-27 07:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:47 [auto1.es] INFO: Found listing with ID: CG97241
2026-04-27 07:53:47 [auto1.es] INFO: Scrape type for CG97241: 2
2026-04-27 07:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c6182c-c4b0-5b33-ae98-05ebcf885818 with identifier: CG97241
2026-04-27 07:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c6182c-c4b0-5b33-ae98-05ebcf885818 with scrape type 2
2026-04-27 07:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c6182c-c4b0-5b33-ae98-05ebcf885818 with scrape type 2
2026-04-27 07:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7c6182c-c4b0-5b33-ae98-05ebcf885818, identifier: CG97241
2026-04-27 07:53:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7c6182c-c4b0-5b33-ae98-05ebcf885818 with identifier: CG97241
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-04-27 07:53:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7c6182c-c4b0-5b33-ae98-05ebcf885818 with identifier: CG97241
2026-04-27 07:53:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7c6182c-c4b0-5b33-ae98-05ebcf885818 with identifier: CG97241 to the API
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:29:27Z',
'fuel_type': 'diesel',
'id': 'b7c6182c-c4b0-5b33-ae98-05ebcf885818',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG97241',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '407',
'odometer': 180754,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-12-21',
'seller_name': None,
'title': 'Peugeot 407 2.0 HDi ST Confort',
'transmission': 'manual',
'trim': 'ST Confort',
'year': 2006}
2026-04-27 07:53:47 [auto1.es] INFO: Saving data for CG97241: {'auction_closing_time': 1777390167.0, 'created_time': 1777020927.764703, 'has_photos': True, 'last_price_update_time': 1777276427.954061}
2026-04-27 07:53:47 [auto1.es] INFO: Found listing with ID: AN65439
2026-04-27 07:53:48 [auto1.es] INFO: Scrape type for AN65439: 2
2026-04-27 07:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcd25998-5eb4-5aa5-927a-0ecf2f09302f with identifier: AN65439
2026-04-27 07:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd25998-5eb4-5aa5-927a-0ecf2f09302f with scrape type 2
2026-04-27 07:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcd25998-5eb4-5aa5-927a-0ecf2f09302f with scrape type 2
2026-04-27 07:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bcd25998-5eb4-5aa5-927a-0ecf2f09302f, identifier: AN65439
2026-04-27 07:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bcd25998-5eb4-5aa5-927a-0ecf2f09302f with identifier: AN65439
2026-04-27 07:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-04-27 07:53:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bcd25998-5eb4-5aa5-927a-0ecf2f09302f with identifier: AN65439
2026-04-27 07:53:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bcd25998-5eb4-5aa5-927a-0ecf2f09302f with identifier: AN65439 to the API
2026-04-27 07:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:51:23Z',
'fuel_type': 'electro',
'id': 'bcd25998-5eb4-5aa5-927a-0ecf2f09302f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN65439',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Leaf',
'odometer': 60000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-02-08',
'seller_name': None,
'title': 'Nissan Leaf electric drive 80 kW Acenta',
'transmission': 'automatic',
'trim': 'Acenta',
'year': 2017}
2026-04-27 07:53:48 [auto1.es] INFO: Saving data for AN65439: {'auction_closing_time': 1777391483.0, 'created_time': 1777021482.348085, 'has_photos': True, 'last_price_update_time': 1777276428.585252}
2026-04-27 07:53:48 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2010 | hits on page: 40
2026-04-27 07:53:48 [auto1.es] INFO: Found listing with ID: FZ41506
2026-04-27 07:53:48 [auto1.es] INFO: Scrape type for FZ41506: 2
2026-04-27 07:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20652d17-28d8-5abd-8704-c074db1d1052 with identifier: FZ41506
2026-04-27 07:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20652d17-28d8-5abd-8704-c074db1d1052 with scrape type 2
2026-04-27 07:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20652d17-28d8-5abd-8704-c074db1d1052 with scrape type 2
2026-04-27 07:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20652d17-28d8-5abd-8704-c074db1d1052, identifier: FZ41506
2026-04-27 07:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH92934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20652d17-28d8-5abd-8704-c074db1d1052 with identifier: FZ41506
2026-04-27 07:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20652d17-28d8-5abd-8704-c074db1d1052 with identifier: FZ41506
2026-04-27 07:53:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20652d17-28d8-5abd-8704-c074db1d1052 with identifier: FZ41506 to the API
2026-04-27 07:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:50:25Z',
'fuel_type': 'diesel',
'id': '20652d17-28d8-5abd-8704-c074db1d1052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ41506',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '7er',
'odometer': 169370,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-03-05',
'seller_name': None,
'title': 'BMW 7er 730d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 07:53:48 [auto1.es] INFO: Saving data for FZ41506: {'auction_closing_time': 1777391425.0, 'created_time': 1777021562.584706, 'has_photos': True, 'last_price_update_time': 1777276428.983695}
2026-04-27 07:53:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:49 [auto1.es] INFO: Found listing with ID: PP73553
2026-04-27 07:53:49 [auto1.es] INFO: Found listing with ID: JG50763
2026-04-27 07:53:49 [auto1.es] INFO: Scrape type for JG50763: 2
2026-04-27 07:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017 with identifier: JG50763
2026-04-27 07:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017 with scrape type 2
2026-04-27 07:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017 with scrape type 2
2026-04-27 07:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017, identifier: JG50763
2026-04-27 07:53:49 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/PP73553/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-04-27 07:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT61600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC28833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017 with identifier: JG50763
2026-04-27 07:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-04-27 07:53:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017 with identifier: JG50763
2026-04-27 07:53:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017 with identifier: JG50763 to the API
2026-04-27 07:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:34:10Z',
'fuel_type': 'diesel',
'id': '5ca4b4a8-62b7-5bbd-8ef9-a5c2772bf017',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG50763',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 159210,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-03-17',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2019}
2026-04-27 07:53:49 [auto1.es] INFO: Saving data for JG50763: {'auction_closing_time': 1777390450.0, 'created_time': 1777021648.259325, 'has_photos': True, 'last_price_update_time': 1777276429.637371}
2026-04-27 07:53:49 [auto1.es] INFO: Found listing with ID: GC71068
2026-04-27 07:53:49 [auto1.es] INFO: Scrape type for GC71068: 0
2026-04-27 07:53:49 [auto1.es] INFO: Found listing with ID: YW33842
2026-04-27 07:53:49 [auto1.es] INFO: Scrape type for YW33842: 0
2026-04-27 07:53:49 [auto1.es] INFO: Found listing with ID: XH92934
2026-04-27 07:53:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ61367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ13692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:49 [auto1.es] INFO: Found listing with ID: PA18450
2026-04-27 07:53:49 [auto1.es] INFO: Scrape type for PA18450: 2
2026-04-27 07:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5386d8-ae51-5b7d-855f-89be19ed2473 with identifier: PA18450
2026-04-27 07:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5386d8-ae51-5b7d-855f-89be19ed2473 with scrape type 2
2026-04-27 07:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5386d8-ae51-5b7d-855f-89be19ed2473 with scrape type 2
2026-04-27 07:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f5386d8-ae51-5b7d-855f-89be19ed2473, identifier: PA18450
2026-04-27 07:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f5386d8-ae51-5b7d-855f-89be19ed2473 with identifier: PA18450
2026-04-27 07:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f5386d8-ae51-5b7d-855f-89be19ed2473 with identifier: PA18450
2026-04-27 07:53:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f5386d8-ae51-5b7d-855f-89be19ed2473 with identifier: PA18450 to the API
2026-04-27 07:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:50:51Z',
'fuel_type': 'diesel',
'id': '9f5386d8-ae51-5b7d-855f-89be19ed2473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA18450',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 133537,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-07-30',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2013}
2026-04-27 07:53:50 [auto1.es] INFO: Saving data for PA18450: {'auction_closing_time': 1777391451.0, 'created_time': 1777021943.81754, 'has_photos': True, 'last_price_update_time': 1777276430.118152}
2026-04-27 07:53:50 [auto1.es] INFO: Found listing with ID: EZ13692
2026-04-27 07:53:50 [auto1.es] INFO: Found listing with ID: NY94557
2026-04-27 07:53:50 [auto1.es] INFO: Scrape type for NY94557: 2
2026-04-27 07:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce61a87c-036f-524e-9a3a-5fd7f986d6e3 with identifier: NY94557
2026-04-27 07:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce61a87c-036f-524e-9a3a-5fd7f986d6e3 with scrape type 2
2026-04-27 07:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce61a87c-036f-524e-9a3a-5fd7f986d6e3 with scrape type 2
2026-04-27 07:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce61a87c-036f-524e-9a3a-5fd7f986d6e3, identifier: NY94557
2026-04-27 07:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP73553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce61a87c-036f-524e-9a3a-5fd7f986d6e3 with identifier: NY94557
2026-04-27 07:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-04-27 07:53:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce61a87c-036f-524e-9a3a-5fd7f986d6e3 with identifier: NY94557
2026-04-27 07:53:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce61a87c-036f-524e-9a3a-5fd7f986d6e3 with identifier: NY94557 to the API
2026-04-27 07:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:52:50Z',
'fuel_type': 'petrol',
'id': 'ce61a87c-036f-524e-9a3a-5fd7f986d6e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY94557',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 272995,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-11-19',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-04-27 07:53:50 [auto1.es] INFO: Saving data for NY94557: {'auction_closing_time': 1777391570.0, 'created_time': 1777018037.613051, 'has_photos': True, 'last_price_update_time': 1777276430.668976}
2026-04-27 07:53:50 [auto1.es] INFO: Found listing with ID: BA75989
2026-04-27 07:53:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:50 [auto1.es] INFO: Found listing with ID: AU88066
2026-04-27 07:53:50 [auto1.es] INFO: Scrape type for AU88066: 2
2026-04-27 07:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b4b951-5789-538d-a08f-90a8d694236e with identifier: AU88066
2026-04-27 07:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b4b951-5789-538d-a08f-90a8d694236e with scrape type 2
2026-04-27 07:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b4b951-5789-538d-a08f-90a8d694236e with scrape type 2
2026-04-27 07:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 27b4b951-5789-538d-a08f-90a8d694236e, identifier: AU88066
2026-04-27 07:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 27b4b951-5789-538d-a08f-90a8d694236e with identifier: AU88066
2026-04-27 07:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 27b4b951-5789-538d-a08f-90a8d694236e with identifier: AU88066
2026-04-27 07:53:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 27b4b951-5789-538d-a08f-90a8d694236e with identifier: AU88066 to the API
2026-04-27 07:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-04-28T15:14:05Z',
'fuel_type': 'diesel',
'id': '27b4b951-5789-538d-a08f-90a8d694236e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU88066',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 185022,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-04-13',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 250 CDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2015}
2026-04-27 07:53:51 [auto1.es] INFO: Saving data for AU88066: {'auction_closing_time': 1777389245.0, 'created_time': 1777021941.230326, 'has_photos': True, 'last_price_update_time': 1777276431.078113}
2026-04-27 07:53:51 [auto1.es] INFO: Found listing with ID: XC28833
2026-04-27 07:53:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:51 [auto1.es] INFO: Found listing with ID: SX43961
2026-04-27 07:53:51 [auto1.es] INFO: Scrape type for SX43961: 2
2026-04-27 07:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b035d48-7600-5242-abf1-3464d06cd7f0 with identifier: SX43961
2026-04-27 07:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b035d48-7600-5242-abf1-3464d06cd7f0 with scrape type 2
2026-04-27 07:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b035d48-7600-5242-abf1-3464d06cd7f0 with scrape type 2
2026-04-27 07:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b035d48-7600-5242-abf1-3464d06cd7f0, identifier: SX43961
2026-04-27 07:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA75989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b035d48-7600-5242-abf1-3464d06cd7f0 with identifier: SX43961
2026-04-27 07:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b035d48-7600-5242-abf1-3464d06cd7f0 with identifier: SX43961
2026-04-27 07:53:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b035d48-7600-5242-abf1-3464d06cd7f0 with identifier: SX43961 to the API
2026-04-27 07:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:34:59Z',
'fuel_type': 'diesel',
'id': '2b035d48-7600-5242-abf1-3464d06cd7f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX43961',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'Partner',
'odometer': 68237,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-10-25',
'seller_name': None,
'title': 'Peugeot Partner 1.5 Blue-HDi Cabine Approfondie L2',
'transmission': 'manual',
'trim': 'Cabine Approfondie L2',
'year': 2021}
2026-04-27 07:53:51 [auto1.es] INFO: Saving data for SX43961: {'auction_closing_time': 1777390499.0, 'created_time': 1777018019.724474, 'has_photos': True, 'last_price_update_time': 1777276431.576674}
2026-04-27 07:53:51 [auto1.es] INFO: Found listing with ID: PT61600
2026-04-27 07:53:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:51 [auto1.es] INFO: Found listing with ID: KH10480
2026-04-27 07:53:51 [auto1.es] INFO: Scrape type for KH10480: 2
2026-04-27 07:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a323a72-e488-578c-bce6-f555c42edf5c with identifier: KH10480
2026-04-27 07:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a323a72-e488-578c-bce6-f555c42edf5c with scrape type 2
2026-04-27 07:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a323a72-e488-578c-bce6-f555c42edf5c with scrape type 2
2026-04-27 07:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a323a72-e488-578c-bce6-f555c42edf5c, identifier: KH10480
2026-04-27 07:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA80872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a323a72-e488-578c-bce6-f555c42edf5c with identifier: KH10480
2026-04-27 07:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a323a72-e488-578c-bce6-f555c42edf5c with identifier: KH10480
2026-04-27 07:53:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a323a72-e488-578c-bce6-f555c42edf5c with identifier: KH10480 to the API
2026-04-27 07:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-04-28T15:29:05Z',
'fuel_type': 'petrol',
'id': '5a323a72-e488-578c-bce6-f555c42edf5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH10480',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 136641,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-12-25',
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo Elegance Start/Stop',
'transmission': 'manual',
'trim': 'Elegance Start/Stop',
'year': 2019}
2026-04-27 07:53:52 [auto1.es] INFO: Saving data for KH10480: {'auction_closing_time': 1777390145.0, 'created_time': 1777018018.752242, 'has_photos': True, 'last_price_update_time': 1777276432.006263}
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: MZ61367
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: VL90771
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for VL90771: 2
2026-04-27 07:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b56cd4a-b38a-5927-b9f7-17fd333ba039 with identifier: VL90771
2026-04-27 07:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b56cd4a-b38a-5927-b9f7-17fd333ba039 with scrape type 2
2026-04-27 07:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b56cd4a-b38a-5927-b9f7-17fd333ba039 with scrape type 2
2026-04-27 07:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b56cd4a-b38a-5927-b9f7-17fd333ba039, identifier: VL90771
2026-04-27 07:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b56cd4a-b38a-5927-b9f7-17fd333ba039 with identifier: VL90771
2026-04-27 07:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b56cd4a-b38a-5927-b9f7-17fd333ba039 with identifier: VL90771
2026-04-27 07:53:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b56cd4a-b38a-5927-b9f7-17fd333ba039 with identifier: VL90771 to the API
2026-04-27 07:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:23:59Z',
'fuel_type': 'diesel',
'id': '0b56cd4a-b38a-5927-b9f7-17fd333ba039',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL90771',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Tipo',
'odometer': 25484,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-06-13',
'seller_name': None,
'title': 'Fiat Tipo 1.3 M-Jet Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2022}
2026-04-27 07:53:52 [auto1.es] INFO: Saving data for VL90771: {'auction_closing_time': 1777389839.0, 'created_time': 1777018011.944269, 'has_photos': True, 'last_price_update_time': 1777276432.423416}
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: XA80872
2026-04-27 07:53:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: JP64596
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for JP64596: 2
2026-04-27 07:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8397f05c-5d39-55ff-b37a-f9eaf320a065 with identifier: JP64596
2026-04-27 07:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8397f05c-5d39-55ff-b37a-f9eaf320a065 with scrape type 2
2026-04-27 07:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8397f05c-5d39-55ff-b37a-f9eaf320a065 with scrape type 2
2026-04-27 07:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8397f05c-5d39-55ff-b37a-f9eaf320a065, identifier: JP64596
2026-04-27 07:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8397f05c-5d39-55ff-b37a-f9eaf320a065 with identifier: JP64596
2026-04-27 07:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8397f05c-5d39-55ff-b37a-f9eaf320a065 with identifier: JP64596
2026-04-27 07:53:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8397f05c-5d39-55ff-b37a-f9eaf320a065 with identifier: JP64596 to the API
2026-04-27 07:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:08:58Z',
'fuel_type': 'diesel',
'id': '8397f05c-5d39-55ff-b37a-f9eaf320a065',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP64596',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '308',
'odometer': 130116,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-09-16',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2020}
2026-04-27 07:53:52 [auto1.es] INFO: Saving data for JP64596: {'auction_closing_time': 1777388938.0, 'created_time': 1777021934.651859, 'has_photos': True, 'last_price_update_time': 1777276432.829205}
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: GG13689
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: VJ33525
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for VJ33525: 1
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: TD87284
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for TD87284: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: EJ79911
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for EJ79911: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: SU38466
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for SU38466: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: CG97241
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for CG97241: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: AN65439
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for AN65439: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: FZ41506
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for FZ41506: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: JG50763
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for JG50763: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: PA18450
2026-04-27 07:53:52 [auto1.es] INFO: Scrape type for PA18450: 0
2026-04-27 07:53:52 [auto1.es] INFO: Found listing with ID: NY94557
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for NY94557: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: AU88066
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for AU88066: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: SX43961
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for SX43961: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: KH10480
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for KH10480: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: VL90771
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for VL90771: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: JP64596
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for JP64596: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: VJ33525
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: ET87010
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for ET87010: 2
2026-04-27 07:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf with identifier: ET87010
2026-04-27 07:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf with scrape type 2
2026-04-27 07:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf with scrape type 2
2026-04-27 07:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf, identifier: ET87010
2026-04-27 07:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf with identifier: ET87010
2026-04-27 07:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf with identifier: ET87010
2026-04-27 07:53:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf with identifier: ET87010 to the API
2026-04-27 07:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:15:24Z',
'fuel_type': 'diesel',
'id': 'ea1444f9-ffdd-5dea-8c6c-88a6c5d77ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET87010',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 63442,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-09-16',
'seller_name': None,
'title': 'Jaguar E-Pace D150 S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2020}
2026-04-27 07:53:53 [auto1.es] INFO: Saving data for ET87010: {'auction_closing_time': 1777389324.0, 'created_time': 1777018030.619518, 'has_photos': True, 'last_price_update_time': 1777276433.471869}
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: ET87010
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for ET87010: 0
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: HR19643
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for HR19643: 2
2026-04-27 07:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643
2026-04-27 07:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa970595-ce67-589f-8c0e-865068a25612 with scrape type 2
2026-04-27 07:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa970595-ce67-589f-8c0e-865068a25612 with scrape type 2
2026-04-27 07:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa970595-ce67-589f-8c0e-865068a25612, identifier: HR19643
2026-04-27 07:53:53 [auto1.es] INFO: Found listing with ID: HR19643
2026-04-27 07:53:53 [auto1.es] INFO: Scrape type for HR19643: 2
2026-04-27 07:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa970595-ce67-589f-8c0e-865068a25612 with scrape type 2
2026-04-27 07:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa970595-ce67-589f-8c0e-865068a25612 with scrape type 2
2026-04-27 07:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa970595-ce67-589f-8c0e-865068a25612, identifier: HR19643
2026-04-27 07:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643
2026-04-27 07:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643
2026-04-27 07:53:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643 to the API
2026-04-27 07:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:32:38Z',
'fuel_type': 'diesel',
'id': 'aa970595-ce67-589f-8c0e-865068a25612',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR19643',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 233550,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-12-01',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2013}
2026-04-27 07:53:54 [auto1.es] INFO: Saving data for HR19643: {'auction_closing_time': 1777390358.0, 'created_time': 1777018011.465541, 'has_photos': True, 'last_price_update_time': 1777276434.162326}
2026-04-27 07:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG13689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643
2026-04-27 07:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643
2026-04-27 07:53:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aa970595-ce67-589f-8c0e-865068a25612 with identifier: HR19643 to the API
2026-04-27 07:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:32:38Z',
'fuel_type': 'diesel',
'id': 'aa970595-ce67-589f-8c0e-865068a25612',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR19643',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 233550,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-12-01',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2013}
2026-04-27 07:53:54 [auto1.es] INFO: Saving data for HR19643: {'auction_closing_time': 1777390358.0, 'created_time': 1777018011.465541, 'has_photos': True, 'last_price_update_time': 1777276434.47369}
2026-04-27 07:53:54 [auto1.es] INFO: Found listing with ID: AC30082
2026-04-27 07:53:54 [auto1.es] INFO: Scrape type for AC30082: 2
2026-04-27 07:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082
2026-04-27 07:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3848f743-8303-5e34-a7c0-876cadb9696c with scrape type 2
2026-04-27 07:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3848f743-8303-5e34-a7c0-876cadb9696c with scrape type 2
2026-04-27 07:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3848f743-8303-5e34-a7c0-876cadb9696c, identifier: AC30082
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:54 [auto1.es] INFO: Found listing with ID: AC30082
2026-04-27 07:53:54 [auto1.es] INFO: Scrape type for AC30082: 2
2026-04-27 07:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3848f743-8303-5e34-a7c0-876cadb9696c with scrape type 2
2026-04-27 07:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3848f743-8303-5e34-a7c0-876cadb9696c with scrape type 2
2026-04-27 07:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3848f743-8303-5e34-a7c0-876cadb9696c, identifier: AC30082
2026-04-27 07:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082
2026-04-27 07:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:53:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-04-27 07:53:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082
2026-04-27 07:53:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082 to the API
2026-04-27 07:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:13:28Z',
'fuel_type': 'diesel',
'id': '3848f743-8303-5e34-a7c0-876cadb9696c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC30082',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 223420,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-09-30',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2010}
2026-04-27 07:53:55 [auto1.es] INFO: Saving data for AC30082: {'auction_closing_time': 1777389208.0, 'created_time': 1777018014.962164, 'has_photos': True, 'last_price_update_time': 1777276435.128812}
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH92934> (referer: https://www.auto1.com/v1/car-details-view/XH92934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ61367> (referer: https://www.auto1.com/v1/car-details-view/MZ61367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC28833> (referer: https://www.auto1.com/v1/car-details-view/XC28833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082
2026-04-27 07:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082
2026-04-27 07:53:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3848f743-8303-5e34-a7c0-876cadb9696c with identifier: AC30082 to the API
2026-04-27 07:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:13:28Z',
'fuel_type': 'diesel',
'id': '3848f743-8303-5e34-a7c0-876cadb9696c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC30082',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 223420,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-09-30',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2010}
2026-04-27 07:53:55 [auto1.es] INFO: Saving data for AC30082: {'auction_closing_time': 1777389208.0, 'created_time': 1777018014.962164, 'has_photos': True, 'last_price_update_time': 1777276435.465739}
2026-04-27 07:53:55 [auto1.es] INFO: Found listing with ID: AK07153
2026-04-27 07:53:55 [auto1.es] INFO: Scrape type for AK07153: 1
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT61600> (referer: https://www.auto1.com/v1/car-details-view/PT61600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [auto1.es] INFO: Found listing with ID: AK07153
2026-04-27 07:53:55 [auto1.es] INFO: Found listing with ID: DB92239
2026-04-27 07:53:55 [auto1.es] INFO: Scrape type for DB92239: 2
2026-04-27 07:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239
2026-04-27 07:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f30d818-f75b-502c-ad60-6f80629c8bff with scrape type 2
2026-04-27 07:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f30d818-f75b-502c-ad60-6f80629c8bff with scrape type 2
2026-04-27 07:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f30d818-f75b-502c-ad60-6f80629c8bff, identifier: DB92239
2026-04-27 07:53:55 [auto1.es] INFO: Found listing with ID: DB92239
2026-04-27 07:53:55 [auto1.es] INFO: Scrape type for DB92239: 2
2026-04-27 07:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f30d818-f75b-502c-ad60-6f80629c8bff with scrape type 2
2026-04-27 07:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f30d818-f75b-502c-ad60-6f80629c8bff with scrape type 2
2026-04-27 07:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f30d818-f75b-502c-ad60-6f80629c8bff, identifier: DB92239
2026-04-27 07:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239
2026-04-27 07:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239
2026-04-27 07:53:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239 to the API
2026-04-27 07:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:32:34Z',
'fuel_type': 'petrol',
'id': '7f30d818-f75b-502c-ad60-6f80629c8bff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB92239',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 191215,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-02',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT Style Connect',
'transmission': 'automatic',
'trim': 'Style Connect',
'year': 2016}
2026-04-27 07:53:56 [auto1.es] INFO: Saving data for DB92239: {'auction_closing_time': 1777390354.0, 'created_time': 1777018047.836886, 'has_photos': True, 'last_price_update_time': 1777276436.060226}
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2010 | hits on page: 40
2026-04-27 07:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55a86871-2b4f-50ad-94ec-c257548c1557 with identifier: XH92934
2026-04-27 07:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55a86871-2b4f-50ad-94ec-c257548c1557 with scrape type 1
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_9c9a3c34297ef23e356bee531d675b8e.jpg not downloaded yet
2026-04-27 07:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81ca799-7604-572e-9667-7b611d005346 with identifier: MZ61367
2026-04-27 07:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81ca799-7604-572e-9667-7b611d005346 with scrape type 1
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b81ca799-7604-572e-9667-7b611d005346
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_a1dce3830ebb79792164853134c59d61.jpg not downloaded yet
2026-04-27 07:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1313b06c-5db1-5717-9464-877905d8b069 with identifier: XC28833
2026-04-27 07:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1313b06c-5db1-5717-9464-877905d8b069 with scrape type 1
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_65ec69e6854e105aa7850cbd260f1703.jpg not downloaded yet
2026-04-27 07:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239
2026-04-27 07:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239
2026-04-27 07:53:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f30d818-f75b-502c-ad60-6f80629c8bff with identifier: DB92239 to the API
2026-04-27 07:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:32:34Z',
'fuel_type': 'petrol',
'id': '7f30d818-f75b-502c-ad60-6f80629c8bff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB92239',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 191215,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-02',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT Style Connect',
'transmission': 'automatic',
'trim': 'Style Connect',
'year': 2016}
2026-04-27 07:53:56 [auto1.es] INFO: Saving data for DB92239: {'auction_closing_time': 1777390354.0, 'created_time': 1777018047.836886, 'has_photos': True, 'last_price_update_time': 1777276436.482787}
2026-04-27 07:53:56 [auto1.es] INFO: Found listing with ID: MF17439
2026-04-27 07:53:56 [auto1.es] INFO: Scrape type for MF17439: 2
2026-04-27 07:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439
2026-04-27 07:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 579d07b7-ab56-59e9-b671-b1373332b6b2 with scrape type 2
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 579d07b7-ab56-59e9-b671-b1373332b6b2 with scrape type 2
2026-04-27 07:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 579d07b7-ab56-59e9-b671-b1373332b6b2, identifier: MF17439
2026-04-27 07:53:56 [auto1.es] INFO: Found listing with ID: MF17439
2026-04-27 07:53:56 [auto1.es] INFO: Scrape type for MF17439: 2
2026-04-27 07:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 579d07b7-ab56-59e9-b671-b1373332b6b2 with scrape type 2
2026-04-27 07:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 579d07b7-ab56-59e9-b671-b1373332b6b2 with scrape type 2
2026-04-27 07:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 579d07b7-ab56-59e9-b671-b1373332b6b2, identifier: MF17439
2026-04-27 07:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439
2026-04-27 07:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439
2026-04-27 07:53:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439 to the API
2026-04-27 07:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:29:07Z',
'fuel_type': 'petrol',
'id': '579d07b7-ab56-59e9-b671-b1373332b6b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF17439',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'Lantra',
'odometer': 232774,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '1998-07-20',
'seller_name': None,
'title': 'Hyundai Lantra 2.0 GLS',
'transmission': 'manual',
'trim': 'GLS',
'year': 1998}
2026-04-27 07:53:57 [auto1.es] INFO: Saving data for MF17439: {'auction_closing_time': 1777390147.0, 'created_time': 1777020816.897704, 'has_photos': True, 'last_price_update_time': 1777276437.101606}
2026-04-27 07:53:57 [auto1.es] INFO: Found listing with ID: FS79489
2026-04-27 07:53:57 [auto1.es] INFO: Scrape type for FS79489: 2
2026-04-27 07:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2391b836-d50d-5418-9e21-14033400d16a with identifier: FS79489
2026-04-27 07:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2391b836-d50d-5418-9e21-14033400d16a with scrape type 2
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2391b836-d50d-5418-9e21-14033400d16a with scrape type 2
2026-04-27 07:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2391b836-d50d-5418-9e21-14033400d16a, identifier: FS79489
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_0550a336d64f383b60fe9348f879adaf.jpg not downloaded yet
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_9d9c5bf61f5829468231227f1082c466.jpg not downloaded yet
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_4430a2ea68ca4a5e2e33069ca466ec82.jpg not downloaded yet
2026-04-27 07:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7248421f-4066-5b1f-a278-2b8c1e4c7add with identifier: PT61600
2026-04-27 07:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7248421f-4066-5b1f-a278-2b8c1e4c7add with scrape type 1
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_54497a625570a9315dedbb2ac2cd5cea.jpg not downloaded yet
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439
2026-04-27 07:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439
2026-04-27 07:53:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 579d07b7-ab56-59e9-b671-b1373332b6b2 with identifier: MF17439 to the API
2026-04-27 07:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:29:07Z',
'fuel_type': 'petrol',
'id': '579d07b7-ab56-59e9-b671-b1373332b6b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF17439',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'Lantra',
'odometer': 232774,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '1998-07-20',
'seller_name': None,
'title': 'Hyundai Lantra 2.0 GLS',
'transmission': 'manual',
'trim': 'GLS',
'year': 1998}
2026-04-27 07:53:57 [auto1.es] INFO: Saving data for MF17439: {'auction_closing_time': 1777390147.0, 'created_time': 1777020816.897704, 'has_photos': True, 'last_price_update_time': 1777276437.751324}
2026-04-27 07:53:57 [auto1.es] INFO: Found listing with ID: RL76926
2026-04-27 07:53:57 [auto1.es] INFO: Scrape type for RL76926: 2
2026-04-27 07:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926
2026-04-27 07:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cee6569-4d03-5591-8d04-7ee8f911aa06 with scrape type 2
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cee6569-4d03-5591-8d04-7ee8f911aa06 with scrape type 2
2026-04-27 07:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4cee6569-4d03-5591-8d04-7ee8f911aa06, identifier: RL76926
2026-04-27 07:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2391b836-d50d-5418-9e21-14033400d16a with identifier: FS79489
2026-04-27 07:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2391b836-d50d-5418-9e21-14033400d16a with identifier: FS79489
2026-04-27 07:53:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2391b836-d50d-5418-9e21-14033400d16a with identifier: FS79489 to the API
2026-04-27 07:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:09:18Z',
'fuel_type': 'diesel',
'id': '2391b836-d50d-5418-9e21-14033400d16a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS79489',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 207990,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-01-17',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-04-27 07:53:58 [auto1.es] INFO: Saving data for FS79489: {'auction_closing_time': 1777388958.0, 'created_time': 1776941039.731398, 'has_photos': True, 'last_price_update_time': 1777276438.772422}
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP73553> (referer: https://www.auto1.com/v1/car-details-view/PP73553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:58 [auto1.es] INFO: Found listing with ID: RL76926
2026-04-27 07:53:58 [auto1.es] INFO: Scrape type for RL76926: 2
2026-04-27 07:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cee6569-4d03-5591-8d04-7ee8f911aa06 with scrape type 2
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cee6569-4d03-5591-8d04-7ee8f911aa06 with scrape type 2
2026-04-27 07:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4cee6569-4d03-5591-8d04-7ee8f911aa06, identifier: RL76926
2026-04-27 07:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926
2026-04-27 07:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926
2026-04-27 07:53:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926 to the API
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:50:04Z',
'fuel_type': 'petrol',
'id': '4cee6569-4d03-5591-8d04-7ee8f911aa06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL76926',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '207',
'odometer': 196458,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-24',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-04-27 07:53:59 [auto1.es] INFO: Saving data for RL76926: {'auction_closing_time': 1777391404.0, 'created_time': 1777018062.765093, 'has_photos': True, 'last_price_update_time': 1777276439.382653}
2026-04-27 07:53:59 [auto1.es] INFO: Found listing with ID: MT24502
2026-04-27 07:53:59 [auto1.es] INFO: Scrape type for MT24502: 1
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_52a71ad67012d75d90c5c434a7d43f13.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_da0f30bf15c7a1f17e6f4343dcb35735.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_c828cc1f56986ee7de6b65a89263e05c.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_ee4eeb0e59e73b2f656516f789cb5c0d.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926
2026-04-27 07:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926
2026-04-27 07:53:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4cee6569-4d03-5591-8d04-7ee8f911aa06 with identifier: RL76926 to the API
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:50:04Z',
'fuel_type': 'petrol',
'id': '4cee6569-4d03-5591-8d04-7ee8f911aa06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL76926',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '207',
'odometer': 196458,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-24',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-04-27 07:53:59 [auto1.es] INFO: Saving data for RL76926: {'auction_closing_time': 1777391404.0, 'created_time': 1777018062.765093, 'has_photos': True, 'last_price_update_time': 1777276439.963084}
2026-04-27 07:54:00 [auto1.es] INFO: Found listing with ID: NZ83694
2026-04-27 07:54:00 [auto1.es] INFO: Scrape type for NZ83694: 2
2026-04-27 07:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694
2026-04-27 07:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95be3fda-b2dc-52ea-926d-7f7beb99d54a with scrape type 2
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95be3fda-b2dc-52ea-926d-7f7beb99d54a with scrape type 2
2026-04-27 07:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95be3fda-b2dc-52ea-926d-7f7beb99d54a, identifier: NZ83694
2026-04-27 07:54:00 [auto1.es] INFO: Found listing with ID: NZ83694
2026-04-27 07:54:00 [auto1.es] INFO: Scrape type for NZ83694: 2
2026-04-27 07:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95be3fda-b2dc-52ea-926d-7f7beb99d54a with scrape type 2
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95be3fda-b2dc-52ea-926d-7f7beb99d54a with scrape type 2
2026-04-27 07:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95be3fda-b2dc-52ea-926d-7f7beb99d54a, identifier: NZ83694
2026-04-27 07:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694
2026-04-27 07:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694
2026-04-27 07:54:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694 to the API
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:30:16Z',
'fuel_type': 'petrol',
'id': '95be3fda-b2dc-52ea-926d-7f7beb99d54a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ83694',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Kadjar',
'odometer': 167062,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-02-19',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2017}
2026-04-27 07:54:00 [auto1.es] INFO: Saving data for NZ83694: {'auction_closing_time': 1777390216.0, 'created_time': 1777018049.639813, 'has_photos': True, 'last_price_update_time': 1777276440.723702}
2026-04-27 07:54:00 [auto1.es] INFO: Found listing with ID: DY27245
2026-04-27 07:54:00 [auto1.es] INFO: Scrape type for DY27245: 1
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_31eb531c8c8fbb518a7dbbd83e1a64cf.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_cbfd48385c396b562fbc5721dae193c3.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_34f00124e456d1690783f98dc81e63c0.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_9fb5297e829610dbdce70a387a3d070c.jpg not downloaded yet
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ13692> (referer: https://www.auto1.com/v1/car-details-view/EZ13692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694
2026-04-27 07:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694
2026-04-27 07:54:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95be3fda-b2dc-52ea-926d-7f7beb99d54a with identifier: NZ83694 to the API
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:30:16Z',
'fuel_type': 'petrol',
'id': '95be3fda-b2dc-52ea-926d-7f7beb99d54a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ83694',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Kadjar',
'odometer': 167062,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-02-19',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2017}
2026-04-27 07:54:01 [auto1.es] INFO: Saving data for NZ83694: {'auction_closing_time': 1777390216.0, 'created_time': 1777018049.639813, 'has_photos': True, 'last_price_update_time': 1777276441.110132}
2026-04-27 07:54:01 [auto1.es] INFO: Found listing with ID: KC34372
2026-04-27 07:54:01 [auto1.es] INFO: Scrape type for KC34372: 2
2026-04-27 07:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372
2026-04-27 07:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4478981-9eb8-5510-95bc-99d71f9811a6 with scrape type 2
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4478981-9eb8-5510-95bc-99d71f9811a6 with scrape type 2
2026-04-27 07:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4478981-9eb8-5510-95bc-99d71f9811a6, identifier: KC34372
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA75989> (referer: https://www.auto1.com/v1/car-details-view/BA75989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3230f8a5-87fe-532b-841f-5e419cdf9d87 with identifier: PP73553
2026-04-27 07:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3230f8a5-87fe-532b-841f-5e419cdf9d87 with scrape type 1
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_9b5a49cbecf38b3eb6e431febd3a269d.jpg not downloaded yet
2026-04-27 07:54:01 [auto1.es] INFO: Found listing with ID: KC34372
2026-04-27 07:54:01 [auto1.es] INFO: Scrape type for KC34372: 2
2026-04-27 07:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4478981-9eb8-5510-95bc-99d71f9811a6 with scrape type 2
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4478981-9eb8-5510-95bc-99d71f9811a6 with scrape type 2
2026-04-27 07:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4478981-9eb8-5510-95bc-99d71f9811a6, identifier: KC34372
2026-04-27 07:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372
2026-04-27 07:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372
2026-04-27 07:54:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372 to the API
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:37:50Z',
'fuel_type': 'petrol',
'id': 'f4478981-9eb8-5510-95bc-99d71f9811a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC34372',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 120049,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2015}
2026-04-27 07:54:01 [auto1.es] INFO: Saving data for KC34372: {'auction_closing_time': 1777390670.0, 'created_time': 1777018032.764236, 'has_photos': True, 'last_price_update_time': 1777276441.677845}
2026-04-27 07:54:01 [auto1.es] INFO: Found listing with ID: JY64983
2026-04-27 07:54:01 [auto1.es] INFO: Scrape type for JY64983: 1
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_35219cc3d85b7bc0a6d1fb51d3b19be4.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_b8f47a2abd2cbf4ad20e6c7f2edd0787.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_acb52f78d826cf961e4b5982f9a6de99.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_1b5d66e14b33e9809c04e21d4ee76ab7.jpg not downloaded yet
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA80872> (referer: https://www.auto1.com/v1/car-details-view/XA80872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372
2026-04-27 07:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372
2026-04-27 07:54:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4478981-9eb8-5510-95bc-99d71f9811a6 with identifier: KC34372 to the API
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:37:50Z',
'fuel_type': 'petrol',
'id': 'f4478981-9eb8-5510-95bc-99d71f9811a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC34372',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 120049,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2015}
2026-04-27 07:54:02 [auto1.es] INFO: Saving data for KC34372: {'auction_closing_time': 1777390670.0, 'created_time': 1777018032.764236, 'has_photos': True, 'last_price_update_time': 1777276442.105406}
2026-04-27 07:54:02 [auto1.es] INFO: Found listing with ID: FV34487
2026-04-27 07:54:02 [auto1.es] INFO: Scrape type for FV34487: 2
2026-04-27 07:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487
2026-04-27 07:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd9ecd1-4767-5cec-8d7b-11c98566507c with scrape type 2
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bd9ecd1-4767-5cec-8d7b-11c98566507c with scrape type 2
2026-04-27 07:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6bd9ecd1-4767-5cec-8d7b-11c98566507c, identifier: FV34487
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_da66cde7b14cba6c74332c72aa595e88.jpg not downloaded yet
2026-04-27 07:54:02 [auto1.es] INFO: Found listing with ID: FV34487
2026-04-27 07:54:02 [auto1.es] INFO: Scrape type for FV34487: 2
2026-04-27 07:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd9ecd1-4767-5cec-8d7b-11c98566507c with scrape type 2
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bd9ecd1-4767-5cec-8d7b-11c98566507c with scrape type 2
2026-04-27 07:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6bd9ecd1-4767-5cec-8d7b-11c98566507c, identifier: FV34487
2026-04-27 07:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487
2026-04-27 07:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487
2026-04-27 07:54:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487 to the API
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:39:39Z',
'fuel_type': 'diesel',
'id': '6bd9ecd1-4767-5cec-8d7b-11c98566507c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV34487',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 208886,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-05',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'T BlueTEC AMG Line',
'year': 2017}
2026-04-27 07:54:02 [auto1.es] INFO: Saving data for FV34487: {'auction_closing_time': 1777390779.0, 'created_time': 1777021937.647132, 'has_photos': True, 'last_price_update_time': 1777276442.744034}
2026-04-27 07:54:02 [auto1.es] INFO: Found listing with ID: NN94006
2026-04-27 07:54:02 [auto1.es] INFO: Scrape type for NN94006: 2
2026-04-27 07:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dc6b04d-90ef-5a97-b82b-d47204c0d24c with identifier: NN94006
2026-04-27 07:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dc6b04d-90ef-5a97-b82b-d47204c0d24c with scrape type 2
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dc6b04d-90ef-5a97-b82b-d47204c0d24c with scrape type 2
2026-04-27 07:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1dc6b04d-90ef-5a97-b82b-d47204c0d24c, identifier: NN94006
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_57f8e8c016e0729a664a2fa7c2ca2aa4.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_1abd0f5174ab56f4f8a48d1d9406e5f0.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_3edbac49a6af71a138b1e6d883f78041.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_479debad057fe7bff138efc8d9adb73f.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487
2026-04-27 07:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487
2026-04-27 07:54:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6bd9ecd1-4767-5cec-8d7b-11c98566507c with identifier: FV34487 to the API
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:39:39Z',
'fuel_type': 'diesel',
'id': '6bd9ecd1-4767-5cec-8d7b-11c98566507c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV34487',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 208886,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-05',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'T BlueTEC AMG Line',
'year': 2017}
2026-04-27 07:54:03 [auto1.es] INFO: Saving data for FV34487: {'auction_closing_time': 1777390779.0, 'created_time': 1777021937.647132, 'has_photos': True, 'last_price_update_time': 1777276443.36292}
2026-04-27 07:54:03 [auto1.es] INFO: Found listing with ID: JY49551
2026-04-27 07:54:03 [auto1.es] INFO: Scrape type for JY49551: 2
2026-04-27 07:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551
2026-04-27 07:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d20492db-a229-55f5-a9ce-b0496ee6daf6 with scrape type 2
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d20492db-a229-55f5-a9ce-b0496ee6daf6 with scrape type 2
2026-04-27 07:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d20492db-a229-55f5-a9ce-b0496ee6daf6, identifier: JY49551
2026-04-27 07:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1dc6b04d-90ef-5a97-b82b-d47204c0d24c with identifier: NN94006
2026-04-27 07:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1dc6b04d-90ef-5a97-b82b-d47204c0d24c with identifier: NN94006
2026-04-27 07:54:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1dc6b04d-90ef-5a97-b82b-d47204c0d24c with identifier: NN94006 to the API
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:33:58Z',
'fuel_type': 'diesel',
'id': '1dc6b04d-90ef-5a97-b82b-d47204c0d24c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN94006',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Aircross',
'odometer': 108548,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-09-28',
'seller_name': None,
'title': 'Citroen C4 Aircross 1.6 e-HDi Seduction 2WD',
'transmission': 'manual',
'trim': 'Seduction 2WD',
'year': 2015}
2026-04-27 07:54:03 [auto1.es] INFO: Saving data for NN94006: {'auction_closing_time': 1777390438.0, 'created_time': 1777018451.334039, 'has_photos': True, 'last_price_update_time': 1777276443.849706}
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_9c7887ccca93b5fb8524c89176c45d7c.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 960db568-016a-59b0-bce9-f5cf20a607bc with identifier: EZ13692
2026-04-27 07:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960db568-016a-59b0-bce9-f5cf20a607bc with scrape type 1
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_63b1122170ea494007dedc6d1b83b4a6.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 140eb0ff-cb21-5a50-9e9a-80b0620554ae with identifier: BA75989
2026-04-27 07:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae with scrape type 1
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6aa5d176fe51029881dac20c3aacd91f.jpg not downloaded yet
2026-04-27 07:54:03 [auto1.es] INFO: Found listing with ID: JY49551
2026-04-27 07:54:04 [auto1.es] INFO: Scrape type for JY49551: 2
2026-04-27 07:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d20492db-a229-55f5-a9ce-b0496ee6daf6 with scrape type 2
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d20492db-a229-55f5-a9ce-b0496ee6daf6 with scrape type 2
2026-04-27 07:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d20492db-a229-55f5-a9ce-b0496ee6daf6, identifier: JY49551
2026-04-27 07:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551
2026-04-27 07:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551
2026-04-27 07:54:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551 to the API
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:24:42Z',
'fuel_type': 'diesel',
'id': 'd20492db-a229-55f5-a9ce-b0496ee6daf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY49551',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Clio',
'odometer': 335456,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-01-11',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique Confort',
'transmission': 'manual',
'trim': 'Dynamique Confort',
'year': 2006}
2026-04-27 07:54:04 [auto1.es] INFO: Saving data for JY49551: {'auction_closing_time': 1777389882.0, 'created_time': 1777018034.506385, 'has_photos': True, 'last_price_update_time': 1777276444.492368}
2026-04-27 07:54:04 [auto1.es] INFO: Found listing with ID: YD06754
2026-04-27 07:54:04 [auto1.es] INFO: Scrape type for YD06754: 2
2026-04-27 07:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efbc411b-441e-5bc2-a10c-d85f75fef832 with identifier: YD06754
2026-04-27 07:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efbc411b-441e-5bc2-a10c-d85f75fef832 with scrape type 2
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efbc411b-441e-5bc2-a10c-d85f75fef832 with scrape type 2
2026-04-27 07:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efbc411b-441e-5bc2-a10c-d85f75fef832, identifier: YD06754
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_1a3eeb94f830013d82f51494b3d1cd62.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_e5fed86b6ed4e67d40f5b13f1b28ac06.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_14b2576bfdef1ecb91172cee66a9a98f.jpg not downloaded yet
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG13689> (referer: https://www.auto1.com/v1/car-details-view/GG13689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK07153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551
2026-04-27 07:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551
2026-04-27 07:54:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d20492db-a229-55f5-a9ce-b0496ee6daf6 with identifier: JY49551 to the API
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:24:42Z',
'fuel_type': 'diesel',
'id': 'd20492db-a229-55f5-a9ce-b0496ee6daf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY49551',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Clio',
'odometer': 335456,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-01-11',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique Confort',
'transmission': 'manual',
'trim': 'Dynamique Confort',
'year': 2006}
2026-04-27 07:54:05 [auto1.es] INFO: Saving data for JY49551: {'auction_closing_time': 1777389882.0, 'created_time': 1777018034.506385, 'has_photos': True, 'last_price_update_time': 1777276445.054305}
2026-04-27 07:54:05 [auto1.es] INFO: Found listing with ID: PF91232
2026-04-27 07:54:05 [auto1.es] INFO: Scrape type for PF91232: 2
2026-04-27 07:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232
2026-04-27 07:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with scrape type 2
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with scrape type 2
2026-04-27 07:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 27a92cdb-4c06-5cfc-b753-b8ea81e66851, identifier: PF91232
2026-04-27 07:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efbc411b-441e-5bc2-a10c-d85f75fef832 with identifier: YD06754
2026-04-27 07:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efbc411b-441e-5bc2-a10c-d85f75fef832 with identifier: YD06754
2026-04-27 07:54:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efbc411b-441e-5bc2-a10c-d85f75fef832 with identifier: YD06754 to the API
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-04-28T15:16:55Z',
'fuel_type': 'petrol',
'id': 'efbc411b-441e-5bc2-a10c-d85f75fef832',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD06754',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C2',
'odometer': 214045,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-30',
'seller_name': None,
'title': 'Citroen C2 1.1 Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2009}
2026-04-27 07:54:05 [auto1.es] INFO: Saving data for YD06754: {'auction_closing_time': 1777389415.0, 'created_time': 1777019487.648187, 'has_photos': True, 'last_price_update_time': 1777276445.619917}
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_a0152af125abfd01e137399fd68e00f8.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_1badac9720c7e420ea2e5d39bb0315f4.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7d39f271e0a5b25179102b5f51703388.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c822002-77e8-5fc7-b296-0f0e7c666052 with identifier: XA80872
2026-04-27 07:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c822002-77e8-5fc7-b296-0f0e7c666052 with scrape type 1
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7812ba0795d2ca02617d8a77951fcb9f.jpg not downloaded yet
2026-04-27 07:54:05 [auto1.es] INFO: Found listing with ID: PF91232
2026-04-27 07:54:05 [auto1.es] INFO: Scrape type for PF91232: 2
2026-04-27 07:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with scrape type 2
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with scrape type 2
2026-04-27 07:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 27a92cdb-4c06-5cfc-b753-b8ea81e66851, identifier: PF91232
2026-04-27 07:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232
2026-04-27 07:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232
2026-04-27 07:54:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232 to the API
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:57:26Z',
'fuel_type': 'diesel',
'id': '27a92cdb-4c06-5cfc-b753-b8ea81e66851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF91232',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '407',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-07-27',
'seller_name': None,
'title': 'Peugeot 407 2.0 HDi ST Sport',
'transmission': 'manual',
'trim': 'ST Sport',
'year': 2006}
2026-04-27 07:54:06 [auto1.es] INFO: Saving data for PF91232: {'auction_closing_time': 1777391846.0, 'created_time': 1777018043.934217, 'has_photos': True, 'last_price_update_time': 1777276446.304001}
2026-04-27 07:54:06 [auto1.es] INFO: Found listing with ID: FS60409
2026-04-27 07:54:06 [auto1.es] INFO: Scrape type for FS60409: 2
2026-04-27 07:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f33b7fa-c505-5e52-86b3-b2f538e300fc with identifier: FS60409
2026-04-27 07:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f33b7fa-c505-5e52-86b3-b2f538e300fc with scrape type 2
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f33b7fa-c505-5e52-86b3-b2f538e300fc with scrape type 2
2026-04-27 07:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f33b7fa-c505-5e52-86b3-b2f538e300fc, identifier: FS60409
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_693285f8c174b9644b35ae06dba42c4b.jpg not downloaded yet
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_975fe0da48d42e8c39c8ab254f5b3212.jpg not downloaded yet
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_574b93c122519c15158f4d3dbf96bbc5.jpg not downloaded yet
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ33525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232
2026-04-27 07:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232
2026-04-27 07:54:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 27a92cdb-4c06-5cfc-b753-b8ea81e66851 with identifier: PF91232 to the API
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:57:26Z',
'fuel_type': 'diesel',
'id': '27a92cdb-4c06-5cfc-b753-b8ea81e66851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF91232',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '407',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-07-27',
'seller_name': None,
'title': 'Peugeot 407 2.0 HDi ST Sport',
'transmission': 'manual',
'trim': 'ST Sport',
'year': 2006}
2026-04-27 07:54:06 [auto1.es] INFO: Saving data for PF91232: {'auction_closing_time': 1777391846.0, 'created_time': 1777018043.934217, 'has_photos': True, 'last_price_update_time': 1777276446.942988}
2026-04-27 07:54:06 [auto1.es] INFO: Found listing with ID: FY07234
2026-04-27 07:54:06 [auto1.es] INFO: Scrape type for FY07234: 2
2026-04-27 07:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234
2026-04-27 07:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834ca1e5-0fd1-575f-8069-a419e35daa8e with scrape type 2
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834ca1e5-0fd1-575f-8069-a419e35daa8e with scrape type 2
2026-04-27 07:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 834ca1e5-0fd1-575f-8069-a419e35daa8e, identifier: FY07234
2026-04-27 07:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f33b7fa-c505-5e52-86b3-b2f538e300fc with identifier: FS60409
2026-04-27 07:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f33b7fa-c505-5e52-86b3-b2f538e300fc with identifier: FS60409
2026-04-27 07:54:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f33b7fa-c505-5e52-86b3-b2f538e300fc with identifier: FS60409 to the API
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-04-28T15:45:54Z',
'fuel_type': 'petrol',
'id': '6f33b7fa-c505-5e52-86b3-b2f538e300fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS60409',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C3',
'odometer': 108543,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-12-31',
'seller_name': None,
'title': 'Citroen C3 1.1 Furio',
'transmission': 'manual',
'trim': 'Furio',
'year': 2006}
2026-04-27 07:54:07 [auto1.es] INFO: Saving data for FS60409: {'auction_closing_time': 1777391154.0, 'created_time': 1777020146.857911, 'has_photos': True, 'last_price_update_time': 1777276447.456626}
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_930c8f7e434c8fb8eb132fcaa028e4bd.jpg not downloaded yet
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_6307280bbdf3c0f87eeb3942bfdb7fcb.jpg not downloaded yet
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_80e85fab71e498855bec7673db0ea60d.jpg not downloaded yet
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_3b94db06f54bd5d6cab4bacd46fe0f07.jpg not downloaded yet
2026-04-27 07:54:07 [auto1.es] INFO: Found listing with ID: FY07234
2026-04-27 07:54:07 [auto1.es] INFO: Scrape type for FY07234: 2
2026-04-27 07:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834ca1e5-0fd1-575f-8069-a419e35daa8e with scrape type 2
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834ca1e5-0fd1-575f-8069-a419e35daa8e with scrape type 2
2026-04-27 07:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 834ca1e5-0fd1-575f-8069-a419e35daa8e, identifier: FY07234
2026-04-27 07:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234
2026-04-27 07:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234
2026-04-27 07:54:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234 to the API
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-04-28T15:08:52Z',
'fuel_type': 'diesel',
'id': '834ca1e5-0fd1-575f-8069-a419e35daa8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY07234',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C1',
'odometer': 127830,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-03-30',
'seller_name': None,
'title': 'Citroen C1 1.4 HDi SX',
'transmission': 'manual',
'trim': 'SX',
'year': 2006}
2026-04-27 07:54:08 [auto1.es] INFO: Saving data for FY07234: {'auction_closing_time': 1777388932.0, 'created_time': 1777019750.659126, 'has_photos': True, 'last_price_update_time': 1777276448.065588}
2026-04-27 07:54:08 [auto1.es] INFO: Found listing with ID: LE93241
2026-04-27 07:54:08 [auto1.es] INFO: Scrape type for LE93241: 2
2026-04-27 07:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafae6a8-6b17-5361-82b0-bd51803b6dba with identifier: LE93241
2026-04-27 07:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafae6a8-6b17-5361-82b0-bd51803b6dba with scrape type 2
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafae6a8-6b17-5361-82b0-bd51803b6dba with scrape type 2
2026-04-27 07:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bafae6a8-6b17-5361-82b0-bd51803b6dba, identifier: LE93241
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_e264bfe468a1bb3239566cb5228a1822.jpg not downloaded yet
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_429b386dc266b65c331a84f02ad954b9.jpg not downloaded yet
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_e11a5df139230bd7d7b95590e0482771.jpg not downloaded yet
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_65ec69e6854e105aa7850cbd260f1703.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_9c9a3c34297ef23e356bee531d675b8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_a1dce3830ebb79792164853134c59d61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234
2026-04-27 07:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234
2026-04-27 07:54:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 834ca1e5-0fd1-575f-8069-a419e35daa8e with identifier: FY07234 to the API
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-04-28T15:08:52Z',
'fuel_type': 'diesel',
'id': '834ca1e5-0fd1-575f-8069-a419e35daa8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY07234',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C1',
'odometer': 127830,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-03-30',
'seller_name': None,
'title': 'Citroen C1 1.4 HDi SX',
'transmission': 'manual',
'trim': 'SX',
'year': 2006}
2026-04-27 07:54:08 [auto1.es] INFO: Saving data for FY07234: {'auction_closing_time': 1777388932.0, 'created_time': 1777019750.659126, 'has_photos': True, 'last_price_update_time': 1777276448.744578}
2026-04-27 07:54:08 [auto1.es] INFO: Found listing with ID: GU60658
2026-04-27 07:54:08 [auto1.es] INFO: Scrape type for GU60658: 1
2026-04-27 07:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bafae6a8-6b17-5361-82b0-bd51803b6dba with identifier: LE93241
2026-04-27 07:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bafae6a8-6b17-5361-82b0-bd51803b6dba with identifier: LE93241
2026-04-27 07:54:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bafae6a8-6b17-5361-82b0-bd51803b6dba with identifier: LE93241 to the API
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-04-28T15:22:14Z',
'fuel_type': 'diesel',
'id': 'bafae6a8-6b17-5361-82b0-bd51803b6dba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE93241',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X5',
'odometer': 84315,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-07-11',
'seller_name': None,
'title': 'BMW X5 xDrive 30d Mild-Hybrid xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2022}
2026-04-27 07:54:09 [auto1.es] INFO: Saving data for LE93241: {'auction_closing_time': 1777389734.0, 'created_time': 1777019173.054569, 'has_photos': True, 'last_price_update_time': 1777276449.095907}
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_432e0fff650e336f43d02674d58d67aa.jpg not downloaded yet
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_798dbf90b1931a926b6400fc3ecca8e9.jpg not downloaded yet
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7725261a0fdf3f0429f63e763ccb028a.jpg not downloaded yet
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_881789b691e567677301fdcbf0c1e826.jpg not downloaded yet
2026-04-27 07:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd3bb06-f6d5-538d-a24b-42002a8f0bed with identifier: GG13689
2026-04-27 07:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed with scrape type 1
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_da00b47514dcc40850186f3a22fc667e.jpg not downloaded yet
2026-04-27 07:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_9d9c5bf61f5829468231227f1082c466.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_0550a336d64f383b60fe9348f879adaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:09 [auto1.es] INFO: Found listing with ID: GU60658
2026-04-27 07:54:09 [auto1.es] INFO: Found listing with ID: SN05978
2026-04-27 07:54:09 [auto1.es] INFO: Scrape type for SN05978: 2
2026-04-27 07:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79e3dc2-9590-57e7-9372-316d79a10dc9 with identifier: SN05978
2026-04-27 07:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79e3dc2-9590-57e7-9372-316d79a10dc9 with scrape type 2
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79e3dc2-9590-57e7-9372-316d79a10dc9 with scrape type 2
2026-04-27 07:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b79e3dc2-9590-57e7-9372-316d79a10dc9, identifier: SN05978
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_09b58c17b699290cc04176335f254df9.jpg not downloaded yet
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_59360e2520efe63d888384985fda0ece.jpg not downloaded yet
2026-04-27 07:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_d2b6efc28e26ca77c8d39512fb59c85f.jpg not downloaded yet
2026-04-27 07:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_54497a625570a9315dedbb2ac2cd5cea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b79e3dc2-9590-57e7-9372-316d79a10dc9 with identifier: SN05978
2026-04-27 07:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b79e3dc2-9590-57e7-9372-316d79a10dc9 with identifier: SN05978
2026-04-27 07:54:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b79e3dc2-9590-57e7-9372-316d79a10dc9 with identifier: SN05978 to the API
2026-04-27 07:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:56:02Z',
'fuel_type': 'diesel',
'id': 'b79e3dc2-9590-57e7-9372-316d79a10dc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN05978',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 144755,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-12-18',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-04-27 07:54:10 [auto1.es] INFO: Saving data for SN05978: {'auction_closing_time': 1777391762.0, 'created_time': 1777019231.391276, 'has_photos': True, 'last_price_update_time': 1777276450.001471}
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_cf61fcae2c579c2189a57458c648a383.jpg not downloaded yet
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_e79ef86b7dcf7a851d69a83db24a82f2.jpg not downloaded yet
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_324ceb32828224935fb661266ec93f4b.jpg not downloaded yet
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7621812542cf4776326270f963f58e57.jpg not downloaded yet
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_7679a7a69a72aa98c4099c085f9036af.jpg not downloaded yet
2026-04-27 07:54:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_ee4eeb0e59e73b2f656516f789cb5c0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [auto1.es] INFO: Found listing with ID: RF34041
2026-04-27 07:54:10 [auto1.es] INFO: Scrape type for RF34041: 2
2026-04-27 07:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b3c81f-5245-560a-8992-bdde6216ceb6 with identifier: RF34041
2026-04-27 07:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b3c81f-5245-560a-8992-bdde6216ceb6 with scrape type 2
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b3c81f-5245-560a-8992-bdde6216ceb6 with scrape type 2
2026-04-27 07:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10b3c81f-5245-560a-8992-bdde6216ceb6, identifier: RF34041
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_6ef8ac2332e2d977a96da4dc262c66ea.jpg not downloaded yet
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_c828cc1f56986ee7de6b65a89263e05c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_9b5a49cbecf38b3eb6e431febd3a269d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_da0f30bf15c7a1f17e6f4343dcb35735.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10b3c81f-5245-560a-8992-bdde6216ceb6 with identifier: RF34041
2026-04-27 07:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10b3c81f-5245-560a-8992-bdde6216ceb6 with identifier: RF34041
2026-04-27 07:54:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10b3c81f-5245-560a-8992-bdde6216ceb6 with identifier: RF34041 to the API
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-04-28T15:49:34Z',
'fuel_type': 'petrol',
'id': '10b3c81f-5245-560a-8992-bdde6216ceb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF34041',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Picanto',
'odometer': 121574,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-06-09',
'seller_name': None,
'title': 'Kia Picanto 1.1 LX',
'transmission': 'manual',
'trim': 'LX',
'year': 2004}
2026-04-27 07:54:11 [auto1.es] INFO: Saving data for RF34041: {'auction_closing_time': 1777391374.0, 'created_time': 1777020281.213481, 'has_photos': True, 'last_price_update_time': 1777276451.169982}
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_37030b3b83fa79d74c23e0681989c50d.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_f54c5b2a2cbbbcc0f83ab2db46c696f4.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6ef65fcdee460a5f5f34514dd4ce23c6.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_81e10088cabd39f113baf0bc66c7956e.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_4869abd4cbc8b40ee12bd674d91911b4.jpg not downloaded yet
2026-04-27 07:54:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 36f195bf-b061-498b-bebd-997f7853af90
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048971550>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2099
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxdev.blob.core.windows.net:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_65ec69e6854e105aa7850cbd260f1703.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ecd10>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55a86871-2b4f-50ad-94ec-c257548c1557/55a86871-2b4f-50ad-94ec-c257548c1557_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_9c9a3c34297ef23e356bee531d675b8e.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c8850>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81ca799-7604-572e-9667-7b611d005346/b81ca799-7604-572e-9667-7b611d005346_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_a1dce3830ebb79792164853134c59d61.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b81ca799-7604-572e-9667-7b611d005346
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483437d0>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81ca799-7604-572e-9667-7b611d005346/b81ca799-7604-572e-9667-7b611d005346_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_9d9c5bf61f5829468231227f1082c466.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b81ca799-7604-572e-9667-7b611d005346
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048340c90>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55a86871-2b4f-50ad-94ec-c257548c1557/55a86871-2b4f-50ad-94ec-c257548c1557_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_0550a336d64f383b60fe9348f879adaf.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:54:11 [auto1.es] INFO: Found listing with ID: RD28461
2026-04-27 07:54:11 [auto1.es] INFO: Scrape type for RD28461: 1
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6aa5d176fe51029881dac20c3aacd91f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_9fb5297e829610dbdce70a387a3d070c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_63b1122170ea494007dedc6d1b83b4a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_306f39351e93d64dca93119d8c2dde7c.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_23d9a2d0dd52a5081c8255e6f0a3f2b6.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_ebbe2d67cb68b408a1fb2b3f5cc01fa4.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_42371b7aee71511933d0c54c67b112f3.jpg not downloaded yet
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_5bcca7ca1256437f89c2498322731d0d.jpg not downloaded yet
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a81790>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_54497a625570a9315dedbb2ac2cd5cea.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876e8d0>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_ee4eeb0e59e73b2f656516f789cb5c0d.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:11 [auto1.es] INFO: Found listing with ID: UM80175
2026-04-27 07:54:11 [auto1.es] INFO: Scrape type for UM80175: 2
2026-04-27 07:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30bb922b-56a9-520a-bfbc-cfc3c57b716d with identifier: UM80175
2026-04-27 07:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bb922b-56a9-520a-bfbc-cfc3c57b716d with scrape type 2
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30bb922b-56a9-520a-bfbc-cfc3c57b716d with scrape type 2
2026-04-27 07:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30bb922b-56a9-520a-bfbc-cfc3c57b716d, identifier: UM80175
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876f110>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_c828cc1f56986ee7de6b65a89263e05c.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048608a90>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_9b5a49cbecf38b3eb6e431febd3a269d.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048495190>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81ca799-7604-572e-9667-7b611d005346/b81ca799-7604-572e-9667-7b611d005346_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/12/d612374a47a872a29848d385d70f0275/pa/MZ61367_da0f30bf15c7a1f17e6f4343dcb35735.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b81ca799-7604-572e-9667-7b611d005346
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_6307280bbdf3c0f87eeb3942bfdb7fcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7812ba0795d2ca02617d8a77951fcb9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30bb922b-56a9-520a-bfbc-cfc3c57b716d with identifier: UM80175
2026-04-27 07:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30bb922b-56a9-520a-bfbc-cfc3c57b716d with identifier: UM80175
2026-04-27 07:54:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30bb922b-56a9-520a-bfbc-cfc3c57b716d with identifier: UM80175 to the API
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:17:10Z',
'fuel_type': 'petrol',
'id': '30bb922b-56a9-520a-bfbc-cfc3c57b716d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM80175',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 77237,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-02-28',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Sport BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport BlueMotion Tech',
'year': 2017}
2026-04-27 07:54:12 [auto1.es] INFO: Saving data for UM80175: {'auction_closing_time': 1777389430.0, 'created_time': 1777019897.759188, 'has_photos': True, 'last_price_update_time': 1777276452.64942}
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_366885955e3a13afea1e12fa3be11247.jpg not downloaded yet
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_9e6dc0ce54909eae38159f4935fbaec0.jpg not downloaded yet
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_0b1c6fa0ae1905c6344a40765727da4b.jpg not downloaded yet
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_33e2f1f8fab1761001b2d5914c83f561.jpg not downloaded yet
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_8be956dac02612b6691d89a37ddfcb74.jpg not downloaded yet
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_3b94db06f54bd5d6cab4bacd46fe0f07.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_80e85fab71e498855bec7673db0ea60d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [auto1.es] INFO: Found listing with ID: NW06210
2026-04-27 07:54:12 [auto1.es] INFO: Scrape type for NW06210: 2
2026-04-27 07:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9079cbbc-d991-57a8-9888-d0c00064ce21 with identifier: NW06210
2026-04-27 07:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9079cbbc-d991-57a8-9888-d0c00064ce21 with scrape type 2
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9079cbbc-d991-57a8-9888-d0c00064ce21 with scrape type 2
2026-04-27 07:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9079cbbc-d991-57a8-9888-d0c00064ce21, identifier: NW06210
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488d0fd0>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6aa5d176fe51029881dac20c3aacd91f.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048aa6010>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_9fb5297e829610dbdce70a387a3d070c.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42290>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_63b1122170ea494007dedc6d1b83b4a6.jpg saved to cache
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_da00b47514dcc40850186f3a22fc667e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_7679a7a69a72aa98c4099c085f9036af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_881789b691e567677301fdcbf0c1e826.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9079cbbc-d991-57a8-9888-d0c00064ce21 with identifier: NW06210
2026-04-27 07:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9079cbbc-d991-57a8-9888-d0c00064ce21 with identifier: NW06210
2026-04-27 07:54:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9079cbbc-d991-57a8-9888-d0c00064ce21 with identifier: NW06210 to the API
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-04-28T15:21:59Z',
'fuel_type': 'petrol',
'id': '9079cbbc-d991-57a8-9888-d0c00064ce21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW06210',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 70695,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-03-23',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2017}
2026-04-27 07:54:13 [auto1.es] INFO: Saving data for NW06210: {'auction_closing_time': 1777389719.0, 'created_time': 1777018534.146846, 'has_photos': True, 'last_price_update_time': 1777276453.350289}
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_cab63a5e42952d7201356a993049c5da.jpg not downloaded yet
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_108a4fa9b1877403603d52c92ada7e55.jpg not downloaded yet
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_ba2cc731fd62eb62cd354d29be0b36e9.jpg not downloaded yet
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_191e0220d56e529ef82c2e5c3cf836ff.jpg not downloaded yet
2026-04-27 07:54:13 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2010 | hits on page: 40
2026-04-27 07:54:13 [auto1.es] INFO: Found listing with ID: KW41207
2026-04-27 07:54:13 [auto1.es] INFO: Scrape type for KW41207: 2
2026-04-27 07:54:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-04-27 07:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09f6640-f68b-5e2e-86fe-53c0624e6dfc with scrape type 2
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09f6640-f68b-5e2e-86fe-53c0624e6dfc with scrape type 2
2026-04-27 07:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a09f6640-f68b-5e2e-86fe-53c0624e6dfc, identifier: KW41207
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7621812542cf4776326270f963f58e57.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_324ceb32828224935fb661266ec93f4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-04-27 07:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-04-27 07:54:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207 to the API
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:14:20Z',
'fuel_type': 'diesel',
'id': 'a09f6640-f68b-5e2e-86fe-53c0624e6dfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW41207',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 112407,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-08-02',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Reference Copa',
'transmission': 'manual',
'trim': 'Reference Copa',
'year': 2011}
2026-04-27 07:54:14 [auto1.es] INFO: Saving data for KW41207: {'auction_closing_time': 1777389260.0, 'created_time': 1777019122.014224, 'has_photos': True, 'last_price_update_time': 1777276454.037562}
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_74a0d2c013f27d156338836fef9900bf.jpg not downloaded yet
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_bada0e8423599198ccaf5b144012a087.jpg not downloaded yet
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_5faf7cde893e3b6f820fbf428fad80cf.jpg not downloaded yet
2026-04-27 07:54:14 [auto1.es] INFO: Found listing with ID: AJ69515
2026-04-27 07:54:14 [auto1.es] INFO: Scrape type for AJ69515: 2
2026-04-27 07:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4097f50f-4f54-525e-b5fc-f768a977f452 with identifier: AJ69515
2026-04-27 07:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4097f50f-4f54-525e-b5fc-f768a977f452 with scrape type 2
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4097f50f-4f54-525e-b5fc-f768a977f452 with scrape type 2
2026-04-27 07:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4097f50f-4f54-525e-b5fc-f768a977f452, identifier: AJ69515
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff05766c410>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_6307280bbdf3c0f87eeb3942bfdb7fcb.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487e1c50>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7812ba0795d2ca02617d8a77951fcb9f.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488462d0>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_3b94db06f54bd5d6cab4bacd46fe0f07.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488faa50>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_80e85fab71e498855bec7673db0ea60d.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_4869abd4cbc8b40ee12bd674d91911b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_81e10088cabd39f113baf0bc66c7956e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [auto1.es] INFO: Found listing with ID: JZ79034
2026-04-27 07:54:14 [auto1.es] INFO: Scrape type for JZ79034: 2
2026-04-27 07:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034
2026-04-27 07:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f4eca3-5e3a-573e-add2-a9d34646be57 with scrape type 2
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f4eca3-5e3a-573e-add2-a9d34646be57 with scrape type 2
2026-04-27 07:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1f4eca3-5e3a-573e-add2-a9d34646be57, identifier: JZ79034
2026-04-27 07:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4097f50f-4f54-525e-b5fc-f768a977f452 with identifier: AJ69515
2026-04-27 07:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4097f50f-4f54-525e-b5fc-f768a977f452 with identifier: AJ69515
2026-04-27 07:54:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4097f50f-4f54-525e-b5fc-f768a977f452 with identifier: AJ69515 to the API
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-04-28T15:53:06Z',
'fuel_type': 'diesel',
'id': '4097f50f-4f54-525e-b5fc-f768a977f452',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ69515',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 253339,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-09-05',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-04-27 07:54:14 [auto1.es] INFO: Saving data for AJ69515: {'auction_closing_time': 1777391586.0, 'created_time': 1777019908.931979, 'has_photos': True, 'last_price_update_time': 1777276454.828613}
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6ef65fcdee460a5f5f34514dd4ce23c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034
2026-04-27 07:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034
2026-04-27 07:54:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034 to the API
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:38:06Z',
'fuel_type': 'diesel',
'id': 'b1f4eca3-5e3a-573e-add2-a9d34646be57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ79034',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ssangyong',
'model': 'Rexton',
'odometer': 260301,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-08-31',
'seller_name': None,
'title': 'Ssangyong Rexton RX 270 Xdi',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-04-27 07:54:15 [auto1.es] INFO: Saving data for JZ79034: {'auction_closing_time': 1777390686.0, 'created_time': 1777020421.531499, 'has_photos': True, 'last_price_update_time': 1777276455.157756}
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_8c0cc4518eefc3f8861603d6e825fd7c.jpg not downloaded yet
2026-04-27 07:54:15 [auto1.es] INFO: Found listing with ID: PR86771
2026-04-27 07:54:15 [auto1.es] INFO: Scrape type for PR86771: 2
2026-04-27 07:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49cdc903-743d-5311-8be8-ebf8e2b2dd39 with identifier: PR86771
2026-04-27 07:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49cdc903-743d-5311-8be8-ebf8e2b2dd39 with scrape type 2
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49cdc903-743d-5311-8be8-ebf8e2b2dd39 with scrape type 2
2026-04-27 07:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49cdc903-743d-5311-8be8-ebf8e2b2dd39, identifier: PR86771
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048577d50>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_da00b47514dcc40850186f3a22fc667e.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486959d0>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_7679a7a69a72aa98c4099c085f9036af.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ee350>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_881789b691e567677301fdcbf0c1e826.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_5bcca7ca1256437f89c2498322731d0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_42371b7aee71511933d0c54c67b112f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [auto1.es] INFO: Found listing with ID: ZP60568
2026-04-27 07:54:15 [auto1.es] INFO: Scrape type for ZP60568: 1
2026-04-27 07:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49cdc903-743d-5311-8be8-ebf8e2b2dd39 with identifier: PR86771
2026-04-27 07:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49cdc903-743d-5311-8be8-ebf8e2b2dd39 with identifier: PR86771
2026-04-27 07:54:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49cdc903-743d-5311-8be8-ebf8e2b2dd39 with identifier: PR86771 to the API
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:18:05Z',
'fuel_type': 'petrol',
'id': '49cdc903-743d-5311-8be8-ebf8e2b2dd39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR86771',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 220635,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Opel Astra 1.6 Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2014}
2026-04-27 07:54:15 [auto1.es] INFO: Saving data for PR86771: {'auction_closing_time': 1777389485.0, 'created_time': 1777019313.037928, 'has_photos': True, 'last_price_update_time': 1777276455.740853}
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_23d9a2d0dd52a5081c8255e6f0a3f2b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_ebbe2d67cb68b408a1fb2b3f5cc01fa4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [auto1.es] INFO: Found listing with ID: BF22404
2026-04-27 07:54:15 [auto1.es] INFO: Scrape type for BF22404: 2
2026-04-27 07:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a80113-2d6d-5a03-adf6-7ad4af74d20a with identifier: BF22404
2026-04-27 07:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a80113-2d6d-5a03-adf6-7ad4af74d20a with scrape type 2
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a80113-2d6d-5a03-adf6-7ad4af74d20a with scrape type 2
2026-04-27 07:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38a80113-2d6d-5a03-adf6-7ad4af74d20a, identifier: BF22404
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_8be956dac02612b6691d89a37ddfcb74.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [auto1.es] INFO: Found listing with ID: FL29872
2026-04-27 07:54:15 [auto1.es] INFO: Scrape type for FL29872: 2
2026-04-27 07:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e54202-6625-55e7-bbec-8287e3932612 with identifier: FL29872
2026-04-27 07:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e54202-6625-55e7-bbec-8287e3932612 with scrape type 2
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e54202-6625-55e7-bbec-8287e3932612 with scrape type 2
2026-04-27 07:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 70e54202-6625-55e7-bbec-8287e3932612, identifier: FL29872
2026-04-27 07:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38a80113-2d6d-5a03-adf6-7ad4af74d20a with identifier: BF22404
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-04-27 07:54:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38a80113-2d6d-5a03-adf6-7ad4af74d20a with identifier: BF22404
2026-04-27 07:54:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38a80113-2d6d-5a03-adf6-7ad4af74d20a with identifier: BF22404 to the API
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:38:02Z',
'fuel_type': 'diesel',
'id': '38a80113-2d6d-5a03-adf6-7ad4af74d20a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF22404',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Captur',
'odometer': 95857,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-07-29',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2014}
2026-04-27 07:54:16 [auto1.es] INFO: Saving data for BF22404: {'auction_closing_time': 1777390682.0, 'created_time': 1777020336.532218, 'has_photos': True, 'last_price_update_time': 1777276456.450562}
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3990>
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7621812542cf4776326270f963f58e57.jpg saved to cache
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fd490>
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_324ceb32828224935fb661266ec93f4b.jpg saved to cache
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b55d0>
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_4869abd4cbc8b40ee12bd674d91911b4.jpg saved to cache
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fcd90>
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_81e10088cabd39f113baf0bc66c7956e.jpg saved to cache
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048846a90>
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6ef65fcdee460a5f5f34514dd4ce23c6.jpg saved to cache
2026-04-27 07:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_33e2f1f8fab1761001b2d5914c83f561.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_306f39351e93d64dca93119d8c2dde7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 70e54202-6625-55e7-bbec-8287e3932612 with identifier: FL29872
2026-04-27 07:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 70e54202-6625-55e7-bbec-8287e3932612 with identifier: FL29872
2026-04-27 07:54:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 70e54202-6625-55e7-bbec-8287e3932612 with identifier: FL29872 to the API
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:45:52Z',
'fuel_type': 'petrol',
'id': '70e54202-6625-55e7-bbec-8287e3932612',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL29872',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 155161,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-04-08',
'seller_name': None,
'title': 'Audi A5 Sportback 1.8 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-04-27 07:54:17 [auto1.es] INFO: Saving data for FL29872: {'auction_closing_time': 1777391152.0, 'created_time': 1777018867.645243, 'has_photos': True, 'last_price_update_time': 1777276457.057458}
2026-04-27 07:54:17 [auto1.es] INFO: Found listing with ID: SR81888
2026-04-27 07:54:17 [auto1.es] INFO: Scrape type for SR81888: 1
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_191e0220d56e529ef82c2e5c3cf836ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [auto1.es] INFO: Found listing with ID: GW37320
2026-04-27 07:54:17 [auto1.es] INFO: Scrape type for GW37320: 2
2026-04-27 07:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320
2026-04-27 07:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with scrape type 2
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with scrape type 2
2026-04-27 07:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29c7aec2-cfc3-5051-8650-d0b1f634ec19, identifier: GW37320
2026-04-27 07:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885ad0>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_5bcca7ca1256437f89c2498322731d0d.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487b8910>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_42371b7aee71511933d0c54c67b112f3.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0636602d0>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_23d9a2d0dd52a5081c8255e6f0a3f2b6.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057514250>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_ebbe2d67cb68b408a1fb2b3f5cc01fa4.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_0b1c6fa0ae1905c6344a40765727da4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320
2026-04-27 07:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320
2026-04-27 07:54:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320 to the API
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:21:19Z',
'fuel_type': 'diesel',
'id': '29c7aec2-cfc3-5051-8650-d0b1f634ec19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW37320',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 185871,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2013}
2026-04-27 07:54:17 [auto1.es] INFO: Saving data for GW37320: {'auction_closing_time': 1777389679.0, 'created_time': 1777018461.379592, 'has_photos': True, 'last_price_update_time': 1777276457.729555}
2026-04-27 07:54:17 [auto1.es] INFO: Found listing with ID: LY59723
2026-04-27 07:54:17 [auto1.es] INFO: Scrape type for LY59723: 2
2026-04-27 07:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077af8fc-4ed4-5a8b-aac7-6016422efcd1 with identifier: LY59723
2026-04-27 07:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077af8fc-4ed4-5a8b-aac7-6016422efcd1 with scrape type 2
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 077af8fc-4ed4-5a8b-aac7-6016422efcd1 with scrape type 2
2026-04-27 07:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 077af8fc-4ed4-5a8b-aac7-6016422efcd1, identifier: LY59723
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK07153> (referer: https://www.auto1.com/v1/car-details-view/AK07153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ33525> (referer: https://www.auto1.com/v1/car-details-view/VJ33525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487bae10>
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_8be956dac02612b6691d89a37ddfcb74.jpg saved to cache
2026-04-27 07:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_5faf7cde893e3b6f820fbf428fad80cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_74a0d2c013f27d156338836fef9900bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_bada0e8423599198ccaf5b144012a087.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:17 [auto1.es] INFO: Found listing with ID: ZG12756
2026-04-27 07:54:17 [auto1.es] INFO: Scrape type for ZG12756: 1
2026-04-27 07:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 077af8fc-4ed4-5a8b-aac7-6016422efcd1 with identifier: LY59723
2026-04-27 07:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 077af8fc-4ed4-5a8b-aac7-6016422efcd1 with identifier: LY59723
2026-04-27 07:54:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 077af8fc-4ed4-5a8b-aac7-6016422efcd1 with identifier: LY59723 to the API
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:04:33Z',
'fuel_type': 'diesel',
'id': '077af8fc-4ed4-5a8b-aac7-6016422efcd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY59723',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': '500X',
'odometer': 92369,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-07-14',
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-04-27 07:54:18 [auto1.es] INFO: Saving data for LY59723: {'auction_closing_time': 1777388673.0, 'created_time': 1777018639.290294, 'has_photos': True, 'last_price_update_time': 1777276458.26043}
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_ba2cc731fd62eb62cd354d29be0b36e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_108a4fa9b1877403603d52c92ada7e55.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [auto1.es] INFO: Found listing with ID: DR12042
2026-04-27 07:54:18 [auto1.es] INFO: Scrape type for DR12042: 2
2026-04-27 07:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ada0d54-a5dd-5af3-b487-04ee791d138e with identifier: DR12042
2026-04-27 07:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada0d54-a5dd-5af3-b487-04ee791d138e with scrape type 2
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ada0d54-a5dd-5af3-b487-04ee791d138e with scrape type 2
2026-04-27 07:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ada0d54-a5dd-5af3-b487-04ee791d138e, identifier: DR12042
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048840f50>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_33e2f1f8fab1761001b2d5914c83f561.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ff0d0>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_306f39351e93d64dca93119d8c2dde7c.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048872cd0>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_191e0220d56e529ef82c2e5c3cf836ff.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed
2026-04-27 07:54:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecd3bb06-f6d5-538d-a24b-42002a8f0bed, skipping ID generation
2026-04-27 07:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed with scrape type 1
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecd3bb06-f6d5-538d-a24b-42002a8f0bed sending to next pipeline
2026-04-27 07:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecd3bb06-f6d5-538d-a24b-42002a8f0bed, identifier: GG13689
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_8c0cc4518eefc3f8861603d6e825fd7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [auto1.es] INFO: Found listing with ID: SX68849
2026-04-27 07:54:18 [auto1.es] INFO: Scrape type for SX68849: 1
2026-04-27 07:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ada0d54-a5dd-5af3-b487-04ee791d138e with identifier: DR12042
2026-04-27 07:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ada0d54-a5dd-5af3-b487-04ee791d138e with identifier: DR12042
2026-04-27 07:54:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ada0d54-a5dd-5af3-b487-04ee791d138e with identifier: DR12042 to the API
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 232,
'expiration_date': '2026-04-28T15:36:58Z',
'fuel_type': 'diesel',
'id': '3ada0d54-a5dd-5af3-b487-04ee791d138e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR12042',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A4',
'odometer': 255906,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-12-26',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2007}
2026-04-27 07:54:18 [auto1.es] INFO: Saving data for DR12042: {'auction_closing_time': 1777390618.0, 'created_time': 1777020198.437407, 'has_photos': True, 'last_price_update_time': 1777276458.98108}
2026-04-27 07:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecd3bb06-f6d5-538d-a24b-42002a8f0bed with identifier: GG13689
2026-04-27 07:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecd3bb06-f6d5-538d-a24b-42002a8f0bed with identifier: GG13689
2026-04-27 07:54:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecd3bb06-f6d5-538d-a24b-42002a8f0bed with identifier: GG13689 to the API
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_191e0220d56e529ef82c2e5c3cf836ff.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Carpio',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '3.5L',
'engine_horse_power': 272,
'expiration_date': '2026-04-28T15:18:36Z',
'fuel_type': 'petrol',
'id': 'ecd3bb06-f6d5-538d-a24b-42002a8f0bed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.9409,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG13689',
'listing': 'auction',
'location': 'ES, El Carpio',
'location_confidence': 'geocoded',
'longitude': -4.4966,
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 347408,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_da00b47514dcc40850186f3a22fc667e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_7679a7a69a72aa98c4099c085f9036af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_4869abd4cbc8b40ee12bd674d91911b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_5bcca7ca1256437f89c2498322731d0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_8be956dac02612b6691d89a37ddfcb74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecd3bb06-f6d5-538d-a24b-42002a8f0bed/ecd3bb06-f6d5-538d-a24b-42002a8f0bed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/69/6369d5b9ea9b907b08052cd65f23f1a5/pa/GG13689_191e0220d56e529ef82c2e5c3cf836ff.jpg',
'Width': 800}],
'postal_code': '14620',
'price': 0,
'price_includes_vat': True,
'province': 'Córdoba',
'province_code': 'ES-CO',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2006-08-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 350',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-04-27 07:54:19 [auto1.es] INFO: Saving data for GG13689: {'created_time': 1777276459.333462, 'last_price_update_time': 1777276459.333481, 'has_photos': True, 'auction_closing_time': 1777389516.0}
2026-04-27 07:54:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_cab63a5e42952d7201356a993049c5da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [auto1.es] INFO: Found listing with ID: HK12855
2026-04-27 07:54:19 [auto1.es] INFO: Scrape type for HK12855: 2
2026-04-27 07:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ef4620-1bf1-5dff-adfc-215eed49d795 with identifier: HK12855
2026-04-27 07:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ef4620-1bf1-5dff-adfc-215eed49d795 with scrape type 2
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ef4620-1bf1-5dff-adfc-215eed49d795 with scrape type 2
2026-04-27 07:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 18ef4620-1bf1-5dff-adfc-215eed49d795, identifier: HK12855
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:19 [auto1.es] INFO: Found listing with ID: ZD70181
2026-04-27 07:54:19 [auto1.es] INFO: Scrape type for ZD70181: 2
2026-04-27 07:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ebec00-94a2-5d07-b52c-7be965c5ff76 with identifier: ZD70181
2026-04-27 07:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ebec00-94a2-5d07-b52c-7be965c5ff76 with scrape type 2
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67ebec00-94a2-5d07-b52c-7be965c5ff76 with scrape type 2
2026-04-27 07:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 67ebec00-94a2-5d07-b52c-7be965c5ff76, identifier: ZD70181
2026-04-27 07:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 18ef4620-1bf1-5dff-adfc-215eed49d795 with identifier: HK12855
2026-04-27 07:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 18ef4620-1bf1-5dff-adfc-215eed49d795 with identifier: HK12855
2026-04-27 07:54:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 18ef4620-1bf1-5dff-adfc-215eed49d795 with identifier: HK12855 to the API
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:22:53Z',
'fuel_type': 'diesel',
'id': '18ef4620-1bf1-5dff-adfc-215eed49d795',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK12855',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 175092,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-12-22',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2011}
2026-04-27 07:54:19 [auto1.es] INFO: Saving data for HK12855: {'auction_closing_time': 1777389773.0, 'created_time': 1777018671.125427, 'has_photos': True, 'last_price_update_time': 1777276459.97583}
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fda50>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_0b1c6fa0ae1905c6344a40765727da4b.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7443f85a-9bbe-5890-8eef-e78da6a37a48 with identifier: AK07153
2026-04-27 07:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7443f85a-9bbe-5890-8eef-e78da6a37a48 with scrape type 1
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_5925567f4fd85d717f0432f5d393086a.jpg not downloaded yet
2026-04-27 07:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91b888d5-973b-5272-a533-e5fdf6369ca1 with identifier: VJ33525
2026-04-27 07:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91b888d5-973b-5272-a533-e5fdf6369ca1 with scrape type 1
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_8389bf9825f43fd66b4ccda4eb3a9886.jpg not downloaded yet
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048580d90>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_5faf7cde893e3b6f820fbf428fad80cf.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048581710>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_74a0d2c013f27d156338836fef9900bf.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048457850>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_bada0e8423599198ccaf5b144012a087.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048485110>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_ba2cc731fd62eb62cd354d29be0b36e9.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485244d0>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_108a4fa9b1877403603d52c92ada7e55.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_37030b3b83fa79d74c23e0681989c50d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_9e6dc0ce54909eae38159f4935fbaec0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_366885955e3a13afea1e12fa3be11247.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 67ebec00-94a2-5d07-b52c-7be965c5ff76 with identifier: ZD70181
2026-04-27 07:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 67ebec00-94a2-5d07-b52c-7be965c5ff76 with identifier: ZD70181
2026-04-27 07:54:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 67ebec00-94a2-5d07-b52c-7be965c5ff76 with identifier: ZD70181 to the API
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:21:02Z',
'fuel_type': 'diesel',
'id': '67ebec00-94a2-5d07-b52c-7be965c5ff76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD70181',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 136915,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-07-28',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-04-27 07:54:21 [auto1.es] INFO: Saving data for ZD70181: {'auction_closing_time': 1777389662.0, 'created_time': 1777020130.301439, 'has_photos': True, 'last_price_update_time': 1777276461.071561}
2026-04-27 07:54:21 [auto1.es] INFO: Found listing with ID: GW46978
2026-04-27 07:54:21 [auto1.es] INFO: Scrape type for GW46978: 2
2026-04-27 07:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978
2026-04-27 07:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with scrape type 2
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with scrape type 2
2026-04-27 07:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0347fef3-23eb-55c8-b86e-d728d1c4fd03, identifier: GW46978
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_e79ef86b7dcf7a851d69a83db24a82f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_f54c5b2a2cbbbcc0f83ab2db46c696f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [auto1.es] INFO: Found listing with ID: PK32914
2026-04-27 07:54:21 [auto1.es] INFO: Scrape type for PK32914: 2
2026-04-27 07:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914
2026-04-27 07:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with scrape type 2
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with scrape type 2
2026-04-27 07:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0091f5f8-ec06-59a0-b7fe-e250db4c0560, identifier: PK32914
2026-04-27 07:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978
2026-04-27 07:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978
2026-04-27 07:54:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978 to the API
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-04-28T15:20:21Z',
'fuel_type': 'petrol',
'id': '0347fef3-23eb-55c8-b86e-d728d1c4fd03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW46978',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Clio',
'odometer': 38711,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-09-28',
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2021}
2026-04-27 07:54:21 [auto1.es] INFO: Saving data for GW46978: {'auction_closing_time': 1777389621.0, 'created_time': 1777019259.009741, 'has_photos': True, 'last_price_update_time': 1777276461.677678}
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_8af2c9bbe850d947f49e1fd42f45d6ef.jpg not downloaded yet
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_88482b89a81c0b443e0cd8eaa13394b1.jpg not downloaded yet
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD28461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cb310>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_8c0cc4518eefc3f8861603d6e825fd7c.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c822002-77e8-5fc7-b296-0f0e7c666052
2026-04-27 07:54:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c822002-77e8-5fc7-b296-0f0e7c666052, skipping ID generation
2026-04-27 07:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c822002-77e8-5fc7-b296-0f0e7c666052 with scrape type 1
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c822002-77e8-5fc7-b296-0f0e7c666052 sending to next pipeline
2026-04-27 07:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c822002-77e8-5fc7-b296-0f0e7c666052, identifier: XA80872
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04888f3d0>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_cab63a5e42952d7201356a993049c5da.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_cf61fcae2c579c2189a57458c648a383.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_6ef8ac2332e2d977a96da4dc262c66ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914
2026-04-27 07:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914
2026-04-27 07:54:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914 to the API
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:41:30Z',
'fuel_type': 'petrol',
'id': '0091f5f8-ec06-59a0-b7fe-e250db4c0560',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK32914',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 84297,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-05-03',
'seller_name': None,
'title': 'Ford Focus 1.6 Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2006}
2026-04-27 07:54:22 [auto1.es] INFO: Saving data for PK32914: {'auction_closing_time': 1777390890.0, 'created_time': 1777019662.66737, 'has_photos': True, 'last_price_update_time': 1777276462.307535}
2026-04-27 07:54:22 [auto1.es] INFO: Found listing with ID: AN99539
2026-04-27 07:54:22 [auto1.es] INFO: Scrape type for AN99539: 2
2026-04-27 07:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a55c5f-08ed-5af1-8027-8210ab9c3eaa with identifier: AN99539
2026-04-27 07:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a55c5f-08ed-5af1-8027-8210ab9c3eaa with scrape type 2
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a55c5f-08ed-5af1-8027-8210ab9c3eaa with scrape type 2
2026-04-27 07:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a6a55c5f-08ed-5af1-8027-8210ab9c3eaa, identifier: AN99539
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP60568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c822002-77e8-5fc7-b296-0f0e7c666052 with identifier: XA80872
2026-04-27 07:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c822002-77e8-5fc7-b296-0f0e7c666052 with identifier: XA80872
2026-04-27 07:54:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c822002-77e8-5fc7-b296-0f0e7c666052 with identifier: XA80872 to the API
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_8c0cc4518eefc3f8861603d6e825fd7c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Valladolid',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 235,
'expiration_date': '2026-04-28T15:30:53Z',
'fuel_type': 'diesel',
'id': '0c822002-77e8-5fc7-b296-0f0e7c666052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6505,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA80872',
'listing': 'auction',
'location': 'ES, Valladolid',
'location_confidence': 'geocoded',
'longitude': -4.7287,
'make': 'Volvo',
'model': 'XC90',
'odometer': 138800,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7812ba0795d2ca02617d8a77951fcb9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_3b94db06f54bd5d6cab4bacd46fe0f07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_881789b691e567677301fdcbf0c1e826.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_7621812542cf4776326270f963f58e57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_81e10088cabd39f113baf0bc66c7956e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_42371b7aee71511933d0c54c67b112f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_33e2f1f8fab1761001b2d5914c83f561.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_ba2cc731fd62eb62cd354d29be0b36e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_5faf7cde893e3b6f820fbf428fad80cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c822002-77e8-5fc7-b296-0f0e7c666052/0c822002-77e8-5fc7-b296-0f0e7c666052_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/44/87446a120904efe2841533eabfe3478c/pa/XA80872_8c0cc4518eefc3f8861603d6e825fd7c.jpg',
'Width': 800}],
'postal_code': '47001',
'price': 0,
'price_includes_vat': True,
'province': 'Valladolid',
'province_code': 'ES-VA',
'region': 'Castilla - Leon',
'region_code': 'ES-CL',
'registration_date': '2019-07-24',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2019}
2026-04-27 07:54:22 [auto1.es] INFO: Saving data for XA80872: {'created_time': 1777276462.846829, 'last_price_update_time': 1777276462.846843, 'has_photos': True, 'auction_closing_time': 1777390253.0}
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [auto1.es] INFO: Found listing with ID: SD64713
2026-04-27 07:54:23 [auto1.es] INFO: Scrape type for SD64713: 2
2026-04-27 07:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14b175f4-4006-519d-af6c-f099baf4f8c4 with identifier: SD64713
2026-04-27 07:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14b175f4-4006-519d-af6c-f099baf4f8c4 with scrape type 2
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14b175f4-4006-519d-af6c-f099baf4f8c4 with scrape type 2
2026-04-27 07:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14b175f4-4006-519d-af6c-f099baf4f8c4, identifier: SD64713
2026-04-27 07:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a6a55c5f-08ed-5af1-8027-8210ab9c3eaa with identifier: AN99539
2026-04-27 07:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a6a55c5f-08ed-5af1-8027-8210ab9c3eaa with identifier: AN99539
2026-04-27 07:54:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a6a55c5f-08ed-5af1-8027-8210ab9c3eaa with identifier: AN99539 to the API
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:56:51Z',
'fuel_type': 'diesel',
'id': 'a6a55c5f-08ed-5af1-8027-8210ab9c3eaa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN99539',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 141525,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-09-08',
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2015}
2026-04-27 07:54:23 [auto1.es] INFO: Saving data for AN99539: {'auction_closing_time': 1777391811.0, 'created_time': 1777020469.205583, 'has_photos': True, 'last_price_update_time': 1777276463.408895}
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_fc7e01f14bbf3d25203f92e6627b6f51.jpg not downloaded yet
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_1be10205bf9a5d064a9c620ff8d3547e.jpg not downloaded yet
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_09b58c17b699290cc04176335f254df9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14b175f4-4006-519d-af6c-f099baf4f8c4 with identifier: SD64713
2026-04-27 07:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14b175f4-4006-519d-af6c-f099baf4f8c4 with identifier: SD64713
2026-04-27 07:54:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14b175f4-4006-519d-af6c-f099baf4f8c4 with identifier: SD64713 to the API
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:40:51Z',
'fuel_type': 'diesel',
'id': '14b175f4-4006-519d-af6c-f099baf4f8c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD64713',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 314823,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-01',
'seller_name': None,
'title': 'Audi A6 Allroad 2.7 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-04-27 07:54:23 [auto1.es] INFO: Saving data for SD64713: {'auction_closing_time': 1777390851.0, 'created_time': 1777018832.591874, 'has_photos': True, 'last_price_update_time': 1777276463.79167}
2026-04-27 07:54:23 [auto1.es] INFO: Found listing with ID: UP31650
2026-04-27 07:54:23 [auto1.es] INFO: Scrape type for UP31650: 2
2026-04-27 07:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b9704b-c2b0-5d11-8027-fef68092b212 with identifier: UP31650
2026-04-27 07:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b9704b-c2b0-5d11-8027-fef68092b212 with scrape type 2
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b9704b-c2b0-5d11-8027-fef68092b212 with scrape type 2
2026-04-27 07:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4b9704b-c2b0-5d11-8027-fef68092b212, identifier: UP31650
2026-04-27 07:54:23 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2011 | hits on page: 40
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048874f10>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_37030b3b83fa79d74c23e0681989c50d.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048570a50>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_9e6dc0ce54909eae38159f4935fbaec0.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b6350>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_366885955e3a13afea1e12fa3be11247.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894e8d0>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_e79ef86b7dcf7a851d69a83db24a82f2.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a38f50>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_f54c5b2a2cbbbcc0f83ab2db46c696f4.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_59360e2520efe63d888384985fda0ece.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_d2b6efc28e26ca77c8d39512fb59c85f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [auto1.es] INFO: Found listing with ID: SD56012
2026-04-27 07:54:24 [auto1.es] INFO: Scrape type for SD56012: 2
2026-04-27 07:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 954b74b1-2057-5503-be43-9b257880bb08 with identifier: SD56012
2026-04-27 07:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 954b74b1-2057-5503-be43-9b257880bb08 with scrape type 2
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 954b74b1-2057-5503-be43-9b257880bb08 with scrape type 2
2026-04-27 07:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 954b74b1-2057-5503-be43-9b257880bb08, identifier: SD56012
2026-04-27 07:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4b9704b-c2b0-5d11-8027-fef68092b212 with identifier: UP31650
2026-04-27 07:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4b9704b-c2b0-5d11-8027-fef68092b212 with identifier: UP31650
2026-04-27 07:54:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4b9704b-c2b0-5d11-8027-fef68092b212 with identifier: UP31650 to the API
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:04:15Z',
'fuel_type': 'diesel',
'id': 'f4b9704b-c2b0-5d11-8027-fef68092b212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP31650',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 196521,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-06-18',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Advance BlueMotion Tech',
'transmission': 'manual',
'trim': 'Advance BlueMotion Tech',
'year': 2014}
2026-04-27 07:54:24 [auto1.es] INFO: Saving data for UP31650: {'auction_closing_time': 1777388655.0, 'created_time': 1777020344.590569, 'has_photos': True, 'last_price_update_time': 1777276464.653551}
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_0d1e3e066152c703f13c8e8d5f01b08b.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_5ee8036b700968775ee506c3db02fc67.jpg not downloaded yet
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_798dbf90b1931a926b6400fc3ecca8e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_8389bf9825f43fd66b4ccda4eb3a9886.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_5925567f4fd85d717f0432f5d393086a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7725261a0fdf3f0429f63e763ccb028a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 954b74b1-2057-5503-be43-9b257880bb08 with identifier: SD56012
2026-04-27 07:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 954b74b1-2057-5503-be43-9b257880bb08 with identifier: SD56012
2026-04-27 07:54:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 954b74b1-2057-5503-be43-9b257880bb08 with identifier: SD56012 to the API
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:12:08Z',
'fuel_type': 'petrol',
'id': '954b74b1-2057-5503-be43-9b257880bb08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD56012',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 29041,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-10-03',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-04-27 07:54:25 [auto1.es] INFO: Saving data for SD56012: {'auction_closing_time': 1777389128.0, 'created_time': 1777020528.452365, 'has_photos': True, 'last_price_update_time': 1777276465.053593}
2026-04-27 07:54:25 [auto1.es] INFO: Found listing with ID: RV47114
2026-04-27 07:54:25 [auto1.es] INFO: Scrape type for RV47114: 2
2026-04-27 07:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114
2026-04-27 07:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34597341-407d-517d-970f-c3a1c57883c1 with scrape type 2
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34597341-407d-517d-970f-c3a1c57883c1 with scrape type 2
2026-04-27 07:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34597341-407d-517d-970f-c3a1c57883c1, identifier: RV47114
2026-04-27 07:54:25 [auto1.es] INFO: Found listing with ID: YX02593
2026-04-27 07:54:25 [auto1.es] INFO: Scrape type for YX02593: 2
2026-04-27 07:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f7705a-f540-57c7-a5db-b37b65144747 with identifier: YX02593
2026-04-27 07:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f7705a-f540-57c7-a5db-b37b65144747 with scrape type 2
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f7705a-f540-57c7-a5db-b37b65144747 with scrape type 2
2026-04-27 07:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c2f7705a-f540-57c7-a5db-b37b65144747, identifier: YX02593
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR81888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865ae90>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_cf61fcae2c579c2189a57458c648a383.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485e5590>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_6ef8ac2332e2d977a96da4dc262c66ea.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_432e0fff650e336f43d02674d58d67aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [auto1.es] INFO: Found listing with ID: JD60065
2026-04-27 07:54:25 [auto1.es] INFO: Scrape type for JD60065: 1
2026-04-27 07:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114
2026-04-27 07:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114
2026-04-27 07:54:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 34597341-407d-517d-970f-c3a1c57883c1 with identifier: RV47114 to the API
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:46:01Z',
'fuel_type': 'diesel',
'id': '34597341-407d-517d-970f-c3a1c57883c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV47114',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 181638,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-09-22',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2008}
2026-04-27 07:54:25 [auto1.es] INFO: Saving data for RV47114: {'auction_closing_time': 1777391161.0, 'created_time': 1777020463.45364, 'has_photos': True, 'last_price_update_time': 1777276465.742411}
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_cd48a7e472b009489d115e9194e885d1.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_2669e11a8c05d089c89de816bb0ed173.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c2f7705a-f540-57c7-a5db-b37b65144747 with identifier: YX02593
2026-04-27 07:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c2f7705a-f540-57c7-a5db-b37b65144747 with identifier: YX02593
2026-04-27 07:54:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c2f7705a-f540-57c7-a5db-b37b65144747 with identifier: YX02593 to the API
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:32:41Z',
'fuel_type': 'petrol',
'id': 'c2f7705a-f540-57c7-a5db-b37b65144747',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX02593',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '308',
'odometer': 109757,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-12-29',
'seller_name': None,
'title': 'Peugeot 308 1.4 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-04-27 07:54:26 [auto1.es] INFO: Saving data for YX02593: {'auction_closing_time': 1777390361.0, 'created_time': 1777020514.696353, 'has_photos': True, 'last_price_update_time': 1777276466.122465}
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048858ed0>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55a86871-2b4f-50ad-94ec-c257548c1557/55a86871-2b4f-50ad-94ec-c257548c1557_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_09b58c17b699290cc04176335f254df9.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:54:26 [auto1.es] INFO: Found listing with ID: KZ16281
2026-04-27 07:54:26 [auto1.es] INFO: Scrape type for KZ16281: 2
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 134cb1fc-89b1-56d8-8541-f4d793db0865 with identifier: KZ16281
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134cb1fc-89b1-56d8-8541-f4d793db0865 with scrape type 2
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 134cb1fc-89b1-56d8-8541-f4d793db0865 with scrape type 2
2026-04-27 07:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 134cb1fc-89b1-56d8-8541-f4d793db0865, identifier: KZ16281
2026-04-27 07:54:26 [auto1.es] INFO: Found listing with ID: TB92438
2026-04-27 07:54:26 [auto1.es] INFO: Scrape type for TB92438: 1
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG12756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_e11a5df139230bd7d7b95590e0482771.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [auto1.es] INFO: Found listing with ID: UF70444
2026-04-27 07:54:26 [auto1.es] INFO: Scrape type for UF70444: 2
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8fc6ac-c7e3-582e-b476-07a3de68352f with identifier: UF70444
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8fc6ac-c7e3-582e-b476-07a3de68352f with scrape type 2
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f8fc6ac-c7e3-582e-b476-07a3de68352f with scrape type 2
2026-04-27 07:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f8fc6ac-c7e3-582e-b476-07a3de68352f, identifier: UF70444
2026-04-27 07:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 134cb1fc-89b1-56d8-8541-f4d793db0865 with identifier: KZ16281
2026-04-27 07:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 134cb1fc-89b1-56d8-8541-f4d793db0865 with identifier: KZ16281
2026-04-27 07:54:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 134cb1fc-89b1-56d8-8541-f4d793db0865 with identifier: KZ16281 to the API
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:32:05Z',
'fuel_type': 'diesel',
'id': '134cb1fc-89b1-56d8-8541-f4d793db0865',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ16281',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'Vito Tourer',
'odometer': 297609,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-04-22',
'seller_name': None,
'title': 'Mercedes-Benz Vito Tourer 114 CDI Pro lang',
'transmission': 'automatic',
'trim': 'Pro lang',
'year': 2021}
2026-04-27 07:54:26 [auto1.es] INFO: Saving data for KZ16281: {'auction_closing_time': 1777390325.0, 'created_time': 1777020412.167792, 'has_photos': True, 'last_price_update_time': 1777276466.733563}
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_09b5975b9c0fe19f157ae7c942edcacb.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_d28bff6f2133e3a37f41cafc226377ac.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX68849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c8d90>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_59360e2520efe63d888384985fda0ece.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048507ed0>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_d2b6efc28e26ca77c8d39512fb59c85f.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048976550>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_798dbf90b1931a926b6400fc3ecca8e9.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057224a10>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_8389bf9825f43fd66b4ccda4eb3a9886.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04899eb10>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_5925567f4fd85d717f0432f5d393086a.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048485d90>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7725261a0fdf3f0429f63e763ccb028a.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_1be10205bf9a5d064a9c620ff8d3547e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_88482b89a81c0b443e0cd8eaa13394b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_8af2c9bbe850d947f49e1fd42f45d6ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_fc7e01f14bbf3d25203f92e6627b6f51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f8fc6ac-c7e3-582e-b476-07a3de68352f with identifier: UF70444
2026-04-27 07:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f8fc6ac-c7e3-582e-b476-07a3de68352f with identifier: UF70444
2026-04-27 07:54:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f8fc6ac-c7e3-582e-b476-07a3de68352f with identifier: UF70444 to the API
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:25:05Z',
'fuel_type': 'diesel',
'id': '7f8fc6ac-c7e3-582e-b476-07a3de68352f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF70444',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '207',
'odometer': 113914,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-29',
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-04-27 07:54:27 [auto1.es] INFO: Saving data for UF70444: {'auction_closing_time': 1777389905.0, 'created_time': 1777020522.913942, 'has_photos': True, 'last_price_update_time': 1777276467.382273}
2026-04-27 07:54:27 [auto1.es] INFO: Found listing with ID: ZT13794
2026-04-27 07:54:27 [auto1.es] INFO: Scrape type for ZT13794: 2
2026-04-27 07:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6977948f-438f-5439-9462-60c1d6dac326 with identifier: ZT13794
2026-04-27 07:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6977948f-438f-5439-9462-60c1d6dac326 with scrape type 2
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6977948f-438f-5439-9462-60c1d6dac326 with scrape type 2
2026-04-27 07:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6977948f-438f-5439-9462-60c1d6dac326, identifier: ZT13794
2026-04-27 07:54:27 [auto1.es] INFO: Found listing with ID: EN74570
2026-04-27 07:54:27 [auto1.es] INFO: Scrape type for EN74570: 2
2026-04-27 07:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a37dec0-b4ed-5209-bd58-8bc48da6eabc with identifier: EN74570
2026-04-27 07:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a37dec0-b4ed-5209-bd58-8bc48da6eabc with scrape type 2
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a37dec0-b4ed-5209-bd58-8bc48da6eabc with scrape type 2
2026-04-27 07:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0a37dec0-b4ed-5209-bd58-8bc48da6eabc, identifier: EN74570
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_e264bfe468a1bb3239566cb5228a1822.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [auto1.es] INFO: Found listing with ID: HY15551
2026-04-27 07:54:27 [auto1.es] INFO: Scrape type for HY15551: 1
2026-04-27 07:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6977948f-438f-5439-9462-60c1d6dac326 with identifier: ZT13794
2026-04-27 07:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6977948f-438f-5439-9462-60c1d6dac326 with identifier: ZT13794
2026-04-27 07:54:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6977948f-438f-5439-9462-60c1d6dac326 with identifier: ZT13794 to the API
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:20:23Z',
'fuel_type': 'diesel',
'id': '6977948f-438f-5439-9462-60c1d6dac326',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT13794',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Ranger',
'odometer': 140638,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-12-16',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 XLT',
'transmission': 'manual',
'trim': 'Doppelkabine 4x4 XLT',
'year': 2020}
2026-04-27 07:54:28 [auto1.es] INFO: Saving data for ZT13794: {'auction_closing_time': 1777389623.0, 'created_time': 1777019386.788225, 'has_photos': True, 'last_price_update_time': 1777276468.044697}
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_51eb52dfba6732d8400cc1a30f0a0aa6.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_e7fb0ef9686529dd274970810c309f19.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0a37dec0-b4ed-5209-bd58-8bc48da6eabc with identifier: EN74570
2026-04-27 07:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0a37dec0-b4ed-5209-bd58-8bc48da6eabc with identifier: EN74570
2026-04-27 07:54:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0a37dec0-b4ed-5209-bd58-8bc48da6eabc with identifier: EN74570 to the API
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:21:03Z',
'fuel_type': 'petrol',
'id': '0a37dec0-b4ed-5209-bd58-8bc48da6eabc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN74570',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A1',
'odometer': 89579,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-08-31',
'seller_name': None,
'title': 'Audi A1 1.2 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2011}
2026-04-27 07:54:28 [auto1.es] INFO: Saving data for EN74570: {'auction_closing_time': 1777389663.0, 'created_time': 1777020356.71638, 'has_photos': True, 'last_price_update_time': 1777276468.604043}
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04847ae90>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_432e0fff650e336f43d02674d58d67aa.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:28 [auto1.es] INFO: Found listing with ID: YY18626
2026-04-27 07:54:28 [auto1.es] INFO: Scrape type for YY18626: 2
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de3817f-02b9-50a3-8e90-92fb6891ad26 with identifier: YY18626
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4de3817f-02b9-50a3-8e90-92fb6891ad26 with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4de3817f-02b9-50a3-8e90-92fb6891ad26 with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4de3817f-02b9-50a3-8e90-92fb6891ad26, identifier: YY18626
2026-04-27 07:54:28 [auto1.es] INFO: Found listing with ID: FN14601
2026-04-27 07:54:28 [auto1.es] INFO: Scrape type for FN14601: 2
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec82a39-ff08-50d5-9d41-f2c30f9528c2 with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec82a39-ff08-50d5-9d41-f2c30f9528c2 with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eec82a39-ff08-50d5-9d41-f2c30f9528c2, identifier: FN14601
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a5f290>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_e11a5df139230bd7d7b95590e0482771.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_cd48a7e472b009489d115e9194e885d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_0d1e3e066152c703f13c8e8d5f01b08b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_930c8f7e434c8fb8eb132fcaa028e4bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [auto1.es] INFO: Found listing with ID: WX24510
2026-04-27 07:54:28 [auto1.es] INFO: Scrape type for WX24510: 2
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483b9598-60f1-5431-af23-988bf5c70d1c with identifier: WX24510
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483b9598-60f1-5431-af23-988bf5c70d1c with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 483b9598-60f1-5431-af23-988bf5c70d1c with scrape type 2
2026-04-27 07:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 483b9598-60f1-5431-af23-988bf5c70d1c, identifier: WX24510
2026-04-27 07:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4de3817f-02b9-50a3-8e90-92fb6891ad26 with identifier: YY18626
2026-04-27 07:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4de3817f-02b9-50a3-8e90-92fb6891ad26 with identifier: YY18626
2026-04-27 07:54:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4de3817f-02b9-50a3-8e90-92fb6891ad26 with identifier: YY18626 to the API
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:27:25Z',
'fuel_type': 'diesel',
'id': '4de3817f-02b9-50a3-8e90-92fb6891ad26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY18626',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'DS Automobiles',
'model': 'DS5',
'odometer': 126624,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-03-20',
'seller_name': None,
'title': 'DS Automobiles DS5 2.0 Blue-HDi',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 07:54:29 [auto1.es] INFO: Saving data for YY18626: {'auction_closing_time': 1777390045.0, 'created_time': 1777020520.913222, 'has_photos': True, 'last_price_update_time': 1777276469.390594}
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_b2aebf4dfcff77885430c6a066c03d7d.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_500f49df645bc1d084fe9f3c8dc9a57d.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-04-27 07:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-04-27 07:54:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601 to the API
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:51:38Z',
'fuel_type': 'diesel',
'id': 'eec82a39-ff08-50d5-9d41-f2c30f9528c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN14601',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Crafter',
'odometer': 17423,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2025-04-15',
'seller_name': None,
'title': 'Volkswagen Crafter 2.0 TDI Kasten 30 mittellang FWD',
'transmission': 'manual',
'trim': 'Kasten 30 mittellang FWD',
'year': 2025}
2026-04-27 07:54:29 [auto1.es] INFO: Saving data for FN14601: {'auction_closing_time': 1777391498.0, 'created_time': 1777019871.086514, 'has_photos': True, 'last_price_update_time': 1777276469.718105}
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_5ee8036b700968775ee506c3db02fc67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_2669e11a8c05d089c89de816bb0ed173.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 483b9598-60f1-5431-af23-988bf5c70d1c with identifier: WX24510
2026-04-27 07:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 483b9598-60f1-5431-af23-988bf5c70d1c with identifier: WX24510
2026-04-27 07:54:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 483b9598-60f1-5431-af23-988bf5c70d1c with identifier: WX24510 to the API
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:35:26Z',
'fuel_type': 'petrol',
'id': '483b9598-60f1-5431-af23-988bf5c70d1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX24510',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 91075,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-12-27',
'seller_name': None,
'title': 'Audi A1 Sportback 25 TFSI Adrenalin',
'transmission': 'manual',
'trim': 'Adrenalin',
'year': 2020}
2026-04-27 07:54:30 [auto1.es] INFO: Saving data for WX24510: {'auction_closing_time': 1777390526.0, 'created_time': 1777019639.577433, 'has_photos': True, 'last_price_update_time': 1777276470.057851}
2026-04-27 07:54:30 [auto1.es] INFO: Found listing with ID: LH99658
2026-04-27 07:54:30 [auto1.es] INFO: Scrape type for LH99658: 2
2026-04-27 07:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658
2026-04-27 07:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5698eaf7-6563-588c-b9a1-5063e94913f9 with scrape type 2
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5698eaf7-6563-588c-b9a1-5063e94913f9 with scrape type 2
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5698eaf7-6563-588c-b9a1-5063e94913f9, identifier: LH99658
2026-04-27 07:54:30 [auto1.es] INFO: Found listing with ID: BM49479
2026-04-27 07:54:30 [auto1.es] INFO: Scrape type for BM49479: 2
2026-04-27 07:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e413e214-effe-5eb3-8061-b55966a0e9d3 with identifier: BM49479
2026-04-27 07:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e413e214-effe-5eb3-8061-b55966a0e9d3 with scrape type 2
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e413e214-effe-5eb3-8061-b55966a0e9d3 with scrape type 2
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e413e214-effe-5eb3-8061-b55966a0e9d3, identifier: BM49479
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b2a50>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_1be10205bf9a5d064a9c620ff8d3547e.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824e90>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_88482b89a81c0b443e0cd8eaa13394b1.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862ac50>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_8af2c9bbe850d947f49e1fd42f45d6ef.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483bf810>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_fc7e01f14bbf3d25203f92e6627b6f51.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e2410>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55a86871-2b4f-50ad-94ec-c257548c1557/55a86871-2b4f-50ad-94ec-c257548c1557_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_e264bfe468a1bb3239566cb5228a1822.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_4430a2ea68ca4a5e2e33069ca466ec82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_574b93c122519c15158f4d3dbf96bbc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [auto1.es] INFO: Found listing with ID: XG11186
2026-04-27 07:54:30 [auto1.es] INFO: Scrape type for XG11186: 2
2026-04-27 07:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186
2026-04-27 07:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830b426a-447f-5ca6-aca1-86a91b4d66df with scrape type 2
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830b426a-447f-5ca6-aca1-86a91b4d66df with scrape type 2
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 830b426a-447f-5ca6-aca1-86a91b4d66df, identifier: XG11186
2026-04-27 07:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658
2026-04-27 07:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658
2026-04-27 07:54:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658 to the API
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:36:48Z',
'fuel_type': 'diesel',
'id': '5698eaf7-6563-588c-b9a1-5063e94913f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH99658',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A4',
'odometer': 231342,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-05-31',
'seller_name': None,
'title': 'Audi A4 1.9 TDI',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-04-27 07:54:31 [auto1.es] INFO: Saving data for LH99658: {'auction_closing_time': 1777390608.0, 'created_time': 1777018846.908675, 'has_photos': True, 'last_price_update_time': 1777276471.835966}
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f01141298b701f5dbbb678e3a9fc510b.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_fbdb0eb154cca8bf304b599282961761.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e413e214-effe-5eb3-8061-b55966a0e9d3 with identifier: BM49479
2026-04-27 07:54:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e413e214-effe-5eb3-8061-b55966a0e9d3 with identifier: BM49479
2026-04-27 07:54:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e413e214-effe-5eb3-8061-b55966a0e9d3 with identifier: BM49479 to the API
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:22:06Z',
'fuel_type': 'diesel',
'id': 'e413e214-effe-5eb3-8061-b55966a0e9d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM49479',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 130141,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-02-23',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-04-27 07:54:32 [auto1.es] INFO: Saving data for BM49479: {'auction_closing_time': 1777389726.0, 'created_time': 1777019746.984091, 'has_photos': True, 'last_price_update_time': 1777276472.289507}
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_429b386dc266b65c331a84f02ad954b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186
2026-04-27 07:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186
2026-04-27 07:54:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186 to the API
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:34:43Z',
'fuel_type': 'diesel',
'id': '830b426a-447f-5ca6-aca1-86a91b4d66df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG11186',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'V40',
'odometer': 119392,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-03-09',
'seller_name': None,
'title': 'Volvo V40 2.0 D3 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2015}
2026-04-27 07:54:32 [auto1.es] INFO: Saving data for XG11186: {'auction_closing_time': 1777390483.0, 'created_time': 1777020478.772369, 'has_photos': True, 'last_price_update_time': 1777276472.63781}
2026-04-27 07:54:32 [auto1.es] INFO: Found listing with ID: MR81111
2026-04-27 07:54:32 [auto1.es] INFO: Scrape type for MR81111: 2
2026-04-27 07:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111
2026-04-27 07:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with scrape type 2
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with scrape type 2
2026-04-27 07:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d, identifier: MR81111
2026-04-27 07:54:32 [auto1.es] INFO: Found listing with ID: HJ23931
2026-04-27 07:54:32 [auto1.es] INFO: Scrape type for HJ23931: 2
2026-04-27 07:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0295b6d2-2775-5c51-8ca2-0558d146718e with identifier: HJ23931
2026-04-27 07:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0295b6d2-2775-5c51-8ca2-0558d146718e with scrape type 2
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0295b6d2-2775-5c51-8ca2-0558d146718e with scrape type 2
2026-04-27 07:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0295b6d2-2775-5c51-8ca2-0558d146718e, identifier: HJ23931
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482da1d0>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_cd48a7e472b009489d115e9194e885d1.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048332290>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_0d1e3e066152c703f13c8e8d5f01b08b.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048675550>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_930c8f7e434c8fb8eb132fcaa028e4bd.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:33 [auto1.es] INFO: Found listing with ID: VA59339
2026-04-27 07:54:33 [auto1.es] INFO: Scrape type for VA59339: 2
2026-04-27 07:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68091a5d-54f4-52af-9d25-a109168c5e16 with identifier: VA59339
2026-04-27 07:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68091a5d-54f4-52af-9d25-a109168c5e16 with scrape type 2
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68091a5d-54f4-52af-9d25-a109168c5e16 with scrape type 2
2026-04-27 07:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68091a5d-54f4-52af-9d25-a109168c5e16, identifier: VA59339
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111
2026-04-27 07:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111
2026-04-27 07:54:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111 to the API
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-04-28T15:49:27Z',
'fuel_type': 'petrol',
'id': 'dac0f31e-0b44-5a5a-a24d-c677ee8ed09d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR81111',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 14200,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-02-20',
'seller_name': None,
'title': 'Ford Focus 2.3 EcoBoost ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2023}
2026-04-27 07:54:33 [auto1.es] INFO: Saving data for MR81111: {'auction_closing_time': 1777391367.0, 'created_time': 1777018537.96764, 'has_photos': True, 'last_price_update_time': 1777276473.496983}
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f0b1ae80c4b60aadf53f3fb6bf973788.jpg not downloaded yet
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_c53d4a6185e1bfa525b38909a2df19e8.jpg not downloaded yet
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0295b6d2-2775-5c51-8ca2-0558d146718e with identifier: HJ23931
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0295b6d2-2775-5c51-8ca2-0558d146718e with identifier: HJ23931
2026-04-27 07:54:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0295b6d2-2775-5c51-8ca2-0558d146718e with identifier: HJ23931 to the API
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-04-28T15:07:50Z',
'fuel_type': 'hybrid',
'id': '0295b6d2-2775-5c51-8ca2-0558d146718e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ23931',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '2er',
'odometer': 181072,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'BMW 2er 225xe Active Tourer',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-04-27 07:54:33 [auto1.es] INFO: Saving data for HJ23931: {'auction_closing_time': 1777388870.0, 'created_time': 1777019238.163411, 'has_photos': True, 'last_price_update_time': 1777276473.965154}
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048331150>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_5ee8036b700968775ee506c3db02fc67.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048806c90>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_2669e11a8c05d089c89de816bb0ed173.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_51eb52dfba6732d8400cc1a30f0a0aa6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_d28bff6f2133e3a37f41cafc226377ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68091a5d-54f4-52af-9d25-a109168c5e16 with identifier: VA59339
2026-04-27 07:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68091a5d-54f4-52af-9d25-a109168c5e16 with identifier: VA59339
2026-04-27 07:54:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68091a5d-54f4-52af-9d25-a109168c5e16 with identifier: VA59339 to the API
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:02:10Z',
'fuel_type': 'diesel',
'id': '68091a5d-54f4-52af-9d25-a109168c5e16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA59339',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 157856,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-12-12',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Excellence 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Excellence 4Motion BlueMotion Tech',
'year': 2012}
2026-04-27 07:54:34 [auto1.es] INFO: Saving data for VA59339: {'auction_closing_time': 1777388530.0, 'created_time': 1777019896.994918, 'has_photos': True, 'last_price_update_time': 1777276474.418023}
2026-04-27 07:54:34 [auto1.es] INFO: Found listing with ID: AB11386
2026-04-27 07:54:34 [auto1.es] INFO: Scrape type for AB11386: 2
2026-04-27 07:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386
2026-04-27 07:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 157e31d6-70f0-5f94-bf32-5110ee75fb13 with scrape type 2
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 157e31d6-70f0-5f94-bf32-5110ee75fb13 with scrape type 2
2026-04-27 07:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 157e31d6-70f0-5f94-bf32-5110ee75fb13, identifier: AB11386
2026-04-27 07:54:34 [auto1.es] INFO: Found listing with ID: PT77544
2026-04-27 07:54:34 [auto1.es] INFO: Scrape type for PT77544: 2
2026-04-27 07:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea148f5f-d227-51c1-b9aa-0345a8ca0376 with identifier: PT77544
2026-04-27 07:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea148f5f-d227-51c1-b9aa-0345a8ca0376 with scrape type 2
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea148f5f-d227-51c1-b9aa-0345a8ca0376 with scrape type 2
2026-04-27 07:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea148f5f-d227-51c1-b9aa-0345a8ca0376, identifier: PT77544
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_e7fb0ef9686529dd274970810c309f19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.extensions.logstats] INFO: Crawled 42 pages (at 42 pages/min), scraped 82 items (at 82 items/min)
2026-04-27 07:54:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 373MiB
2026-04-27 07:54:34 [auto1.es] INFO: Found listing with ID: MD90485
2026-04-27 07:54:34 [auto1.es] INFO: Scrape type for MD90485: 1
2026-04-27 07:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386
2026-04-27 07:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386
2026-04-27 07:54:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 157e31d6-70f0-5f94-bf32-5110ee75fb13 with identifier: AB11386 to the API
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:47:32Z',
'fuel_type': 'petrol',
'id': '157e31d6-70f0-5f94-bf32-5110ee75fb13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB11386',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 56655,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-02-28',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Klass 2WD',
'transmission': 'manual',
'trim': 'Klass 2WD',
'year': 2023}
2026-04-27 07:54:35 [auto1.es] INFO: Saving data for AB11386: {'auction_closing_time': 1777391252.0, 'created_time': 1777020340.452023, 'has_photos': True, 'last_price_update_time': 1777276475.047046}
2026-04-27 07:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea148f5f-d227-51c1-b9aa-0345a8ca0376 with identifier: PT77544
2026-04-27 07:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea148f5f-d227-51c1-b9aa-0345a8ca0376 with identifier: PT77544
2026-04-27 07:54:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea148f5f-d227-51c1-b9aa-0345a8ca0376 with identifier: PT77544 to the API
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-04-28T15:00:17Z',
'fuel_type': 'petrol',
'id': 'ea148f5f-d227-51c1-b9aa-0345a8ca0376',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT77544',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 293537,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '1997-08-06',
'seller_name': None,
'title': 'Land Rover Range Rover 4.6 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 1997}
2026-04-27 07:54:35 [auto1.es] INFO: Saving data for PT77544: {'auction_closing_time': 1777388417.0, 'created_time': 1777021280.732382, 'has_photos': True, 'last_price_update_time': 1777276475.868177}
2026-04-27 07:54:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048815010>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_4430a2ea68ca4a5e2e33069ca466ec82.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048679a50>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_574b93c122519c15158f4d3dbf96bbc5.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b35d0>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_429b386dc266b65c331a84f02ad954b9.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_b2aebf4dfcff77885430c6a066c03d7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_500f49df645bc1d084fe9f3c8dc9a57d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [auto1.es] INFO: Found listing with ID: TR63609
2026-04-27 07:54:36 [auto1.es] INFO: Scrape type for TR63609: 1
2026-04-27 07:54:36 [auto1.es] INFO: Found listing with ID: HR02229
2026-04-27 07:54:36 [auto1.es] INFO: Scrape type for HR02229: 2
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 754883a7-18da-5164-92c9-987bdd508e52 with identifier: HR02229
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 754883a7-18da-5164-92c9-987bdd508e52 with scrape type 2
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 754883a7-18da-5164-92c9-987bdd508e52 with scrape type 2
2026-04-27 07:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 754883a7-18da-5164-92c9-987bdd508e52, identifier: HR02229
2026-04-27 07:54:36 [auto1.es] INFO: Found listing with ID: TK27143
2026-04-27 07:54:36 [auto1.es] INFO: Scrape type for TK27143: 2
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc3a9277-e28d-5469-9623-22b20bbf3b34 with identifier: TK27143
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc3a9277-e28d-5469-9623-22b20bbf3b34 with scrape type 2
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc3a9277-e28d-5469-9623-22b20bbf3b34 with scrape type 2
2026-04-27 07:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc3a9277-e28d-5469-9623-22b20bbf3b34, identifier: TK27143
2026-04-27 07:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 754883a7-18da-5164-92c9-987bdd508e52 with identifier: HR02229
2026-04-27 07:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 754883a7-18da-5164-92c9-987bdd508e52 with identifier: HR02229
2026-04-27 07:54:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 754883a7-18da-5164-92c9-987bdd508e52 with identifier: HR02229 to the API
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:36:47Z',
'fuel_type': 'diesel',
'id': '754883a7-18da-5164-92c9-987bdd508e52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR02229',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Kuga',
'odometer': 266569,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-01-04',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-04-27 07:54:36 [auto1.es] INFO: Saving data for HR02229: {'auction_closing_time': 1777390607.0, 'created_time': 1777019633.549143, 'has_photos': True, 'last_price_update_time': 1777276476.972173}
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD28461> (referer: https://www.auto1.com/v1/car-details-view/RD28461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU60658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD60065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048605850>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_51eb52dfba6732d8400cc1a30f0a0aa6.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852f890>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_d28bff6f2133e3a37f41cafc226377ac.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc3a9277-e28d-5469-9623-22b20bbf3b34 with identifier: TK27143
2026-04-27 07:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc3a9277-e28d-5469-9623-22b20bbf3b34 with identifier: TK27143
2026-04-27 07:54:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc3a9277-e28d-5469-9623-22b20bbf3b34 with identifier: TK27143 to the API
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:30:22Z',
'fuel_type': 'petrol',
'id': 'dc3a9277-e28d-5469-9623-22b20bbf3b34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK27143',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 171736,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-29',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Edition BlueMotion Tech',
'transmission': 'manual',
'trim': 'Edition BlueMotion Tech',
'year': 2016}
2026-04-27 07:54:37 [auto1.es] INFO: Saving data for TK27143: {'auction_closing_time': 1777390222.0, 'created_time': 1777018516.840434, 'has_photos': True, 'last_price_update_time': 1777276477.438289}
2026-04-27 07:54:37 [auto1.es] INFO: Found listing with ID: YD82310
2026-04-27 07:54:37 [auto1.es] INFO: Scrape type for YD82310: 1
2026-04-27 07:54:37 [auto1.es] INFO: Found listing with ID: UE40961
2026-04-27 07:54:37 [auto1.es] INFO: Scrape type for UE40961: 2
2026-04-27 07:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-04-27 07:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab8644c-ef55-530e-a443-a11bb746b190 with scrape type 2
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cab8644c-ef55-530e-a443-a11bb746b190 with scrape type 2
2026-04-27 07:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cab8644c-ef55-530e-a443-a11bb746b190, identifier: UE40961
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB92438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP60568> (referer: https://www.auto1.com/v1/car-details-view/ZP60568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:37 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2012 | hits on page: 40
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048616910>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_e7fb0ef9686529dd274970810c309f19.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_fbdb0eb154cca8bf304b599282961761.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f0b1ae80c4b60aadf53f3fb6bf973788.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [auto1.es] INFO: Found listing with ID: XT63016
2026-04-27 07:54:37 [auto1.es] INFO: Scrape type for XT63016: 1
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-04-27 07:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-04-27 07:54:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961 to the API
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:50:50Z',
'fuel_type': 'diesel',
'id': 'cab8644c-ef55-530e-a443-a11bb746b190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE40961',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3',
'odometer': 123537,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-09-30',
'seller_name': None,
'title': 'Audi A3 1.6 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2015}
2026-04-27 07:54:38 [auto1.es] INFO: Saving data for UE40961: {'auction_closing_time': 1777391450.0, 'created_time': 1777020429.747922, 'has_photos': True, 'last_price_update_time': 1777276478.074464}
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824b50>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_b2aebf4dfcff77885430c6a066c03d7d.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048982ed0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_500f49df645bc1d084fe9f3c8dc9a57d.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_c53d4a6185e1bfa525b38909a2df19e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f01141298b701f5dbbb678e3a9fc510b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [auto1.es] INFO: Found listing with ID: XW07664
2026-04-27 07:54:38 [auto1.es] INFO: Scrape type for XW07664: 1
2026-04-27 07:54:38 [auto1.es] INFO: Found listing with ID: XN12672
2026-04-27 07:54:38 [auto1.es] INFO: Scrape type for XN12672: 2
2026-04-27 07:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-04-27 07:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6cc0662-1e2a-51e2-abe4-c188536caecb with scrape type 2
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6cc0662-1e2a-51e2-abe4-c188536caecb with scrape type 2
2026-04-27 07:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6cc0662-1e2a-51e2-abe4-c188536caecb, identifier: XN12672
2026-04-27 07:54:38 [auto1.es] INFO: Found listing with ID: NH36425
2026-04-27 07:54:38 [auto1.es] INFO: Scrape type for NH36425: 2
2026-04-27 07:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88 with identifier: NH36425
2026-04-27 07:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88 with scrape type 2
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88 with scrape type 2
2026-04-27 07:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88, identifier: NH36425
2026-04-27 07:54:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_693285f8c174b9644b35ae06dba42c4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_09b5975b9c0fe19f157ae7c942edcacb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [auto1.es] INFO: Found listing with ID: LM23612
2026-04-27 07:54:38 [auto1.es] INFO: Scrape type for LM23612: 2
2026-04-27 07:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc6bc3d-5936-5b96-9612-366e76de634a with identifier: LM23612
2026-04-27 07:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc6bc3d-5936-5b96-9612-366e76de634a with scrape type 2
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc6bc3d-5936-5b96-9612-366e76de634a with scrape type 2
2026-04-27 07:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecc6bc3d-5936-5b96-9612-366e76de634a, identifier: LM23612
2026-04-27 07:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-04-27 07:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-04-27 07:54:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672 to the API
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-04-28T15:20:15Z',
'fuel_type': 'petrol',
'id': 'f6cc0662-1e2a-51e2-abe4-c188536caecb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN12672',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 61150,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-04-27 07:54:39 [auto1.es] INFO: Saving data for XN12672: {'auction_closing_time': 1777389615.0, 'created_time': 1777020488.01986, 'has_photos': True, 'last_price_update_time': 1777276479.025017}
2026-04-27 07:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88 with identifier: NH36425
2026-04-27 07:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88 with identifier: NH36425
2026-04-27 07:54:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e2f8cb6-ad73-5c32-8d6e-6d024a503b88 with identifier: NH36425 to the API
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:58:05Z',
'fuel_type': 'petrol',
'id': '6e2f8cb6-ad73-5c32-8d6e-6d024a503b88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH36425',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 188486,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-04-27 07:54:39 [auto1.es] INFO: Saving data for NH36425: {'auction_closing_time': 1777391885.0, 'created_time': 1777019639.015042, 'has_photos': True, 'last_price_update_time': 1777276479.407923}
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1152e29f-4946-587c-8bab-27792ed8e6ac with identifier: RD28461
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1152e29f-4946-587c-8bab-27792ed8e6ac with scrape type 1
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1152e29f-4946-587c-8bab-27792ed8e6ac
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_5fd1d0cbed8c1c4dd58d06b548479eed.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecc6bc3d-5936-5b96-9612-366e76de634a with identifier: LM23612
2026-04-27 07:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecc6bc3d-5936-5b96-9612-366e76de634a with identifier: LM23612
2026-04-27 07:54:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecc6bc3d-5936-5b96-9612-366e76de634a with identifier: LM23612 to the API
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:26:12Z',
'fuel_type': 'diesel',
'id': 'ecc6bc3d-5936-5b96-9612-366e76de634a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM23612',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'S90',
'odometer': 262992,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-12-29',
'seller_name': None,
'title': 'Volvo S90 2.0 D3 Inscription',
'transmission': 'automatic',
'trim': 'Inscription',
'year': 2020}
2026-04-27 07:54:39 [auto1.es] INFO: Saving data for LM23612: {'auction_closing_time': 1777389972.0, 'created_time': 1777018870.229321, 'has_photos': True, 'last_price_update_time': 1777276479.761917}
2026-04-27 07:54:39 [auto1.es] INFO: Found listing with ID: EG33692
2026-04-27 07:54:39 [auto1.es] INFO: Scrape type for EG33692: 2
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110ca445-49e7-5a90-b7d7-15d4446d86a1 with identifier: EG33692
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110ca445-49e7-5a90-b7d7-15d4446d86a1 with scrape type 2
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110ca445-49e7-5a90-b7d7-15d4446d86a1 with scrape type 2
2026-04-27 07:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 110ca445-49e7-5a90-b7d7-15d4446d86a1, identifier: EG33692
2026-04-27 07:54:39 [auto1.es] INFO: Found listing with ID: DJ05197
2026-04-27 07:54:39 [auto1.es] INFO: Scrape type for DJ05197: 2
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5774f7-d867-5a76-941e-e0a2cbc0ffab with identifier: DJ05197
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5774f7-d867-5a76-941e-e0a2cbc0ffab with scrape type 2
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc5774f7-d867-5a76-941e-e0a2cbc0ffab with scrape type 2
2026-04-27 07:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc5774f7-d867-5a76-941e-e0a2cbc0ffab, identifier: DJ05197
2026-04-27 07:54:40 [auto1.es] INFO: Found listing with ID: GC87947
2026-04-27 07:54:40 [auto1.es] INFO: Scrape type for GC87947: 2
2026-04-27 07:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec271735-2d04-5e95-b344-5258f8526cbe with identifier: GC87947
2026-04-27 07:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec271735-2d04-5e95-b344-5258f8526cbe with scrape type 2
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec271735-2d04-5e95-b344-5258f8526cbe with scrape type 2
2026-04-27 07:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec271735-2d04-5e95-b344-5258f8526cbe, identifier: GC87947
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG12756> (referer: https://www.auto1.com/v1/car-details-view/ZG12756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX68849> (referer: https://www.auto1.com/v1/car-details-view/SX68849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b328ad-ede4-54c3-9954-36ba63cff223 with identifier: ZP60568
2026-04-27 07:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b328ad-ede4-54c3-9954-36ba63cff223 with scrape type 1
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_f879aa1b4d79c5c865de5165c6cc39a6.jpg not downloaded yet
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485044d0>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_fbdb0eb154cca8bf304b599282961761.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841cad0>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f0b1ae80c4b60aadf53f3fb6bf973788.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7d39f271e0a5b25179102b5f51703388.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [auto1.es] INFO: Found listing with ID: EN12947
2026-04-27 07:54:40 [auto1.es] INFO: Scrape type for EN12947: 1
2026-04-27 07:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 110ca445-49e7-5a90-b7d7-15d4446d86a1 with identifier: EG33692
2026-04-27 07:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 110ca445-49e7-5a90-b7d7-15d4446d86a1 with identifier: EG33692
2026-04-27 07:54:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 110ca445-49e7-5a90-b7d7-15d4446d86a1 with identifier: EG33692 to the API
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 520,
'expiration_date': '2026-04-28T15:38:04Z',
'fuel_type': 'petrol',
'id': '110ca445-49e7-5a90-b7d7-15d4446d86a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG33692',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'S8',
'odometer': 232118,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-08-06',
'seller_name': None,
'title': 'Audi S8 4.0 V8 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-04-27 07:54:40 [auto1.es] INFO: Saving data for EG33692: {'auction_closing_time': 1777390684.0, 'created_time': 1777019800.946222, 'has_photos': True, 'last_price_update_time': 1777276480.71603}
2026-04-27 07:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc5774f7-d867-5a76-941e-e0a2cbc0ffab with identifier: DJ05197
2026-04-27 07:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc5774f7-d867-5a76-941e-e0a2cbc0ffab with identifier: DJ05197
2026-04-27 07:54:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc5774f7-d867-5a76-941e-e0a2cbc0ffab with identifier: DJ05197 to the API
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:56:38Z',
'fuel_type': 'diesel',
'id': 'dc5774f7-d867-5a76-941e-e0a2cbc0ffab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ05197',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Vel Satis',
'odometer': 174586,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-07-04',
'seller_name': None,
'title': 'Renault Vel Satis 3.0 V6 dCi Grand Confort',
'transmission': 'automatic',
'trim': 'Grand Confort',
'year': 2005}
2026-04-27 07:54:41 [auto1.es] INFO: Saving data for DJ05197: {'auction_closing_time': 1777391798.0, 'created_time': 1777020026.391024, 'has_photos': True, 'last_price_update_time': 1777276481.144684}
2026-04-27 07:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec271735-2d04-5e95-b344-5258f8526cbe with identifier: GC87947
2026-04-27 07:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec271735-2d04-5e95-b344-5258f8526cbe with identifier: GC87947
2026-04-27 07:54:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec271735-2d04-5e95-b344-5258f8526cbe with identifier: GC87947 to the API
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:38:13Z',
'fuel_type': 'diesel',
'id': 'ec271735-2d04-5e95-b344-5258f8526cbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC87947',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 96453,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-07-09',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2026-04-27 07:54:41 [auto1.es] INFO: Saving data for GC87947: {'auction_closing_time': 1777390693.0, 'created_time': 1777019141.281325, 'has_photos': True, 'last_price_update_time': 1777276481.512882}
2026-04-27 07:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_f81188af21da9bf42fe5442d8d8d882f.jpg not downloaded yet
2026-04-27 07:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865a290>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_c53d4a6185e1bfa525b38909a2df19e8.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91b888d5-973b-5272-a533-e5fdf6369ca1
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91b888d5-973b-5272-a533-e5fdf6369ca1, skipping ID generation
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91b888d5-973b-5272-a533-e5fdf6369ca1 with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91b888d5-973b-5272-a533-e5fdf6369ca1 sending to next pipeline
2026-04-27 07:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91b888d5-973b-5272-a533-e5fdf6369ca1, identifier: VJ33525
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485a60d0>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f01141298b701f5dbbb678e3a9fc510b.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_e5fed86b6ed4e67d40f5b13f1b28ac06.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_1badac9720c7e420ea2e5d39bb0315f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_a0152af125abfd01e137399fd68e00f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_14b2576bfdef1ecb91172cee66a9a98f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [auto1.es] INFO: Found listing with ID: BN37578
2026-04-27 07:54:41 [auto1.es] INFO: Scrape type for BN37578: 2
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2189c568-c88f-57ce-811f-9df22051856a with identifier: BN37578
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2189c568-c88f-57ce-811f-9df22051856a with scrape type 2
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2189c568-c88f-57ce-811f-9df22051856a with scrape type 2
2026-04-27 07:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2189c568-c88f-57ce-811f-9df22051856a, identifier: BN37578
2026-04-27 07:54:41 [auto1.es] INFO: Found listing with ID: ZY52551
2026-04-27 07:54:41 [auto1.es] INFO: Scrape type for ZY52551: 1
2026-04-27 07:54:41 [auto1.es] INFO: Found listing with ID: BM03004
2026-04-27 07:54:41 [auto1.es] INFO: Scrape type for BM03004: 2
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17dbb149-d293-53d4-a5b5-11bc440e0982 with identifier: BM03004
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17dbb149-d293-53d4-a5b5-11bc440e0982 with scrape type 2
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17dbb149-d293-53d4-a5b5-11bc440e0982 with scrape type 2
2026-04-27 07:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17dbb149-d293-53d4-a5b5-11bc440e0982, identifier: BM03004
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_56523566a264af403312cf27783ed396.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91b888d5-973b-5272-a533-e5fdf6369ca1 with identifier: VJ33525
2026-04-27 07:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91b888d5-973b-5272-a533-e5fdf6369ca1 with identifier: VJ33525
2026-04-27 07:54:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91b888d5-973b-5272-a533-e5fdf6369ca1 with identifier: VJ33525 to the API
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_c53d4a6185e1bfa525b38909a2df19e8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 404,
'expiration_date': '2026-04-28T15:43:48Z',
'fuel_type': 'hybrid',
'id': '91b888d5-973b-5272-a533-e5fdf6369ca1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ33525',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 95885,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_8389bf9825f43fd66b4ccda4eb3a9886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_88482b89a81c0b443e0cd8eaa13394b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_1be10205bf9a5d064a9c620ff8d3547e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_5ee8036b700968775ee506c3db02fc67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_2669e11a8c05d089c89de816bb0ed173.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_d28bff6f2133e3a37f41cafc226377ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_e7fb0ef9686529dd274970810c309f19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_500f49df645bc1d084fe9f3c8dc9a57d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_fbdb0eb154cca8bf304b599282961761.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91b888d5-973b-5272-a533-e5fdf6369ca1/91b888d5-973b-5272-a533-e5fdf6369ca1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/65/ee6560dd27f5d441dfc7e3fa416aacc2/pa/VJ33525_c53d4a6185e1bfa525b38909a2df19e8.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 2.0 Hybrid HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2020}
2026-04-27 07:54:42 [auto1.es] INFO: Saving data for VJ33525: {'created_time': 1777276482.489527, 'last_price_update_time': 1777276482.489537, 'has_photos': True, 'auction_closing_time': 1777391028.0}
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838cd10>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55a86871-2b4f-50ad-94ec-c257548c1557/55a86871-2b4f-50ad-94ec-c257548c1557_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_693285f8c174b9644b35ae06dba42c4b.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482df490>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_09b5975b9c0fe19f157ae7c942edcacb.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7443f85a-9bbe-5890-8eef-e78da6a37a48
2026-04-27 07:54:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7443f85a-9bbe-5890-8eef-e78da6a37a48, skipping ID generation
2026-04-27 07:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7443f85a-9bbe-5890-8eef-e78da6a37a48 with scrape type 1
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7443f85a-9bbe-5890-8eef-e78da6a37a48 sending to next pipeline
2026-04-27 07:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7443f85a-9bbe-5890-8eef-e78da6a37a48, identifier: AK07153
2026-04-27 07:54:42 [auto1.es] INFO: Found listing with ID: ZT48501
2026-04-27 07:54:42 [auto1.es] INFO: Scrape type for ZT48501: 2
2026-04-27 07:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e with identifier: ZT48501
2026-04-27 07:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e with scrape type 2
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e with scrape type 2
2026-04-27 07:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e, identifier: ZT48501
2026-04-27 07:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2189c568-c88f-57ce-811f-9df22051856a with identifier: BN37578
2026-04-27 07:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2189c568-c88f-57ce-811f-9df22051856a with identifier: BN37578
2026-04-27 07:54:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2189c568-c88f-57ce-811f-9df22051856a with identifier: BN37578 to the API
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:01:31Z',
'fuel_type': 'diesel',
'id': '2189c568-c88f-57ce-811f-9df22051856a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN37578',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Laguna',
'odometer': 339936,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-12-31',
'seller_name': None,
'title': 'Renault Laguna 1.9 dCi Luxe Privilège',
'transmission': 'manual',
'trim': 'Luxe Privilège',
'year': 2005}
2026-04-27 07:54:43 [auto1.es] INFO: Saving data for BN37578: {'auction_closing_time': 1777388491.0, 'created_time': 1777020425.02098, 'has_photos': True, 'last_price_update_time': 1777276483.167345}
2026-04-27 07:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17dbb149-d293-53d4-a5b5-11bc440e0982 with identifier: BM03004
2026-04-27 07:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17dbb149-d293-53d4-a5b5-11bc440e0982 with identifier: BM03004
2026-04-27 07:54:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 17dbb149-d293-53d4-a5b5-11bc440e0982 with identifier: BM03004 to the API
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 360,
'expiration_date': '2026-04-28T15:32:34Z',
'fuel_type': 'petrol',
'id': '17dbb149-d293-53d4-a5b5-11bc440e0982',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM03004',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Porsche',
'model': 'Macan',
'odometer': 137442,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-01-15',
'seller_name': None,
'title': 'Porsche Macan GTS',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-04-27 07:54:43 [auto1.es] INFO: Saving data for BM03004: {'auction_closing_time': 1777390354.0, 'created_time': 1777018897.378418, 'has_photos': True, 'last_price_update_time': 1777276483.609687}
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_a508f2f6a2363fbb307a72bbcbb4b04e.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7443f85a-9bbe-5890-8eef-e78da6a37a48 with identifier: AK07153
2026-04-27 07:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7443f85a-9bbe-5890-8eef-e78da6a37a48 with identifier: AK07153
2026-04-27 07:54:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7443f85a-9bbe-5890-8eef-e78da6a37a48 with identifier: AK07153 to the API
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_09b5975b9c0fe19f157ae7c942edcacb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:35:00Z',
'fuel_type': 'diesel',
'id': '7443f85a-9bbe-5890-8eef-e78da6a37a48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK07153',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Citroen',
'model': 'C4',
'odometer': 117497,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_5925567f4fd85d717f0432f5d393086a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_8af2c9bbe850d947f49e1fd42f45d6ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_fc7e01f14bbf3d25203f92e6627b6f51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_0d1e3e066152c703f13c8e8d5f01b08b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_cd48a7e472b009489d115e9194e885d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_09b5975b9c0fe19f157ae7c942edcacb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_51eb52dfba6732d8400cc1a30f0a0aa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_b2aebf4dfcff77885430c6a066c03d7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f01141298b701f5dbbb678e3a9fc510b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7443f85a-9bbe-5890-8eef-e78da6a37a48/7443f85a-9bbe-5890-8eef-e78da6a37a48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/92/a89250699ecbe6d9e239d70dc8a99c30/pa/AK07153_f0b1ae80c4b60aadf53f3fb6bf973788.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2012-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Collection',
'transmission': 'automatic',
'trim': 'Collection',
'year': 2012}
2026-04-27 07:54:43 [auto1.es] INFO: Saving data for AK07153: {'created_time': 1777276483.995047, 'last_price_update_time': 1777276483.995059, 'has_photos': True, 'auction_closing_time': 1777390500.0}
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 704b1135-81f8-540e-8508-a9076c2e5adf with identifier: ZG12756
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 704b1135-81f8-540e-8508-a9076c2e5adf with scrape type 1
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_c25b25209a82e74feed1b907e238217e.jpg not downloaded yet
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef7b1d7-5c75-5261-846f-af3924f3b3c8 with identifier: SX68849
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8 with scrape type 1
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_cff8bf08de2415a4b65472e0440c7b90.jpg not downloaded yet
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_1a3eeb94f830013d82f51494b3d1cd62.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e with identifier: ZT48501
2026-04-27 07:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e with identifier: ZT48501
2026-04-27 07:54:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e with identifier: ZT48501 to the API
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:49:28Z',
'fuel_type': 'diesel',
'id': '1f7bd5b1-3e57-5452-9810-b2eee4d8ad6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT48501',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 120527,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-23',
'seller_name': None,
'title': 'Audi A3 Limousine 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2015}
2026-04-27 07:54:44 [auto1.es] INFO: Saving data for ZT48501: {'auction_closing_time': 1777391368.0, 'created_time': 1777020217.627922, 'has_photos': True, 'last_price_update_time': 1777276484.452673}
2026-04-27 07:54:44 [auto1.es] INFO: Found listing with ID: NJ18297
2026-04-27 07:54:44 [auto1.es] INFO: Scrape type for NJ18297: 2
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df512b1f-a43e-5c08-85eb-850787e54dd1 with identifier: NJ18297
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df512b1f-a43e-5c08-85eb-850787e54dd1 with scrape type 2
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df512b1f-a43e-5c08-85eb-850787e54dd1 with scrape type 2
2026-04-27 07:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: df512b1f-a43e-5c08-85eb-850787e54dd1, identifier: NJ18297
2026-04-27 07:54:44 [auto1.es] INFO: Found listing with ID: TY81479
2026-04-27 07:54:44 [auto1.es] INFO: Scrape type for TY81479: 2
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with scrape type 2
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with scrape type 2
2026-04-27 07:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e, identifier: TY81479
2026-04-27 07:54:44 [auto1.es] INFO: Found listing with ID: DL65475
2026-04-27 07:54:44 [auto1.es] INFO: Scrape type for DL65475: 2
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb5c39f2-0690-52a8-b997-3aafaf7d79f1 with identifier: DL65475
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb5c39f2-0690-52a8-b997-3aafaf7d79f1 with scrape type 2
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb5c39f2-0690-52a8-b997-3aafaf7d79f1 with scrape type 2
2026-04-27 07:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb5c39f2-0690-52a8-b997-3aafaf7d79f1, identifier: DL65475
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_65ed8aedfc6982ba76e86741115dbca6.jpg not downloaded yet
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714550>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7d39f271e0a5b25179102b5f51703388.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 140eb0ff-cb21-5a50-9e9a-80b0620554ae, skipping ID generation
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae with scrape type 1
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 140eb0ff-cb21-5a50-9e9a-80b0620554ae sending to next pipeline
2026-04-27 07:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 140eb0ff-cb21-5a50-9e9a-80b0620554ae, identifier: BA75989
2026-04-27 07:54:45 [auto1.es] INFO: Found listing with ID: MU00444
2026-04-27 07:54:45 [auto1.es] INFO: Scrape type for MU00444: 2
2026-04-27 07:54:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84984ccb-d064-5304-b3ea-acef3cf428fe with identifier: MU00444
2026-04-27 07:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84984ccb-d064-5304-b3ea-acef3cf428fe with scrape type 2
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84984ccb-d064-5304-b3ea-acef3cf428fe with scrape type 2
2026-04-27 07:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 84984ccb-d064-5304-b3ea-acef3cf428fe, identifier: MU00444
2026-04-27 07:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: df512b1f-a43e-5c08-85eb-850787e54dd1 with identifier: NJ18297
2026-04-27 07:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: df512b1f-a43e-5c08-85eb-850787e54dd1 with identifier: NJ18297
2026-04-27 07:54:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: df512b1f-a43e-5c08-85eb-850787e54dd1 with identifier: NJ18297 to the API
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 71,
'expiration_date': '2026-04-28T15:32:03Z',
'fuel_type': 'petrol',
'id': 'df512b1f-a43e-5c08-85eb-850787e54dd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ18297',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 21179,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-09-11',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.2 Kaiteki',
'transmission': 'manual',
'trim': 'Kaiteki',
'year': 2022}
2026-04-27 07:54:45 [auto1.es] INFO: Saving data for NJ18297: {'auction_closing_time': 1777390323.0, 'created_time': 1777018934.537416, 'has_photos': True, 'last_price_update_time': 1777276485.496725}
2026-04-27 07:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479
2026-04-27 07:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479
2026-04-27 07:54:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479 to the API
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:06:10Z',
'fuel_type': 'diesel',
'id': 'a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY81479',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Zafira',
'odometer': 174729,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-09-20',
'seller_name': None,
'title': 'Opel Zafira 2.0 DTI Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2004}
2026-04-27 07:54:45 [auto1.es] INFO: Saving data for TY81479: {'auction_closing_time': 1777388770.0, 'created_time': 1777020488.915688, 'has_photos': True, 'last_price_update_time': 1777276485.81585}
2026-04-27 07:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb5c39f2-0690-52a8-b997-3aafaf7d79f1 with identifier: DL65475
2026-04-27 07:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb5c39f2-0690-52a8-b997-3aafaf7d79f1 with identifier: DL65475
2026-04-27 07:54:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb5c39f2-0690-52a8-b997-3aafaf7d79f1 with identifier: DL65475 to the API
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:45:51Z',
'fuel_type': 'diesel',
'id': 'bb5c39f2-0690-52a8-b997-3aafaf7d79f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL65475',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VI Plus',
'odometer': 227620,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-06-19',
'seller_name': None,
'title': 'Volkswagen Golf VI Plus 1.6 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2013}
2026-04-27 07:54:46 [auto1.es] INFO: Saving data for DL65475: {'auction_closing_time': 1777391151.0, 'created_time': 1777021568.234259, 'has_photos': True, 'last_price_update_time': 1777276486.856274}
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_22d0f66b275c3bca58b75a05c4b649be.jpg not downloaded yet
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_701eac903855a30952f4b47d990a2817.jpg not downloaded yet
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_6a218974f6978f36ebfbfe6caf8d5a73.jpg not downloaded yet
2026-04-27 07:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 140eb0ff-cb21-5a50-9e9a-80b0620554ae with identifier: BA75989
2026-04-27 07:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 140eb0ff-cb21-5a50-9e9a-80b0620554ae with identifier: BA75989
2026-04-27 07:54:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 140eb0ff-cb21-5a50-9e9a-80b0620554ae with identifier: BA75989 to the API
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7d39f271e0a5b25179102b5f51703388.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-04-28T15:00:10Z',
'fuel_type': 'hybrid',
'id': '140eb0ff-cb21-5a50-9e9a-80b0620554ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA75989',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 62810,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6aa5d176fe51029881dac20c3aacd91f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7d39f271e0a5b25179102b5f51703388.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_80e85fab71e498855bec7673db0ea60d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_7725261a0fdf3f0429f63e763ccb028a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_324ceb32828224935fb661266ec93f4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_6ef65fcdee460a5f5f34514dd4ce23c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_ebbe2d67cb68b408a1fb2b3f5cc01fa4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_0b1c6fa0ae1905c6344a40765727da4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_108a4fa9b1877403603d52c92ada7e55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_140eb0ff-cb21-5a50-9e9a-80b0620554ae/140eb0ff-cb21-5a50-9e9a-80b0620554ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/0f/910fdd4710a231bd1ab4c39372b061eb/pa/BA75989_bada0e8423599198ccaf5b144012a087.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2022-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Tech',
'transmission': 'automatic',
'trim': '2WD Active Tech',
'year': 2022}
2026-04-27 07:54:47 [auto1.es] INFO: Saving data for BA75989: {'created_time': 1777276487.305159, 'last_price_update_time': 1777276487.305173, 'has_photos': True, 'auction_closing_time': 1777388410.0}
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c21d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_e5fed86b6ed4e67d40f5b13f1b28ac06.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931e50>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_1badac9720c7e420ea2e5d39bb0315f4.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 960db568-016a-59b0-bce9-f5cf20a607bc
2026-04-27 07:54:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 960db568-016a-59b0-bce9-f5cf20a607bc, skipping ID generation
2026-04-27 07:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960db568-016a-59b0-bce9-f5cf20a607bc with scrape type 1
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 960db568-016a-59b0-bce9-f5cf20a607bc sending to next pipeline
2026-04-27 07:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 960db568-016a-59b0-bce9-f5cf20a607bc, identifier: EZ13692
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048478ed0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_a0152af125abfd01e137399fd68e00f8.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483396d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7248421f-4066-5b1f-a278-2b8c1e4c7add/7248421f-4066-5b1f-a278-2b8c1e4c7add_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b8/4bb848228eba938f45b0ae00ca738ea5/pa/PT61600_14b2576bfdef1ecb91172cee66a9a98f.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7248421f-4066-5b1f-a278-2b8c1e4c7add
2026-04-27 07:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_5fd1d0cbed8c1c4dd58d06b548479eed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 84984ccb-d064-5304-b3ea-acef3cf428fe with identifier: MU00444
2026-04-27 07:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 84984ccb-d064-5304-b3ea-acef3cf428fe with identifier: MU00444
2026-04-27 07:54:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 84984ccb-d064-5304-b3ea-acef3cf428fe with identifier: MU00444 to the API
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:44:34Z',
'fuel_type': 'diesel',
'id': '84984ccb-d064-5304-b3ea-acef3cf428fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU00444',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Sportage',
'odometer': 148226,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-09-07',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Black Edition 2WD',
'transmission': 'manual',
'trim': 'Black Edition 2WD',
'year': 2021}
2026-04-27 07:54:47 [auto1.es] INFO: Saving data for MU00444: {'auction_closing_time': 1777391074.0, 'created_time': 1777019214.315594, 'has_photos': True, 'last_price_update_time': 1777276487.982645}
2026-04-27 07:54:48 [auto1.es] INFO: Found listing with ID: JT03070
2026-04-27 07:54:48 [auto1.es] INFO: Scrape type for JT03070: 2
2026-04-27 07:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08723098-24db-592d-9947-99bcbbe2c84c with identifier: JT03070
2026-04-27 07:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08723098-24db-592d-9947-99bcbbe2c84c with scrape type 2
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08723098-24db-592d-9947-99bcbbe2c84c with scrape type 2
2026-04-27 07:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08723098-24db-592d-9947-99bcbbe2c84c, identifier: JT03070
2026-04-27 07:54:48 [auto1.es] INFO: Found listing with ID: DX19120
2026-04-27 07:54:48 [auto1.es] INFO: Scrape type for DX19120: 2
2026-04-27 07:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c3df8d-b514-524d-9792-5397b162c53f with identifier: DX19120
2026-04-27 07:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c3df8d-b514-524d-9792-5397b162c53f with scrape type 2
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c3df8d-b514-524d-9792-5397b162c53f with scrape type 2
2026-04-27 07:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83c3df8d-b514-524d-9792-5397b162c53f, identifier: DX19120
2026-04-27 07:54:48 [auto1.es] INFO: Found listing with ID: DZ61006
2026-04-27 07:54:48 [auto1.es] INFO: Scrape type for DZ61006: 2
2026-04-27 07:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05febebc-0307-537b-9745-487bc3892661 with identifier: DZ61006
2026-04-27 07:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05febebc-0307-537b-9745-487bc3892661 with scrape type 2
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05febebc-0307-537b-9745-487bc3892661 with scrape type 2
2026-04-27 07:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05febebc-0307-537b-9745-487bc3892661, identifier: DZ61006
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_c2b53e89debf197c382c235eebc0389a.jpg not downloaded yet
2026-04-27 07:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 960db568-016a-59b0-bce9-f5cf20a607bc with identifier: EZ13692
2026-04-27 07:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 960db568-016a-59b0-bce9-f5cf20a607bc with identifier: EZ13692
2026-04-27 07:54:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 960db568-016a-59b0-bce9-f5cf20a607bc with identifier: EZ13692 to the API
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_1badac9720c7e420ea2e5d39bb0315f4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:56:38Z',
'fuel_type': 'diesel',
'id': '960db568-016a-59b0-bce9-f5cf20a607bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ13692',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 266448,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_63b1122170ea494007dedc6d1b83b4a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_1badac9720c7e420ea2e5d39bb0315f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_6307280bbdf3c0f87eeb3942bfdb7fcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_798dbf90b1931a926b6400fc3ecca8e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_e79ef86b7dcf7a851d69a83db24a82f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_f54c5b2a2cbbbcc0f83ab2db46c696f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_23d9a2d0dd52a5081c8255e6f0a3f2b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_9e6dc0ce54909eae38159f4935fbaec0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_cab63a5e42952d7201356a993049c5da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_960db568-016a-59b0-bce9-f5cf20a607bc/960db568-016a-59b0-bce9-f5cf20a607bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/47/4a47237036e633d9064c0af42fd9f267/pa/EZ13692_74a0d2c013f27d156338836fef9900bf.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2016-11-29',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2016}
2026-04-27 07:54:48 [auto1.es] INFO: Saving data for EZ13692: {'created_time': 1777276488.90101, 'last_price_update_time': 1777276488.901024, 'has_photos': True, 'auction_closing_time': 1777391798.0}
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_f879aa1b4d79c5c865de5165c6cc39a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_9c7887ccca93b5fb8524c89176c45d7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [auto1.es] INFO: Found listing with ID: MX90719
2026-04-27 07:54:49 [auto1.es] INFO: Scrape type for MX90719: 1
2026-04-27 07:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08723098-24db-592d-9947-99bcbbe2c84c with identifier: JT03070
2026-04-27 07:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08723098-24db-592d-9947-99bcbbe2c84c with identifier: JT03070
2026-04-27 07:54:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08723098-24db-592d-9947-99bcbbe2c84c with identifier: JT03070 to the API
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 194,
'expiration_date': '2026-04-28T15:14:22Z',
'fuel_type': 'diesel',
'id': '08723098-24db-592d-9947-99bcbbe2c84c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT03070',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 137196,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-02-16',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-04-27 07:54:49 [auto1.es] INFO: Saving data for JT03070: {'auction_closing_time': 1777389262.0, 'created_time': 1777019120.188966, 'has_photos': True, 'last_price_update_time': 1777276489.388953}
2026-04-27 07:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83c3df8d-b514-524d-9792-5397b162c53f with identifier: DX19120
2026-04-27 07:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83c3df8d-b514-524d-9792-5397b162c53f with identifier: DX19120
2026-04-27 07:54:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83c3df8d-b514-524d-9792-5397b162c53f with identifier: DX19120 to the API
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:39:35Z',
'fuel_type': 'diesel',
'id': '83c3df8d-b514-524d-9792-5397b162c53f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX19120',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'Expert',
'odometer': 116536,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-06-21',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Business L3',
'transmission': 'manual',
'trim': 'Business L3',
'year': 2018}
2026-04-27 07:54:49 [auto1.es] INFO: Saving data for DX19120: {'auction_closing_time': 1777390775.0, 'created_time': 1777018978.918444, 'has_photos': True, 'last_price_update_time': 1777276489.791114}
2026-04-27 07:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05febebc-0307-537b-9745-487bc3892661 with identifier: DZ61006
2026-04-27 07:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05febebc-0307-537b-9745-487bc3892661 with identifier: DZ61006
2026-04-27 07:54:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05febebc-0307-537b-9745-487bc3892661 with identifier: DZ61006 to the API
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-04-28T15:48:55Z',
'fuel_type': 'diesel',
'id': '05febebc-0307-537b-9745-487bc3892661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ61006',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mitsubishi',
'model': 'Pajero',
'odometer': 252122,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-09-28',
'seller_name': None,
'title': 'Mitsubishi Pajero 3.2 DI-D Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2004}
2026-04-27 07:54:50 [auto1.es] INFO: Saving data for DZ61006: {'auction_closing_time': 1777391335.0, 'created_time': 1777019895.972447, 'has_photos': True, 'last_price_update_time': 1777276490.120058}
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_caf583200dabb03f9d401e1f38769c7d.jpg not downloaded yet
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_975cf60695c4c1f5d248a98924f3bfa1.jpg not downloaded yet
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_2bd9c652b19f7dca98e5e4929c41aae2.jpg not downloaded yet
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD90485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD82310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR63609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c2a90>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55a86871-2b4f-50ad-94ec-c257548c1557/55a86871-2b4f-50ad-94ec-c257548c1557_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/b9/b3b971a138ab82cdc828569e5b2b7e64/pa/XH92934_1a3eeb94f830013d82f51494b3d1cd62.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55a86871-2b4f-50ad-94ec-c257548c1557
2026-04-27 07:54:50 [auto1.es] INFO: Found listing with ID: HL91539
2026-04-27 07:54:50 [auto1.es] INFO: Scrape type for HL91539: 1
2026-04-27 07:54:50 [auto1.es] INFO: Found listing with ID: DL67174
2026-04-27 07:54:50 [auto1.es] INFO: Scrape type for DL67174: 2
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0a60d5-e253-560b-971d-6acef668247b with scrape type 2
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0a60d5-e253-560b-971d-6acef668247b with scrape type 2
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f0a60d5-e253-560b-971d-6acef668247b, identifier: DL67174
2026-04-27 07:54:50 [auto1.es] INFO: Found listing with ID: GL91388
2026-04-27 07:54:50 [auto1.es] INFO: Scrape type for GL91388: 2
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc8df66c-89d9-504a-8736-ef4eb13f437e with identifier: GL91388
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc8df66c-89d9-504a-8736-ef4eb13f437e with scrape type 2
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc8df66c-89d9-504a-8736-ef4eb13f437e with scrape type 2
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc8df66c-89d9-504a-8736-ef4eb13f437e, identifier: GL91388
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_127e9d998e0444f00e9c6521ff9cedc1.jpg not downloaded yet
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR81888> (referer: https://www.auto1.com/v1/car-details-view/SR81888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_56523566a264af403312cf27783ed396.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:50 [auto1.es] INFO: Found listing with ID: AB65360
2026-04-27 07:54:50 [auto1.es] INFO: Scrape type for AB65360: 2
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d353cfad-a280-5e7e-8be4-2b9c3b587d00 with identifier: AB65360
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d353cfad-a280-5e7e-8be4-2b9c3b587d00 with scrape type 2
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d353cfad-a280-5e7e-8be4-2b9c3b587d00 with scrape type 2
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d353cfad-a280-5e7e-8be4-2b9c3b587d00, identifier: AB65360
2026-04-27 07:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-04-27 07:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-04-27 07:54:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174 to the API
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:40:44Z',
'fuel_type': 'diesel',
'id': '7f0a60d5-e253-560b-971d-6acef668247b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL67174',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q3',
'odometer': 246968,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-04-09',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Ambition',
'transmission': 'manual',
'trim': 'quattro Ambition',
'year': 2014}
2026-04-27 07:54:50 [auto1.es] INFO: Saving data for DL67174: {'auction_closing_time': 1777390844.0, 'created_time': 1777020144.143719, 'has_photos': True, 'last_price_update_time': 1777276490.970162}
2026-04-27 07:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc8df66c-89d9-504a-8736-ef4eb13f437e with identifier: GL91388
2026-04-27 07:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc8df66c-89d9-504a-8736-ef4eb13f437e with identifier: GL91388
2026-04-27 07:54:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc8df66c-89d9-504a-8736-ef4eb13f437e with identifier: GL91388 to the API
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:24:07Z',
'fuel_type': 'petrol',
'id': 'dc8df66c-89d9-504a-8736-ef4eb13f437e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL91388',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 181741,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-12-25',
'seller_name': None,
'title': 'Peugeot 3008 1.2 e-THP GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2018}
2026-04-27 07:54:51 [auto1.es] INFO: Saving data for GL91388: {'auction_closing_time': 1777389847.0, 'created_time': 1777020294.236463, 'has_photos': True, 'last_price_update_time': 1777276491.316004}
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_21d13018d4a6edb99b7cef7fcdb9041c.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_4dae23f037501462343be0cb5b150b72.jpg not downloaded yet
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_da25d513fcdba4fda3e776ac3263d7c9.jpg not downloaded yet
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048933ed0>
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1152e29f-4946-587c-8bab-27792ed8e6ac/1152e29f-4946-587c-8bab-27792ed8e6ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_5fd1d0cbed8c1c4dd58d06b548479eed.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1152e29f-4946-587c-8bab-27792ed8e6ac
2026-04-27 07:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d353cfad-a280-5e7e-8be4-2b9c3b587d00 with identifier: AB65360
2026-04-27 07:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d353cfad-a280-5e7e-8be4-2b9c3b587d00 with identifier: AB65360
2026-04-27 07:54:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d353cfad-a280-5e7e-8be4-2b9c3b587d00 with identifier: AB65360 to the API
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:55:11Z',
'fuel_type': 'diesel',
'id': 'd353cfad-a280-5e7e-8be4-2b9c3b587d00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB65360',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 78543,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-07-06',
'seller_name': None,
'title': 'Seat Ibiza 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2009}
2026-04-27 07:54:51 [auto1.es] INFO: Saving data for AB65360: {'auction_closing_time': 1777391711.0, 'created_time': 1777020123.582306, 'has_photos': True, 'last_price_update_time': 1777276491.791259}
2026-04-27 07:54:51 [auto1.es] INFO: Found listing with ID: TK27878
2026-04-27 07:54:51 [auto1.es] INFO: Scrape type for TK27878: 2
2026-04-27 07:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f91b4f-198c-5ca6-860d-030541d5bd19 with identifier: TK27878
2026-04-27 07:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f91b4f-198c-5ca6-860d-030541d5bd19 with scrape type 2
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58f91b4f-198c-5ca6-860d-030541d5bd19 with scrape type 2
2026-04-27 07:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58f91b4f-198c-5ca6-860d-030541d5bd19, identifier: TK27878
2026-04-27 07:54:51 [auto1.es] INFO: Found listing with ID: JE95438
2026-04-27 07:54:51 [auto1.es] INFO: Scrape type for JE95438: 2
2026-04-27 07:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d1a359-f1ea-502f-84d0-7b5643d967ef with identifier: JE95438
2026-04-27 07:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d1a359-f1ea-502f-84d0-7b5643d967ef with scrape type 2
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d1a359-f1ea-502f-84d0-7b5643d967ef with scrape type 2
2026-04-27 07:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 99d1a359-f1ea-502f-84d0-7b5643d967ef, identifier: JE95438
2026-04-27 07:54:52 [auto1.es] INFO: Found listing with ID: WT40413
2026-04-27 07:54:52 [auto1.es] INFO: Scrape type for WT40413: 1
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_04bf5b0a43526a36bd953d344b313ebe.jpg not downloaded yet
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048497210>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_f879aa1b4d79c5c865de5165c6cc39a6.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048858250>
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3230f8a5-87fe-532b-841f-5e419cdf9d87/3230f8a5-87fe-532b-841f-5e419cdf9d87_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/93/86938bfa42251b88e92fb414b9b4b3ec/pa/PP73553_9c7887ccca93b5fb8524c89176c45d7c.jpg saved to cache
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3230f8a5-87fe-532b-841f-5e419cdf9d87
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_65ed8aedfc6982ba76e86741115dbca6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [auto1.es] INFO: Found listing with ID: FF27618
2026-04-27 07:54:52 [auto1.es] INFO: Scrape type for FF27618: 2
2026-04-27 07:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1420f417-d65b-57c9-86b2-222c5c8b5a19 with identifier: FF27618
2026-04-27 07:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1420f417-d65b-57c9-86b2-222c5c8b5a19 with scrape type 2
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1420f417-d65b-57c9-86b2-222c5c8b5a19 with scrape type 2
2026-04-27 07:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1420f417-d65b-57c9-86b2-222c5c8b5a19, identifier: FF27618
2026-04-27 07:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58f91b4f-198c-5ca6-860d-030541d5bd19 with identifier: TK27878
2026-04-27 07:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58f91b4f-198c-5ca6-860d-030541d5bd19 with identifier: TK27878
2026-04-27 07:54:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58f91b4f-198c-5ca6-860d-030541d5bd19 with identifier: TK27878 to the API
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:36:00Z',
'fuel_type': 'diesel',
'id': '58f91b4f-198c-5ca6-860d-030541d5bd19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK27878',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 16509,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2024-12-29',
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.6 VGT-D Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2024}
2026-04-27 07:54:52 [auto1.es] INFO: Saving data for TK27878: {'auction_closing_time': 1777390560.0, 'created_time': 1777020234.004804, 'has_photos': True, 'last_price_update_time': 1777276492.606594}
2026-04-27 07:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 99d1a359-f1ea-502f-84d0-7b5643d967ef with identifier: JE95438
2026-04-27 07:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 99d1a359-f1ea-502f-84d0-7b5643d967ef with identifier: JE95438
2026-04-27 07:54:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 99d1a359-f1ea-502f-84d0-7b5643d967ef with identifier: JE95438 to the API
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-04-28T15:07:29Z',
'fuel_type': 'petrol',
'id': '99d1a359-f1ea-502f-84d0-7b5643d967ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE95438',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'RS 3 Sportback',
'odometer': 42260,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-11-05',
'seller_name': None,
'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-04-27 07:54:52 [auto1.es] INFO: Saving data for JE95438: {'auction_closing_time': 1777388849.0, 'created_time': 1777019138.072007, 'has_photos': True, 'last_price_update_time': 1777276492.908862}
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_7831957c2b794a297837c1c83fbfd62a.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_9aa25afd7f60d4d263f472dadb4f27df.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_a743285f6ea9ccff6b7784a9fee661c9.jpg not downloaded yet
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_701eac903855a30952f4b47d990a2817.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_6a218974f6978f36ebfbfe6caf8d5a73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1420f417-d65b-57c9-86b2-222c5c8b5a19 with identifier: FF27618
2026-04-27 07:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1420f417-d65b-57c9-86b2-222c5c8b5a19 with identifier: FF27618
2026-04-27 07:54:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1420f417-d65b-57c9-86b2-222c5c8b5a19 with identifier: FF27618 to the API
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:23:19Z',
'fuel_type': 'diesel',
'id': '1420f417-d65b-57c9-86b2-222c5c8b5a19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF27618',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Karoq',
'odometer': 123328,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-11-18',
'seller_name': None,
'title': 'Skoda Karoq 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2019}
2026-04-27 07:54:53 [auto1.es] INFO: Saving data for FF27618: {'auction_closing_time': 1777389799.0, 'created_time': 1777018504.327717, 'has_photos': True, 'last_price_update_time': 1777276493.293004}
2026-04-27 07:54:53 [auto1.es] INFO: Found listing with ID: CU40890
2026-04-27 07:54:53 [auto1.es] INFO: Scrape type for CU40890: 2
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202 with identifier: CU40890
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202 with scrape type 2
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202 with scrape type 2
2026-04-27 07:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202, identifier: CU40890
2026-04-27 07:54:53 [auto1.es] INFO: Found listing with ID: EG82804
2026-04-27 07:54:53 [auto1.es] INFO: Scrape type for EG82804: 2
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4f0a595-d090-55e9-915e-5639344481db with identifier: EG82804
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4f0a595-d090-55e9-915e-5639344481db with scrape type 2
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4f0a595-d090-55e9-915e-5639344481db with scrape type 2
2026-04-27 07:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4f0a595-d090-55e9-915e-5639344481db, identifier: EG82804
2026-04-27 07:54:53 [auto1.es] INFO: Found listing with ID: MH09710
2026-04-27 07:54:53 [auto1.es] INFO: Scrape type for MH09710: 2
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ee03ad-e9f7-5812-8373-c9837706aa35 with identifier: MH09710
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ee03ad-e9f7-5812-8373-c9837706aa35 with scrape type 2
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ee03ad-e9f7-5812-8373-c9837706aa35 with scrape type 2
2026-04-27 07:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91ee03ad-e9f7-5812-8373-c9837706aa35, identifier: MH09710
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_1e5afb07d66aa67ac057d3823fa66caa.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT63016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY15551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58daa033-94ff-5d12-b99b-d3638ad3ae90 with identifier: SR81888
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58daa033-94ff-5d12-b99b-d3638ad3ae90 with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_80e390e1880db3be8df03f4dca1016fd.jpg not downloaded yet
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833f390>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_56523566a264af403312cf27783ed396.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_cff8bf08de2415a4b65472e0440c7b90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_c2b53e89debf197c382c235eebc0389a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_22d0f66b275c3bca58b75a05c4b649be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202 with identifier: CU40890
2026-04-27 07:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202 with identifier: CU40890
2026-04-27 07:54:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 04bdf1e6-b0be-5649-9d4a-7f98ec6e9202 with identifier: CU40890 to the API
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:14:25Z',
'fuel_type': 'diesel',
'id': '04bdf1e6-b0be-5649-9d4a-7f98ec6e9202',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU40890',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Honda',
'model': 'Civic',
'odometer': 160534,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-02-14',
'seller_name': None,
'title': 'Honda Civic 1.6 DTEC Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2019}
2026-04-27 07:54:54 [auto1.es] INFO: Saving data for CU40890: {'auction_closing_time': 1777389265.0, 'created_time': 1777020439.609923, 'has_photos': True, 'last_price_update_time': 1777276494.117026}
2026-04-27 07:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4f0a595-d090-55e9-915e-5639344481db with identifier: EG82804
2026-04-27 07:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4f0a595-d090-55e9-915e-5639344481db with identifier: EG82804
2026-04-27 07:54:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4f0a595-d090-55e9-915e-5639344481db with identifier: EG82804 to the API
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:55:19Z',
'fuel_type': 'diesel',
'id': 'c4f0a595-d090-55e9-915e-5639344481db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG82804',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 141674,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-03-20',
'seller_name': None,
'title': 'BMW X1 sDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-04-27 07:54:54 [auto1.es] INFO: Saving data for EG82804: {'auction_closing_time': 1777391719.0, 'created_time': 1777018898.362932, 'has_photos': True, 'last_price_update_time': 1777276494.56948}
2026-04-27 07:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91ee03ad-e9f7-5812-8373-c9837706aa35 with identifier: MH09710
2026-04-27 07:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91ee03ad-e9f7-5812-8373-c9837706aa35 with identifier: MH09710
2026-04-27 07:54:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91ee03ad-e9f7-5812-8373-c9837706aa35 with identifier: MH09710 to the API
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:19:41Z',
'fuel_type': 'diesel',
'id': '91ee03ad-e9f7-5812-8373-c9837706aa35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH09710',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 240703,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-24',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2009}
2026-04-27 07:54:54 [auto1.es] INFO: Saving data for MH09710: {'auction_closing_time': 1777389581.0, 'created_time': 1777020452.900058, 'has_photos': True, 'last_price_update_time': 1777276494.89526}
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_8ea6adc38d549be9e5dcacd2a38da4ba.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_a87a536e436689e575e946a81a5de6e8.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_83f406f3de629628fc35cdb95077d5e6.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_2bd9c652b19f7dca98e5e4929c41aae2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [auto1.es] INFO: Found listing with ID: UD79775
2026-04-27 07:54:54 [auto1.es] INFO: Scrape type for UD79775: 1
2026-04-27 07:54:54 [auto1.es] INFO: Found listing with ID: CH02568
2026-04-27 07:54:55 [auto1.es] INFO: Scrape type for CH02568: 2
2026-04-27 07:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca with identifier: CH02568
2026-04-27 07:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca with scrape type 2
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca with scrape type 2
2026-04-27 07:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca, identifier: CH02568
2026-04-27 07:54:55 [auto1.es] INFO: Found listing with ID: GP30009
2026-04-27 07:54:55 [auto1.es] INFO: Scrape type for GP30009: 2
2026-04-27 07:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d82368-ec45-5c19-9ec2-bbae9ced5357 with identifier: GP30009
2026-04-27 07:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d82368-ec45-5c19-9ec2-bbae9ced5357 with scrape type 2
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d82368-ec45-5c19-9ec2-bbae9ced5357 with scrape type 2
2026-04-27 07:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6d82368-ec45-5c19-9ec2-bbae9ced5357, identifier: GP30009
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_aad1cb76a97cdcaf4731686ec1c63166.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_02cdc63d331b50baaf9801f14920ebf6.jpg not downloaded yet
2026-04-27 07:54:55 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2013 | hits on page: 40
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048385fd0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_65ed8aedfc6982ba76e86741115dbca6.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca with identifier: CH02568
2026-04-27 07:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca with identifier: CH02568
2026-04-27 07:54:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca with identifier: CH02568 to the API
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:54:28Z',
'fuel_type': 'diesel',
'id': 'e38fd236-38ca-5cf1-b4e5-a0f2c3ac91ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH02568',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 61083,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-04-29',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.5 Blue-HDi C-Series',
'transmission': 'manual',
'trim': 'C-Series',
'year': 2021}
2026-04-27 07:54:55 [auto1.es] INFO: Saving data for CH02568: {'auction_closing_time': 1777391668.0, 'created_time': 1777019728.474831, 'has_photos': True, 'last_price_update_time': 1777276495.9626}
2026-04-27 07:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6d82368-ec45-5c19-9ec2-bbae9ced5357 with identifier: GP30009
2026-04-27 07:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6d82368-ec45-5c19-9ec2-bbae9ced5357 with identifier: GP30009
2026-04-27 07:54:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6d82368-ec45-5c19-9ec2-bbae9ced5357 with identifier: GP30009 to the API
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:06:04Z',
'fuel_type': 'diesel',
'id': 'b6d82368-ec45-5c19-9ec2-bbae9ced5357',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP30009',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '208',
'odometer': 73998,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-09-15',
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-04-27 07:54:56 [auto1.es] INFO: Saving data for GP30009: {'auction_closing_time': 1777388764.0, 'created_time': 1777021330.319232, 'has_photos': True, 'last_price_update_time': 1777276496.301515}
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_ae9844bb9d1e12161e2615eaf2e621f8.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_c81875b044c4acde20c63d1627e70824.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_8df7eafa51f9afe3735a9038a5a816ec.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207850>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_701eac903855a30952f4b47d990a2817.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04829e550>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_6a218974f6978f36ebfbfe6caf8d5a73.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_da25d513fcdba4fda3e776ac3263d7c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_127e9d998e0444f00e9c6521ff9cedc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_975cf60695c4c1f5d248a98924f3bfa1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [auto1.es] INFO: Found listing with ID: HS39015
2026-04-27 07:54:56 [auto1.es] INFO: Scrape type for HS39015: 2
2026-04-27 07:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ffa1fea-8d85-5908-b7d0-741559fc3d5e with identifier: HS39015
2026-04-27 07:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ffa1fea-8d85-5908-b7d0-741559fc3d5e with scrape type 2
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ffa1fea-8d85-5908-b7d0-741559fc3d5e with scrape type 2
2026-04-27 07:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ffa1fea-8d85-5908-b7d0-741559fc3d5e, identifier: HS39015
2026-04-27 07:54:56 [auto1.es] INFO: Found listing with ID: FP58894
2026-04-27 07:54:56 [auto1.es] INFO: Scrape type for FP58894: 1
2026-04-27 07:54:56 [auto1.es] INFO: Found listing with ID: WA83651
2026-04-27 07:54:56 [auto1.es] INFO: Scrape type for WA83651: 2
2026-04-27 07:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651
2026-04-27 07:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b6ba251-62f6-5df4-bafc-69f744a392f2 with scrape type 2
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b6ba251-62f6-5df4-bafc-69f744a392f2 with scrape type 2
2026-04-27 07:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b6ba251-62f6-5df4-bafc-69f744a392f2, identifier: WA83651
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_69b27e96af0056535d816bc925786134.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_b6da303705ba39f63d93ad408b2f8302.jpg not downloaded yet
2026-04-27 07:54:56 [auto1.es] INFO: Found listing with ID: VB40335
2026-04-27 07:54:56 [auto1.es] INFO: Scrape type for VB40335: 2
2026-04-27 07:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccff3961-972d-5db4-837a-fd6314921dda with identifier: VB40335
2026-04-27 07:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccff3961-972d-5db4-837a-fd6314921dda with scrape type 2
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccff3961-972d-5db4-837a-fd6314921dda with scrape type 2
2026-04-27 07:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ccff3961-972d-5db4-837a-fd6314921dda, identifier: VB40335
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD60065> (referer: https://www.auto1.com/v1/car-details-view/JD60065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ab150>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_cff8bf08de2415a4b65472e0440c7b90.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851da50>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_c2b53e89debf197c382c235eebc0389a.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ee650>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1152e29f-4946-587c-8bab-27792ed8e6ac/1152e29f-4946-587c-8bab-27792ed8e6ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_22d0f66b275c3bca58b75a05c4b649be.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1152e29f-4946-587c-8bab-27792ed8e6ac
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_04bf5b0a43526a36bd953d344b313ebe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ffa1fea-8d85-5908-b7d0-741559fc3d5e with identifier: HS39015
2026-04-27 07:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ffa1fea-8d85-5908-b7d0-741559fc3d5e with identifier: HS39015
2026-04-27 07:54:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ffa1fea-8d85-5908-b7d0-741559fc3d5e with identifier: HS39015 to the API
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:12:40Z',
'fuel_type': 'diesel',
'id': '1ffa1fea-8d85-5908-b7d0-741559fc3d5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS39015',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Altea',
'odometer': 161338,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-01-09',
'seller_name': None,
'title': 'Seat Altea 1.6 TDI Reference Copa Ecomotive',
'transmission': 'manual',
'trim': 'Reference Copa Ecomotive',
'year': 2012}
2026-04-27 07:54:57 [auto1.es] INFO: Saving data for HS39015: {'auction_closing_time': 1777389160.0, 'created_time': 1777019609.595245, 'has_photos': True, 'last_price_update_time': 1777276497.399732}
2026-04-27 07:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651
2026-04-27 07:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651
2026-04-27 07:54:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b6ba251-62f6-5df4-bafc-69f744a392f2 with identifier: WA83651 to the API
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:51:04Z',
'fuel_type': 'diesel',
'id': '0b6ba251-62f6-5df4-bafc-69f744a392f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA83651',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 216267,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-11-30',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2007}
2026-04-27 07:54:57 [auto1.es] INFO: Saving data for WA83651: {'auction_closing_time': 1777391464.0, 'created_time': 1777020540.047068, 'has_photos': True, 'last_price_update_time': 1777276497.774466}
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_35eeb490d6de06e1d78689d88dbca670.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_e71ab83b8a50d5a4df6890aa1448712f.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_21b33bee89e418ff7d92c7cc377252ec.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ccff3961-972d-5db4-837a-fd6314921dda with identifier: VB40335
2026-04-27 07:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ccff3961-972d-5db4-837a-fd6314921dda with identifier: VB40335
2026-04-27 07:54:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ccff3961-972d-5db4-837a-fd6314921dda with identifier: VB40335 to the API
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:07:20Z',
'fuel_type': 'diesel',
'id': 'ccff3961-972d-5db4-837a-fd6314921dda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB40335',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 289557,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-09-16',
'seller_name': None,
'title': 'Ford Fiesta 1.6 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2010}
2026-04-27 07:54:58 [auto1.es] INFO: Saving data for VB40335: {'auction_closing_time': 1777388840.0, 'created_time': 1777019626.932205, 'has_photos': True, 'last_price_update_time': 1777276498.179812}
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a85fe50>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_2bd9c652b19f7dca98e5e4929c41aae2.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_7831957c2b794a297837c1c83fbfd62a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_a743285f6ea9ccff6b7784a9fee661c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_9aa25afd7f60d4d263f472dadb4f27df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [auto1.es] INFO: Found listing with ID: DL65807
2026-04-27 07:54:58 [auto1.es] INFO: Scrape type for DL65807: 1
2026-04-27 07:54:58 [auto1.es] INFO: Found listing with ID: VK23822
2026-04-27 07:54:58 [auto1.es] INFO: Scrape type for VK23822: 2
2026-04-27 07:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822
2026-04-27 07:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with scrape type 2
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with scrape type 2
2026-04-27 07:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850, identifier: VK23822
2026-04-27 07:54:58 [auto1.es] INFO: Found listing with ID: UK11838
2026-04-27 07:54:58 [auto1.es] INFO: Scrape type for UK11838: 2
2026-04-27 07:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a452a3e0-1510-56ed-bfe6-81279eb2eb7d with identifier: UK11838
2026-04-27 07:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a452a3e0-1510-56ed-bfe6-81279eb2eb7d with scrape type 2
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a452a3e0-1510-56ed-bfe6-81279eb2eb7d with scrape type 2
2026-04-27 07:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a452a3e0-1510-56ed-bfe6-81279eb2eb7d, identifier: UK11838
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_299ea7e6bd3fee53c5dadaeb9cfdfbed.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_6bc9179ab8dbbd36b26d9b0e046d3709.jpg not downloaded yet
2026-04-27 07:54:58 [auto1.es] INFO: Found listing with ID: VE24671
2026-04-27 07:54:58 [auto1.es] INFO: Scrape type for VE24671: 2
2026-04-27 07:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7 with identifier: VE24671
2026-04-27 07:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7 with scrape type 2
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7 with scrape type 2
2026-04-27 07:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7, identifier: VE24671
2026-04-27 07:54:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_80e390e1880db3be8df03f4dca1016fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_4dae23f037501462343be0cb5b150b72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822
2026-04-27 07:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822
2026-04-27 07:54:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822 to the API
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-04-28T15:28:56Z',
'fuel_type': 'petrol',
'id': 'be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK23822',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Micra',
'odometer': 181615,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '1994-04-28',
'seller_name': None,
'title': 'Nissan Micra 1.0',
'transmission': 'manual',
'trim': '',
'year': 1994}
2026-04-27 07:54:59 [auto1.es] INFO: Saving data for VK23822: {'auction_closing_time': 1777390136.0, 'created_time': 1776941008.889156, 'has_photos': True, 'last_price_update_time': 1777276499.041661}
2026-04-27 07:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a452a3e0-1510-56ed-bfe6-81279eb2eb7d with identifier: UK11838
2026-04-27 07:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a452a3e0-1510-56ed-bfe6-81279eb2eb7d with identifier: UK11838
2026-04-27 07:54:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a452a3e0-1510-56ed-bfe6-81279eb2eb7d with identifier: UK11838 to the API
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:40:56Z',
'fuel_type': 'diesel',
'id': 'a452a3e0-1510-56ed-bfe6-81279eb2eb7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK11838',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 209587,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-06-11',
'seller_name': None,
'title': 'Seat Ibiza 1.9 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2006}
2026-04-27 07:54:59 [auto1.es] INFO: Saving data for UK11838: {'auction_closing_time': 1777390856.0, 'created_time': 1777020373.465036, 'has_photos': True, 'last_price_update_time': 1777276499.471929}
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_85c81d73221235b540d562322a2ceb37.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_e809394780e4ed205eb202847512b16a.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7 with identifier: VE24671
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-04-27 07:54:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7 with identifier: VE24671
2026-04-27 07:54:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7 with identifier: VE24671 to the API
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'other',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:28:22Z',
'fuel_type': 'diesel',
'id': 'fd89b979-e75a-5d7b-a9e8-8b4a698fa7a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE24671',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 29060,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2025-05-11',
'seller_name': None,
'title': 'BMW 3er 318d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2025}
2026-04-27 07:55:00 [auto1.es] INFO: Saving data for VE24671: {'auction_closing_time': 1777390102.0, 'created_time': 1777018503.477476, 'has_photos': True, 'last_price_update_time': 1777276500.059682}
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048674210>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_da25d513fcdba4fda3e776ac3263d7c9.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048829190>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_127e9d998e0444f00e9c6521ff9cedc1.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572fa310>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_975cf60695c4c1f5d248a98924f3bfa1.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd81c38-6402-51ad-96f1-7bf4a59afa30 with identifier: JD60065
2026-04-27 07:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd81c38-6402-51ad-96f1-7bf4a59afa30 with scrape type 1
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_62986ea1f568ac682ed0ae4872ac703f.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_02cdc63d331b50baaf9801f14920ebf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_21d13018d4a6edb99b7cef7fcdb9041c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [auto1.es] INFO: Found listing with ID: DZ14313
2026-04-27 07:55:00 [auto1.es] INFO: Scrape type for DZ14313: 2
2026-04-27 07:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-04-27 07:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with scrape type 2
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with scrape type 2
2026-04-27 07:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7, identifier: DZ14313
2026-04-27 07:55:00 [auto1.es] INFO: Found listing with ID: HB55085
2026-04-27 07:55:00 [auto1.es] INFO: Scrape type for HB55085: 1
2026-04-27 07:55:00 [auto1.es] INFO: Found listing with ID: BB33691
2026-04-27 07:55:00 [auto1.es] INFO: Scrape type for BB33691: 1
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_6b65727803db96cfe3a5bcabba24b8ed.jpg not downloaded yet
2026-04-27 07:55:00 [auto1.es] INFO: Found listing with ID: CP55474
2026-04-27 07:55:00 [auto1.es] INFO: Scrape type for CP55474: 2
2026-04-27 07:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d832ecbe-1b41-59a4-9e32-37bfb2f579ef with identifier: CP55474
2026-04-27 07:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d832ecbe-1b41-59a4-9e32-37bfb2f579ef with scrape type 2
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d832ecbe-1b41-59a4-9e32-37bfb2f579ef with scrape type 2
2026-04-27 07:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d832ecbe-1b41-59a4-9e32-37bfb2f579ef, identifier: CP55474
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048386d10>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_04bf5b0a43526a36bd953d344b313ebe.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_c81875b044c4acde20c63d1627e70824.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_8df7eafa51f9afe3735a9038a5a816ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-04-27 07:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-04-27 07:55:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313 to the API
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:24:28Z',
'fuel_type': 'petrol',
'id': 'af095160-2b8c-51a6-92d0-ac9e8b1e6fa7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ14313',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 141564,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-02-29',
'seller_name': None,
'title': 'Ford Focus 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-04-27 07:55:01 [auto1.es] INFO: Saving data for DZ14313: {'auction_closing_time': 1777389868.0, 'created_time': 1777019898.366576, 'has_photos': True, 'last_price_update_time': 1777276501.09727}
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_e4dcdbcbc1ca9fb6dbb9a6651813a6ac.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_071b65bc37c8e520b6f42846a8431b76.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d832ecbe-1b41-59a4-9e32-37bfb2f579ef with identifier: CP55474
2026-04-27 07:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d832ecbe-1b41-59a4-9e32-37bfb2f579ef with identifier: CP55474
2026-04-27 07:55:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d832ecbe-1b41-59a4-9e32-37bfb2f579ef with identifier: CP55474 to the API
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:21:12Z',
'fuel_type': 'diesel',
'id': 'd832ecbe-1b41-59a4-9e32-37bfb2f579ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP55474',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 132289,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-02-15',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 07:55:01 [auto1.es] INFO: Saving data for CP55474: {'auction_closing_time': 1777389672.0, 'created_time': 1777019592.533928, 'has_photos': True, 'last_price_update_time': 1777276501.903716}
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_439156a8f1086afccb51cff6b04989e4.jpg not downloaded yet
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3ca10>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1152e29f-4946-587c-8bab-27792ed8e6ac/1152e29f-4946-587c-8bab-27792ed8e6ac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_7831957c2b794a297837c1c83fbfd62a.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1152e29f-4946-587c-8bab-27792ed8e6ac
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04859da10>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_a743285f6ea9ccff6b7784a9fee661c9.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823f250>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_9aa25afd7f60d4d263f472dadb4f27df.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_b6da303705ba39f63d93ad408b2f8302.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_aad1cb76a97cdcaf4731686ec1c63166.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [auto1.es] INFO: Found listing with ID: FL34452
2026-04-27 07:55:02 [auto1.es] INFO: Scrape type for FL34452: 2
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 223d9b25-2cf9-5a5c-9490-b10fb59f6c05 with identifier: FL34452
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 223d9b25-2cf9-5a5c-9490-b10fb59f6c05 with scrape type 2
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 223d9b25-2cf9-5a5c-9490-b10fb59f6c05 with scrape type 2
2026-04-27 07:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 223d9b25-2cf9-5a5c-9490-b10fb59f6c05, identifier: FL34452
2026-04-27 07:55:02 [auto1.es] INFO: Found listing with ID: FU46355
2026-04-27 07:55:02 [auto1.es] INFO: Scrape type for FU46355: 1
2026-04-27 07:55:02 [auto1.es] INFO: Found listing with ID: SR89718
2026-04-27 07:55:02 [auto1.es] INFO: Scrape type for SR89718: 1
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_78c6c849d66f3763a37290aba5d57417.jpg not downloaded yet
2026-04-27 07:55:02 [auto1.es] INFO: Found listing with ID: RW26453
2026-04-27 07:55:02 [auto1.es] INFO: Scrape type for RW26453: 2
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df707647-ab54-53cb-869e-2ae91411da10 with identifier: RW26453
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df707647-ab54-53cb-869e-2ae91411da10 with scrape type 2
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df707647-ab54-53cb-869e-2ae91411da10 with scrape type 2
2026-04-27 07:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: df707647-ab54-53cb-869e-2ae91411da10, identifier: RW26453
2026-04-27 07:55:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048257650>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_80e390e1880db3be8df03f4dca1016fd.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048277d50>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_4dae23f037501462343be0cb5b150b72.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_21b33bee89e418ff7d92c7cc377252ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 223d9b25-2cf9-5a5c-9490-b10fb59f6c05 with identifier: FL34452
2026-04-27 07:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 223d9b25-2cf9-5a5c-9490-b10fb59f6c05 with identifier: FL34452
2026-04-27 07:55:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 223d9b25-2cf9-5a5c-9490-b10fb59f6c05 with identifier: FL34452 to the API
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 118,
'expiration_date': '2026-04-28T15:41:11Z',
'fuel_type': 'petrol',
'id': '223d9b25-2cf9-5a5c-9490-b10fb59f6c05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL34452',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Captur',
'odometer': 204307,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-10-19',
'seller_name': None,
'title': 'Renault Captur 1.2 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-04-27 07:55:02 [auto1.es] INFO: Saving data for FL34452: {'auction_closing_time': 1777390871.0, 'created_time': 1777018833.567201, 'has_photos': True, 'last_price_update_time': 1777276502.881221}
2026-04-27 07:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: df707647-ab54-53cb-869e-2ae91411da10 with identifier: RW26453
2026-04-27 07:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: df707647-ab54-53cb-869e-2ae91411da10 with identifier: RW26453
2026-04-27 07:55:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: df707647-ab54-53cb-869e-2ae91411da10 with identifier: RW26453 to the API
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:44:24Z',
'fuel_type': 'diesel',
'id': 'df707647-ab54-53cb-869e-2ae91411da10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW26453',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 100544,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-12-27',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Autobiography',
'transmission': 'automatic',
'trim': 'Autobiography',
'year': 2015}
2026-04-27 07:55:03 [auto1.es] INFO: Saving data for RW26453: {'auction_closing_time': 1777391064.0, 'created_time': 1777019377.052248, 'has_photos': True, 'last_price_update_time': 1777276503.214215}
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_ec5ac1ee7d32692339bcb34b85266993.jpg not downloaded yet
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04850f1d0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_02cdc63d331b50baaf9801f14920ebf6.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488eeb90>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1152e29f-4946-587c-8bab-27792ed8e6ac/1152e29f-4946-587c-8bab-27792ed8e6ac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ac/68ac3981164e25fda802573972d5da42/pa/RD28461_21d13018d4a6edb99b7cef7fcdb9041c.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1152e29f-4946-587c-8bab-27792ed8e6ac
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_6bc9179ab8dbbd36b26d9b0e046d3709.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_e71ab83b8a50d5a4df6890aa1448712f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [auto1.es] INFO: Found listing with ID: ZW00345
2026-04-27 07:55:03 [auto1.es] INFO: Scrape type for ZW00345: 2
2026-04-27 07:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7 with identifier: ZW00345
2026-04-27 07:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7 with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7 with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7, identifier: ZW00345
2026-04-27 07:55:03 [auto1.es] INFO: Found listing with ID: BY63311
2026-04-27 07:55:03 [auto1.es] INFO: Scrape type for BY63311: 2
2026-04-27 07:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77226e86-a919-5827-8839-ba767f2923f5 with identifier: BY63311
2026-04-27 07:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77226e86-a919-5827-8839-ba767f2923f5 with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77226e86-a919-5827-8839-ba767f2923f5 with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77226e86-a919-5827-8839-ba767f2923f5, identifier: BY63311
2026-04-27 07:55:03 [auto1.es] INFO: Found listing with ID: RL85874
2026-04-27 07:55:03 [auto1.es] INFO: Scrape type for RL85874: 2
2026-04-27 07:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0a1dade-1adb-562b-abaf-d98968ee361e with identifier: RL85874
2026-04-27 07:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0a1dade-1adb-562b-abaf-d98968ee361e with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0a1dade-1adb-562b-abaf-d98968ee361e with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e0a1dade-1adb-562b-abaf-d98968ee361e, identifier: RL85874
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_038023c25171fad4655cc18812078edf.jpg not downloaded yet
2026-04-27 07:55:03 [auto1.es] INFO: Found listing with ID: EC05346
2026-04-27 07:55:03 [auto1.es] INFO: Scrape type for EC05346: 2
2026-04-27 07:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230f266a-3351-5be1-9a4b-3abb161dce6a with identifier: EC05346
2026-04-27 07:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230f266a-3351-5be1-9a4b-3abb161dce6a with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 230f266a-3351-5be1-9a4b-3abb161dce6a with scrape type 2
2026-04-27 07:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 230f266a-3351-5be1-9a4b-3abb161dce6a, identifier: EC05346
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT40413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2950>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_c81875b044c4acde20c63d1627e70824.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824bf90>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_8df7eafa51f9afe3735a9038a5a816ec.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_299ea7e6bd3fee53c5dadaeb9cfdfbed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7 with identifier: ZW00345
2026-04-27 07:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7 with identifier: ZW00345
2026-04-27 07:55:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7 with identifier: ZW00345 to the API
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-04-28T15:17:08Z',
'fuel_type': 'diesel',
'id': '8db6ddb2-4d0b-5b97-a586-fcdf890bfaf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW00345',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A5',
'odometer': 117645,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-06-16',
'seller_name': None,
'title': 'Audi A5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-04-27 07:55:04 [auto1.es] INFO: Saving data for ZW00345: {'auction_closing_time': 1777389428.0, 'created_time': 1777021613.209661, 'has_photos': True, 'last_price_update_time': 1777276504.341976}
2026-04-27 07:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77226e86-a919-5827-8839-ba767f2923f5 with identifier: BY63311
2026-04-27 07:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77226e86-a919-5827-8839-ba767f2923f5 with identifier: BY63311
2026-04-27 07:55:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77226e86-a919-5827-8839-ba767f2923f5 with identifier: BY63311 to the API
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:40:18Z',
'fuel_type': 'diesel',
'id': '77226e86-a919-5827-8839-ba767f2923f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY63311',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 158515,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2014}
2026-04-27 07:55:04 [auto1.es] INFO: Saving data for BY63311: {'auction_closing_time': 1777390818.0, 'created_time': 1777020190.059786, 'has_photos': True, 'last_price_update_time': 1777276504.734737}
2026-04-27 07:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e0a1dade-1adb-562b-abaf-d98968ee361e with identifier: RL85874
2026-04-27 07:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e0a1dade-1adb-562b-abaf-d98968ee361e with identifier: RL85874
2026-04-27 07:55:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e0a1dade-1adb-562b-abaf-d98968ee361e with identifier: RL85874 to the API
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:39:09Z',
'fuel_type': 'diesel',
'id': 'e0a1dade-1adb-562b-abaf-d98968ee361e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL85874',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Ducato',
'odometer': 137974,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-08-12',
'seller_name': None,
'title': 'Fiat Ducato 2.3 JTD 130',
'transmission': 'manual',
'trim': '130',
'year': 2019}
2026-04-27 07:55:05 [auto1.es] INFO: Saving data for RL85874: {'auction_closing_time': 1777390749.0, 'created_time': 1777020493.927349, 'has_photos': True, 'last_price_update_time': 1777276505.055392}
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 230f266a-3351-5be1-9a4b-3abb161dce6a with identifier: EC05346
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 230f266a-3351-5be1-9a4b-3abb161dce6a with identifier: EC05346
2026-04-27 07:55:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 230f266a-3351-5be1-9a4b-3abb161dce6a with identifier: EC05346 to the API
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:42:44Z',
'fuel_type': 'diesel',
'id': '230f266a-3351-5be1-9a4b-3abb161dce6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC05346',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Sportage',
'odometer': 136728,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-04-03',
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Concept 2WD',
'transmission': 'manual',
'trim': 'Concept 2WD',
'year': 2018}
2026-04-27 07:55:05 [auto1.es] INFO: Saving data for EC05346: {'auction_closing_time': 1777390964.0, 'created_time': 1777019769.797002, 'has_photos': True, 'last_price_update_time': 1777276505.366373}
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_b3116c162d18ec9b61300067eb79de93.jpg not downloaded yet
2026-04-27 07:55:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3f890>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_b6da303705ba39f63d93ad408b2f8302.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048656d50>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_aad1cb76a97cdcaf4731686ec1c63166.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_62986ea1f568ac682ed0ae4872ac703f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_e809394780e4ed205eb202847512b16a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [auto1.es] INFO: Found listing with ID: AU55314
2026-04-27 07:55:05 [auto1.es] INFO: Scrape type for AU55314: 2
2026-04-27 07:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2944080e-0855-5a71-84cd-b508d5ac42e6 with identifier: AU55314
2026-04-27 07:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2944080e-0855-5a71-84cd-b508d5ac42e6 with scrape type 2
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2944080e-0855-5a71-84cd-b508d5ac42e6 with scrape type 2
2026-04-27 07:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2944080e-0855-5a71-84cd-b508d5ac42e6, identifier: AU55314
2026-04-27 07:55:05 [auto1.es] INFO: Found listing with ID: XA87642
2026-04-27 07:55:05 [auto1.es] INFO: Scrape type for XA87642: 1
2026-04-27 07:55:05 [auto1.es] INFO: Found listing with ID: ZT41669
2026-04-27 07:55:05 [auto1.es] INFO: Scrape type for ZT41669: 2
2026-04-27 07:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 360a7a20-a7c2-5999-9c3f-ba117cc65389 with identifier: ZT41669
2026-04-27 07:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360a7a20-a7c2-5999-9c3f-ba117cc65389 with scrape type 2
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 360a7a20-a7c2-5999-9c3f-ba117cc65389 with scrape type 2
2026-04-27 07:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 360a7a20-a7c2-5999-9c3f-ba117cc65389, identifier: ZT41669
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_d39d22e8338b7019c2c80ed74f1129a9.jpg not downloaded yet
2026-04-27 07:55:05 [auto1.es] INFO: Found listing with ID: TF35206
2026-04-27 07:55:05 [auto1.es] INFO: Scrape type for TF35206: 2
2026-04-27 07:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd798952-efd6-59df-ae91-718e78dc209b with identifier: TF35206
2026-04-27 07:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd798952-efd6-59df-ae91-718e78dc209b with scrape type 2
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd798952-efd6-59df-ae91-718e78dc209b with scrape type 2
2026-04-27 07:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd798952-efd6-59df-ae91-718e78dc209b, identifier: TF35206
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU60658> (referer: https://www.auto1.com/v1/car-details-view/GU60658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW07664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485e5510>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_21b33bee89e418ff7d92c7cc377252ec.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_6b65727803db96cfe3a5bcabba24b8ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2944080e-0855-5a71-84cd-b508d5ac42e6 with identifier: AU55314
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2944080e-0855-5a71-84cd-b508d5ac42e6 with identifier: AU55314
2026-04-27 07:55:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2944080e-0855-5a71-84cd-b508d5ac42e6 with identifier: AU55314 to the API
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:18:40Z',
'fuel_type': 'diesel',
'id': '2944080e-0855-5a71-84cd-b508d5ac42e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU55314',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 121320,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-06-26',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 d lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2017}
2026-04-27 07:55:06 [auto1.es] INFO: Saving data for AU55314: {'auction_closing_time': 1777389520.0, 'created_time': 1777019570.577571, 'has_photos': True, 'last_price_update_time': 1777276506.323195}
2026-04-27 07:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 360a7a20-a7c2-5999-9c3f-ba117cc65389 with identifier: ZT41669
2026-04-27 07:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 360a7a20-a7c2-5999-9c3f-ba117cc65389 with identifier: ZT41669
2026-04-27 07:55:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 360a7a20-a7c2-5999-9c3f-ba117cc65389 with identifier: ZT41669 to the API
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:38:32Z',
'fuel_type': 'diesel',
'id': '360a7a20-a7c2-5999-9c3f-ba117cc65389',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT41669',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Altea',
'odometer': 240548,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-06-14',
'seller_name': None,
'title': 'Seat Altea 2.0 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2006}
2026-04-27 07:55:06 [auto1.es] INFO: Saving data for ZT41669: {'auction_closing_time': 1777390712.0, 'created_time': 1777019821.977062, 'has_photos': True, 'last_price_update_time': 1777276506.650722}
2026-04-27 07:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd798952-efd6-59df-ae91-718e78dc209b with identifier: TF35206
2026-04-27 07:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd798952-efd6-59df-ae91-718e78dc209b with identifier: TF35206
2026-04-27 07:55:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd798952-efd6-59df-ae91-718e78dc209b with identifier: TF35206 to the API
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:05:17Z',
'fuel_type': 'diesel',
'id': 'dd798952-efd6-59df-ae91-718e78dc209b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF35206',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'S-Max',
'odometer': 208228,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-04-09',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-04-27 07:55:07 [auto1.es] INFO: Saving data for TF35206: {'auction_closing_time': 1777388717.0, 'created_time': 1777019806.397747, 'has_photos': True, 'last_price_update_time': 1777276507.401592}
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_27e9a70033de94ab5ab75eead326c708.jpg not downloaded yet
2026-04-27 07:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cac50>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_6bc9179ab8dbbd36b26d9b0e046d3709.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880e6d0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_e71ab83b8a50d5a4df6890aa1448712f.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_78c6c849d66f3763a37290aba5d57417.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_439156a8f1086afccb51cff6b04989e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [auto1.es] INFO: Found listing with ID: MC88071
2026-04-27 07:55:07 [auto1.es] INFO: Scrape type for MC88071: 2
2026-04-27 07:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7861579-1d38-5ec2-b5e2-49e6d6e731f2 with identifier: MC88071
2026-04-27 07:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7861579-1d38-5ec2-b5e2-49e6d6e731f2 with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7861579-1d38-5ec2-b5e2-49e6d6e731f2 with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7861579-1d38-5ec2-b5e2-49e6d6e731f2, identifier: MC88071
2026-04-27 07:55:07 [auto1.es] INFO: Found listing with ID: WH54771
2026-04-27 07:55:07 [auto1.es] INFO: Scrape type for WH54771: 2
2026-04-27 07:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771
2026-04-27 07:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313d282b-72b1-5113-b1fe-660e070c7f1a with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313d282b-72b1-5113-b1fe-660e070c7f1a with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 313d282b-72b1-5113-b1fe-660e070c7f1a, identifier: WH54771
2026-04-27 07:55:07 [auto1.es] INFO: Found listing with ID: GB16607
2026-04-27 07:55:07 [auto1.es] INFO: Scrape type for GB16607: 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_d2d66b90c783ec35de0cf07f6199c93a.jpg not downloaded yet
2026-04-27 07:55:07 [auto1.es] INFO: Found listing with ID: AZ04928
2026-04-27 07:55:07 [auto1.es] INFO: Scrape type for AZ04928: 2
2026-04-27 07:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-04-27 07:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with scrape type 2
2026-04-27 07:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00, identifier: AZ04928
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB92438> (referer: https://www.auto1.com/v1/car-details-view/TB92438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488376d0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b328ad-ede4-54c3-9954-36ba63cff223/56b328ad-ede4-54c3-9954-36ba63cff223_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/20/b5209a8a8204e2a9834d537c129d97a7/pa/ZP60568_299ea7e6bd3fee53c5dadaeb9cfdfbed.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56b328ad-ede4-54c3-9954-36ba63cff223
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7861579-1d38-5ec2-b5e2-49e6d6e731f2 with identifier: MC88071
2026-04-27 07:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7861579-1d38-5ec2-b5e2-49e6d6e731f2 with identifier: MC88071
2026-04-27 07:55:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7861579-1d38-5ec2-b5e2-49e6d6e731f2 with identifier: MC88071 to the API
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:13:48Z',
'fuel_type': 'diesel',
'id': 'a7861579-1d38-5ec2-b5e2-49e6d6e731f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC88071',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 177094,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-09-17',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2018}
2026-04-27 07:55:08 [auto1.es] INFO: Saving data for MC88071: {'auction_closing_time': 1777389228.0, 'created_time': 1777019730.335201, 'has_photos': True, 'last_price_update_time': 1777276508.315561}
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771
2026-04-27 07:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771
2026-04-27 07:55:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771 to the API
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-04-28T15:55:07Z',
'fuel_type': 'diesel',
'id': '313d282b-72b1-5113-b1fe-660e070c7f1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH54771',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Espace',
'odometer': 153770,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-06-11',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2017}
2026-04-27 07:55:08 [auto1.es] INFO: Saving data for WH54771: {'auction_closing_time': 1777391707.0, 'created_time': 1777019470.282586, 'has_photos': True, 'last_price_update_time': 1777276508.685455}
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-04-27 07:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-04-27 07:55:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928 to the API
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-04-28T15:43:10Z',
'fuel_type': 'hybrid',
'id': '14379ca0-cb74-5f2d-9aca-09ef90b2bc00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ04928',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 46061,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-01-23',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
'transmission': 'automatic',
'trim': '4 300 GT',
'year': 2020}
2026-04-27 07:55:09 [auto1.es] INFO: Saving data for AZ04928: {'auction_closing_time': 1777390990.0, 'created_time': 1777018941.652979, 'has_photos': True, 'last_price_update_time': 1777276509.0582}
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_e21a8e2d4e40e3c5bfc1ffd4bc0a2fb4.jpg not downloaded yet
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843f310>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_62986ea1f568ac682ed0ae4872ac703f.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b8a50>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_e809394780e4ed205eb202847512b16a.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_038023c25171fad4655cc18812078edf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_071b65bc37c8e520b6f42846a8431b76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_ec5ac1ee7d32692339bcb34b85266993.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [auto1.es] INFO: Found listing with ID: LU18012
2026-04-27 07:55:09 [auto1.es] INFO: Scrape type for LU18012: 2
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9fa1864-7c32-5074-bdde-cc8299c7a15d with identifier: LU18012
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9fa1864-7c32-5074-bdde-cc8299c7a15d with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9fa1864-7c32-5074-bdde-cc8299c7a15d with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9fa1864-7c32-5074-bdde-cc8299c7a15d, identifier: LU18012
2026-04-27 07:55:09 [auto1.es] INFO: Found listing with ID: KW77859
2026-04-27 07:55:09 [auto1.es] INFO: Scrape type for KW77859: 2
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a with identifier: KW77859
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a, identifier: KW77859
2026-04-27 07:55:09 [auto1.es] INFO: Found listing with ID: RS66594
2026-04-27 07:55:09 [auto1.es] INFO: Scrape type for RS66594: 2
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d822aa4-473f-5d70-b1c5-69b644bf2d4d with identifier: RS66594
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d822aa4-473f-5d70-b1c5-69b644bf2d4d with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d822aa4-473f-5d70-b1c5-69b644bf2d4d with scrape type 2
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d822aa4-473f-5d70-b1c5-69b644bf2d4d, identifier: RS66594
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_2208adfbca895e1b95baf62194c8e469.jpg not downloaded yet
2026-04-27 07:55:09 [auto1.es] INFO: Found listing with ID: SN89364
2026-04-27 07:55:09 [auto1.es] INFO: Scrape type for SN89364: 1
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY15551> (referer: https://www.auto1.com/v1/car-details-view/HY15551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT63016> (referer: https://www.auto1.com/v1/car-details-view/XT63016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e01b17-54fb-5cef-ae7e-6e9b459cf532 with identifier: GU60658
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e01b17-54fb-5cef-ae7e-6e9b459cf532 with scrape type 1
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70e01b17-54fb-5cef-ae7e-6e9b459cf532
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_0434aafd784b500b9eb0c19d36d7e6b9.jpg not downloaded yet
2026-04-27 07:55:09 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2013 | hits on page: 40
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884f190>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_6b65727803db96cfe3a5bcabba24b8ed.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9fa1864-7c32-5074-bdde-cc8299c7a15d with identifier: LU18012
2026-04-27 07:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9fa1864-7c32-5074-bdde-cc8299c7a15d with identifier: LU18012
2026-04-27 07:55:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9fa1864-7c32-5074-bdde-cc8299c7a15d with identifier: LU18012 to the API
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:52:35Z',
'fuel_type': 'diesel',
'id': 'f9fa1864-7c32-5074-bdde-cc8299c7a15d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU18012',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 209092,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-08-30',
'seller_name': None,
'title': 'Jeep Cherokee 2.0 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2017}
2026-04-27 07:55:09 [auto1.es] INFO: Saving data for LU18012: {'auction_closing_time': 1777391555.0, 'created_time': 1777018971.592314, 'has_photos': True, 'last_price_update_time': 1777276509.985517}
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a with identifier: KW77859
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a with identifier: KW77859
2026-04-27 07:55:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a with identifier: KW77859 to the API
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 212,
'expiration_date': '2026-04-28T15:44:08Z',
'fuel_type': 'diesel',
'id': 'be01d2c8-5d7e-5ed2-b89b-c960f45f7d6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW77859',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Ranger',
'odometer': 247517,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-06-10',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Wildtrak',
'year': 2021}
2026-04-27 07:55:10 [auto1.es] INFO: Saving data for KW77859: {'auction_closing_time': 1777391048.0, 'created_time': 1776941066.636028, 'has_photos': True, 'last_price_update_time': 1777276510.766832}
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d822aa4-473f-5d70-b1c5-69b644bf2d4d with identifier: RS66594
2026-04-27 07:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d822aa4-473f-5d70-b1c5-69b644bf2d4d with identifier: RS66594
2026-04-27 07:55:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d822aa4-473f-5d70-b1c5-69b644bf2d4d with identifier: RS66594 to the API
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:53:02Z',
'fuel_type': 'diesel',
'id': '6d822aa4-473f-5d70-b1c5-69b644bf2d4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS66594',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Captur',
'odometer': 105509,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-11-20',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Adventure',
'transmission': 'manual',
'trim': 'Adventure',
'year': 2013}
2026-04-27 07:55:11 [auto1.es] INFO: Saving data for RS66594: {'auction_closing_time': 1777391582.0, 'created_time': 1777020434.489536, 'has_photos': True, 'last_price_update_time': 1777276511.086097}
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_6d9ecfcf2663310f340fe07f6ee40686.jpg not downloaded yet
2026-04-27 07:55:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bf050>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_78c6c849d66f3763a37290aba5d57417.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823b3d0>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_439156a8f1086afccb51cff6b04989e4.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_d39d22e8338b7019c2c80ed74f1129a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_b3116c162d18ec9b61300067eb79de93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_85c81d73221235b540d562322a2ceb37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_e4dcdbcbc1ca9fb6dbb9a6651813a6ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [auto1.es] INFO: Found listing with ID: BE52922
2026-04-27 07:55:11 [auto1.es] INFO: Scrape type for BE52922: 2
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71d959ab-092f-5345-aef1-78b6c9646256 with identifier: BE52922
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d959ab-092f-5345-aef1-78b6c9646256 with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71d959ab-092f-5345-aef1-78b6c9646256 with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71d959ab-092f-5345-aef1-78b6c9646256, identifier: BE52922
2026-04-27 07:55:11 [auto1.es] INFO: Found listing with ID: CX56846
2026-04-27 07:55:11 [auto1.es] INFO: Scrape type for CX56846: 2
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573163cb-cda8-5bd0-94a5-311c6d266ff1 with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 573163cb-cda8-5bd0-94a5-311c6d266ff1 with scrape type 2
2026-04-27 07:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 573163cb-cda8-5bd0-94a5-311c6d266ff1, identifier: CX56846
2026-04-27 07:55:11 [auto1.es] INFO: Found listing with ID: ZT64030
2026-04-27 07:55:11 [auto1.es] INFO: Scrape type for ZT64030: 1
2026-04-27 07:55:11 [auto1.es] INFO: Found listing with ID: ZU19234
2026-04-27 07:55:11 [auto1.es] INFO: Scrape type for ZU19234: 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_e31ce6fdddeffbb23afee9f19e4d5642.jpg not downloaded yet
2026-04-27 07:55:11 [auto1.es] INFO: Found listing with ID: WV76791
2026-04-27 07:55:11 [auto1.es] INFO: Scrape type for WV76791: 1
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7 with identifier: TB92438
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7 with scrape type 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_13775cdfef8d7ddc39aea95bc1295c60.jpg not downloaded yet
2026-04-27 07:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71d959ab-092f-5345-aef1-78b6c9646256 with identifier: BE52922
2026-04-27 07:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71d959ab-092f-5345-aef1-78b6c9646256 with identifier: BE52922
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71d959ab-092f-5345-aef1-78b6c9646256 with identifier: BE52922 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-04-28T15:21:09Z',
'fuel_type': 'petrol',
'id': '71d959ab-092f-5345-aef1-78b6c9646256',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE52922',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jeep',
'model': 'Compass',
'odometer': 90880,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-01-11',
'seller_name': None,
'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Night Eagle FWD',
'transmission': 'automatic',
'trim': 'Night Eagle FWD',
'year': 2023}
2026-04-27 07:55:11 [auto1.es] INFO: Saving data for BE52922: {'auction_closing_time': 1777389669.0, 'created_time': 1777019146.385799, 'has_photos': True, 'last_price_update_time': 1777276511.871669}
2026-04-27 07:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846
2026-04-27 07:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 573163cb-cda8-5bd0-94a5-311c6d266ff1 with identifier: CX56846 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-04-28T15:48:17Z',
'fuel_type': 'diesel',
'id': '573163cb-cda8-5bd0-94a5-311c6d266ff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX56846',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 228242,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-06-13',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Confort XL',
'transmission': 'manual',
'trim': 'Confort XL',
'year': 2018}
2026-04-27 07:55:12 [auto1.es] INFO: Saving data for CX56846: {'auction_closing_time': 1777391297.0, 'created_time': 1777020397.924745, 'has_photos': True, 'last_price_update_time': 1777276512.293503}
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_240419caa2c5cf5f8a6781fd56201b8d.jpg not downloaded yet
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488b8410>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_038023c25171fad4655cc18812078edf.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484bb290>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef7b1d7-5c75-5261-846f-af3924f3b3c8/3ef7b1d7-5c75-5261-846f-af3924f3b3c8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ed/22ed011f6e7b8bb53a5adc0a6e7c16a2/pa/SX68849_071b65bc37c8e520b6f42846a8431b76.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ef7b1d7-5c75-5261-846f-af3924f3b3c8
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823b050>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_ec5ac1ee7d32692339bcb34b85266993.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_27e9a70033de94ab5ab75eead326c708.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [auto1.es] INFO: Found listing with ID: HC34911
2026-04-27 07:55:12 [auto1.es] INFO: Scrape type for HC34911: 2
2026-04-27 07:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c229f300-277d-5387-b085-4ef442c92927 with identifier: HC34911
2026-04-27 07:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c229f300-277d-5387-b085-4ef442c92927 with scrape type 2
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c229f300-277d-5387-b085-4ef442c92927 with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c229f300-277d-5387-b085-4ef442c92927, identifier: HC34911
2026-04-27 07:55:13 [auto1.es] INFO: Found listing with ID: BW10675
2026-04-27 07:55:13 [auto1.es] INFO: Scrape type for BW10675: 1
2026-04-27 07:55:13 [auto1.es] INFO: Found listing with ID: YX68233
2026-04-27 07:55:13 [auto1.es] INFO: Scrape type for YX68233: 2
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with scrape type 2
2026-04-27 07:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9, identifier: YX68233
2026-04-27 07:55:13 [auto1.es] INFO: Found listing with ID: ZN14981
2026-04-27 07:55:13 [auto1.es] INFO: Scrape type for ZN14981: 1
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_84f5ff2e966833445d61ec647dddd818.jpg not downloaded yet
2026-04-27 07:55:13 [auto1.es] INFO: Found listing with ID: NN13578
2026-04-27 07:55:13 [auto1.es] INFO: Scrape type for NN13578: 1
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_66ae601df75f33382821d824c6532ada.jpg not downloaded yet
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b485986f-fa0a-52de-a0d5-27d250c60795 with identifier: HY15551
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b485986f-fa0a-52de-a0d5-27d250c60795 with scrape type 1
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b485986f-fa0a-52de-a0d5-27d250c60795
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_b5a598f252e9fb1657156f271ff7bad0.jpg not downloaded yet
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88203590-28b7-5f00-bb71-520fb66c3e5a with identifier: XT63016
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88203590-28b7-5f00-bb71-520fb66c3e5a with scrape type 1
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 88203590-28b7-5f00-bb71-520fb66c3e5a
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_dc2a6785ef98fe50d8d5dab607461517.jpg not downloaded yet
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_975fe0da48d42e8c39c8ab254f5b3212.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_d2d66b90c783ec35de0cf07f6199c93a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c229f300-277d-5387-b085-4ef442c92927 with identifier: HC34911
2026-04-27 07:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c229f300-277d-5387-b085-4ef442c92927 with identifier: HC34911
2026-04-27 07:55:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c229f300-277d-5387-b085-4ef442c92927 with identifier: HC34911 to the API
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:01:20Z',
'fuel_type': 'diesel',
'id': 'c229f300-277d-5387-b085-4ef442c92927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC34911',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'i30',
'odometer': 195483,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-02-03',
'seller_name': None,
'title': 'Hyundai i30 1.4 CRDi Klass',
'transmission': 'manual',
'trim': 'Klass',
'year': 2015}
2026-04-27 07:55:13 [auto1.es] INFO: Saving data for HC34911: {'auction_closing_time': 1777388480.0, 'created_time': 1777019001.676923, 'has_photos': True, 'last_price_update_time': 1777276513.846561}
2026-04-27 07:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233
2026-04-27 07:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233
2026-04-27 07:55:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9 with identifier: YX68233 to the API
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:53:41Z',
'fuel_type': 'diesel',
'id': '01bca85a-1f92-56b6-b9ac-e9f3d8b9e4c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX68233',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 222592,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-02-24',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2009}
2026-04-27 07:55:14 [auto1.es] INFO: Saving data for YX68233: {'auction_closing_time': 1777391621.0, 'created_time': 1777019539.429186, 'has_photos': True, 'last_price_update_time': 1777276514.211302}
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_a704905486ac5528311aa686799baf8b.jpg not downloaded yet
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a44e90>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_d39d22e8338b7019c2c80ed74f1129a9.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488431d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_b3116c162d18ec9b61300067eb79de93.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481b56d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_85c81d73221235b540d562322a2ceb37.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838f890>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_704b1135-81f8-540e-8508-a9076c2e5adf/704b1135-81f8-540e-8508-a9076c2e5adf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/fa/62fa4ac3ec23b9482df96241f1fa66a1/pa/ZG12756_e4dcdbcbc1ca9fb6dbb9a6651813a6ac.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 704b1135-81f8-540e-8508-a9076c2e5adf
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_e21a8e2d4e40e3c5bfc1ffd4bc0a2fb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [auto1.es] INFO: Found listing with ID: SL14722
2026-04-27 07:55:14 [auto1.es] INFO: Scrape type for SL14722: 1
2026-04-27 07:55:14 [auto1.es] INFO: Found listing with ID: XH53032
2026-04-27 07:55:14 [auto1.es] INFO: Scrape type for XH53032: 2
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e25f07f-fc3e-518c-9dd1-face0404faef with identifier: XH53032
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e25f07f-fc3e-518c-9dd1-face0404faef with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e25f07f-fc3e-518c-9dd1-face0404faef with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3e25f07f-fc3e-518c-9dd1-face0404faef, identifier: XH53032
2026-04-27 07:55:14 [auto1.es] INFO: Found listing with ID: DU40385
2026-04-27 07:55:14 [auto1.es] INFO: Scrape type for DU40385: 2
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f65197-8cee-5824-a23f-0444bc8df1e0 with identifier: DU40385
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f65197-8cee-5824-a23f-0444bc8df1e0 with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8f65197-8cee-5824-a23f-0444bc8df1e0 with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8f65197-8cee-5824-a23f-0444bc8df1e0, identifier: DU40385
2026-04-27 07:55:14 [auto1.es] INFO: Found listing with ID: NC39762
2026-04-27 07:55:14 [auto1.es] INFO: Scrape type for NC39762: 2
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c03c55b1-dd74-562b-aabf-1d6e9c045f8c with identifier: NC39762
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c03c55b1-dd74-562b-aabf-1d6e9c045f8c with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c03c55b1-dd74-562b-aabf-1d6e9c045f8c with scrape type 2
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c03c55b1-dd74-562b-aabf-1d6e9c045f8c, identifier: NC39762
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_80e5ed83c843edacc879616368c41d81.jpg not downloaded yet
2026-04-27 07:55:14 [auto1.es] INFO: Found listing with ID: CA43015
2026-04-27 07:55:14 [auto1.es] INFO: Scrape type for CA43015: 1
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_6c83e43fe5cfd6f1aa05a54f5eb7e354.jpg not downloaded yet
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_e679d8fa052eeb44edd9724601995df8.jpg not downloaded yet
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_67019410b9972cef04d3775ab17c383e.jpg not downloaded yet
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB33691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_0434aafd784b500b9eb0c19d36d7e6b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3e25f07f-fc3e-518c-9dd1-face0404faef with identifier: XH53032
2026-04-27 07:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3e25f07f-fc3e-518c-9dd1-face0404faef with identifier: XH53032
2026-04-27 07:55:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3e25f07f-fc3e-518c-9dd1-face0404faef with identifier: XH53032 to the API
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-04-28T15:43:38Z',
'fuel_type': 'diesel',
'id': '3e25f07f-fc3e-518c-9dd1-face0404faef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH53032',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 249463,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-04-28',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2021}
2026-04-27 07:55:15 [auto1.es] INFO: Saving data for XH53032: {'auction_closing_time': 1777391018.0, 'created_time': 1777019693.521163, 'has_photos': True, 'last_price_update_time': 1777276515.167536}
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8f65197-8cee-5824-a23f-0444bc8df1e0 with identifier: DU40385
2026-04-27 07:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8f65197-8cee-5824-a23f-0444bc8df1e0 with identifier: DU40385
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8f65197-8cee-5824-a23f-0444bc8df1e0 with identifier: DU40385 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-04-28T15:48:58Z',
'fuel_type': 'diesel',
'id': 'c8f65197-8cee-5824-a23f-0444bc8df1e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU40385',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 165272,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-08-04',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Alltrack 4Motion',
'transmission': 'automatic',
'trim': 'Alltrack 4Motion',
'year': 2022}
2026-04-27 07:55:15 [auto1.es] INFO: Saving data for DU40385: {'auction_closing_time': 1777391338.0, 'created_time': 1777021828.586261, 'has_photos': True, 'last_price_update_time': 1777276515.606837}
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c03c55b1-dd74-562b-aabf-1d6e9c045f8c with identifier: NC39762
2026-04-27 07:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c03c55b1-dd74-562b-aabf-1d6e9c045f8c with identifier: NC39762
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c03c55b1-dd74-562b-aabf-1d6e9c045f8c with identifier: NC39762 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 313,
'expiration_date': '2026-04-28T15:39:36Z',
'fuel_type': 'diesel',
'id': 'c03c55b1-dd74-562b-aabf-1d6e9c045f8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC39762',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '6er',
'odometer': 159597,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-08-14',
'seller_name': None,
'title': 'BMW 6er 640d Gran Coupé',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 07:55:15 [auto1.es] INFO: Saving data for NC39762: {'auction_closing_time': 1777390776.0, 'created_time': 1777019524.915291, 'has_photos': True, 'last_price_update_time': 1777276515.965344}
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_6d5028aa60dd79a0b76d0fdb4dc3143d.jpg not downloaded yet
2026-04-27 07:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048972f50>
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_27e9a70033de94ab5ab75eead326c708.jpg saved to cache
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:16 [auto1.es] INFO: Found listing with ID: YX02593
2026-04-27 07:55:16 [auto1.es] INFO: Scrape type for YX02593: 0
2026-04-27 07:55:16 [auto1.es] INFO: Found listing with ID: RY99240
2026-04-27 07:55:16 [auto1.es] INFO: Scrape type for RY99240: 2
2026-04-27 07:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c2f3536-5143-55b9-8484-d222a79bc4dc with identifier: RY99240
2026-04-27 07:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c2f3536-5143-55b9-8484-d222a79bc4dc with scrape type 2
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c2f3536-5143-55b9-8484-d222a79bc4dc with scrape type 2
2026-04-27 07:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c2f3536-5143-55b9-8484-d222a79bc4dc, identifier: RY99240
2026-04-27 07:55:16 [auto1.es] INFO: Found listing with ID: MR11800
2026-04-27 07:55:16 [auto1.es] INFO: Scrape type for MR11800: 1
2026-04-27 07:55:16 [auto1.es] INFO: Found listing with ID: TC23983
2026-04-27 07:55:16 [auto1.es] INFO: Scrape type for TC23983: 1
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_bfde8976960d29d4c1ee95c7990877fb.jpg not downloaded yet
2026-04-27 07:55:16 [auto1.es] INFO: Found listing with ID: XW45273
2026-04-27 07:55:16 [auto1.es] INFO: Scrape type for XW45273: 1
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_ea5d0a8d072ebfa71014b49a7f1865f4.jpg not downloaded yet
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_54a160e432a7680cefc1d74ca3b62cd1.jpg not downloaded yet
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_2991de8a883ba486a27243d13e09dac7.jpg not downloaded yet
2026-04-27 07:55:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048229890>
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1313b06c-5db1-5717-9464-877905d8b069/1313b06c-5db1-5717-9464-877905d8b069_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a2/05a2b440acc59d462b6069eb36ade719/pa/XC28833_975fe0da48d42e8c39c8ab254f5b3212.jpg saved to cache
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1313b06c-5db1-5717-9464-877905d8b069
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487afc90>
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58daa033-94ff-5d12-b99b-d3638ad3ae90/58daa033-94ff-5d12-b99b-d3638ad3ae90_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/10/ec101793c7bafdc1ec7dec4263432f97/pa/SR81888_d2d66b90c783ec35de0cf07f6199c93a.jpg saved to cache
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58daa033-94ff-5d12-b99b-d3638ad3ae90
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_13775cdfef8d7ddc39aea95bc1295c60.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c2f3536-5143-55b9-8484-d222a79bc4dc with identifier: RY99240
2026-04-27 07:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c2f3536-5143-55b9-8484-d222a79bc4dc with identifier: RY99240
2026-04-27 07:55:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c2f3536-5143-55b9-8484-d222a79bc4dc with identifier: RY99240 to the API
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:57:43Z',
'fuel_type': 'diesel',
'id': '9c2f3536-5143-55b9-8484-d222a79bc4dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY99240',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Laguna',
'odometer': 131055,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-07-30',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Confort Dynamique',
'transmission': 'manual',
'trim': 'Confort Dynamique',
'year': 2006}
2026-04-27 07:55:17 [auto1.es] INFO: Saving data for RY99240: {'auction_closing_time': 1777391863.0, 'created_time': 1777018603.345705, 'has_photos': True, 'last_price_update_time': 1777276517.025404}
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_240419caa2c5cf5f8a6781fd56201b8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:17 [auto1.es] INFO: Found listing with ID: ER43390
2026-04-27 07:55:17 [auto1.es] INFO: Scrape type for ER43390: 2
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11 with identifier: ER43390
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11 with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11 with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11, identifier: ER43390
2026-04-27 07:55:17 [auto1.es] INFO: Found listing with ID: AG21540
2026-04-27 07:55:17 [auto1.es] INFO: Scrape type for AG21540: 2
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f with identifier: AG21540
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f, identifier: AG21540
2026-04-27 07:55:17 [auto1.es] INFO: Found listing with ID: UV89988
2026-04-27 07:55:17 [auto1.es] INFO: Scrape type for UV89988: 2
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fb1fdf-be55-5f76-8f24-149aba69025f with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fb1fdf-be55-5f76-8f24-149aba69025f with scrape type 2
2026-04-27 07:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2fb1fdf-be55-5f76-8f24-149aba69025f, identifier: UV89988
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_29cc97cb4d976678abab1a86d542f6e9.jpg not downloaded yet
2026-04-27 07:55:17 [auto1.es] INFO: Found listing with ID: KE93313
2026-04-27 07:55:17 [auto1.es] INFO: Scrape type for KE93313: 1
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_7cefe21a2a77b2ccd4adea553d54bd51.jpg not downloaded yet
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_f197e63f328dc1af9b8448e8dadd9666.jpg not downloaded yet
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_f194fe146897142314e2464f3ae071dd.jpg not downloaded yet
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA87642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048331410>
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_e21a8e2d4e40e3c5bfc1ffd4bc0a2fb4.jpg saved to cache
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057224a10>
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e01b17-54fb-5cef-ae7e-6e9b459cf532/70e01b17-54fb-5cef-ae7e-6e9b459cf532_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_0434aafd784b500b9eb0c19d36d7e6b9.jpg saved to cache
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70e01b17-54fb-5cef-ae7e-6e9b459cf532
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_dc2a6785ef98fe50d8d5dab607461517.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11 with identifier: ER43390
2026-04-27 07:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11 with identifier: ER43390
2026-04-27 07:55:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26a1ebe0-05b9-5a7a-afea-9083dc8d4b11 with identifier: ER43390 to the API
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:33:03Z',
'fuel_type': 'diesel',
'id': '26a1ebe0-05b9-5a7a-afea-9083dc8d4b11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER43390',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 198407,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-10-17',
'seller_name': None,
'title': 'Jaguar F-Pace E-Performance Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2018}
2026-04-27 07:55:18 [auto1.es] INFO: Saving data for ER43390: {'auction_closing_time': 1777390383.0, 'created_time': 1777021309.974672, 'has_photos': True, 'last_price_update_time': 1777276518.50009}
2026-04-27 07:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f with identifier: AG21540
2026-04-27 07:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f with identifier: AG21540
2026-04-27 07:55:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f with identifier: AG21540 to the API
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-04-28T15:26:40Z',
'fuel_type': 'diesel',
'id': 'c27a8e7f-c2cf-59c9-b8e2-fc69ce3e568f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG21540',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 66214,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-05-25',
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2021}
2026-04-27 07:55:19 [auto1.es] INFO: Saving data for AG21540: {'auction_closing_time': 1777390000.0, 'created_time': 1777020517.288024, 'has_photos': True, 'last_price_update_time': 1777276519.384193}
2026-04-27 07:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988
2026-04-27 07:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988
2026-04-27 07:55:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988 to the API
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:41:39Z',
'fuel_type': 'diesel',
'id': 'a2fb1fdf-be55-5f76-8f24-149aba69025f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV89988',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 406065,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-11-21',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-04-27 07:55:19 [auto1.es] INFO: Saving data for UV89988: {'auction_closing_time': 1777390899.0, 'created_time': 1777021413.529297, 'has_photos': True, 'last_price_update_time': 1777276519.71937}
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_b5a598f252e9fb1657156f271ff7bad0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_a704905486ac5528311aa686799baf8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [auto1.es] INFO: Found listing with ID: SL72652
2026-04-27 07:55:19 [auto1.es] INFO: Scrape type for SL72652: 2
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3875ab53-a4ed-5b6a-91c5-3147c8e669a8 with identifier: SL72652
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3875ab53-a4ed-5b6a-91c5-3147c8e669a8 with scrape type 2
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3875ab53-a4ed-5b6a-91c5-3147c8e669a8 with scrape type 2
2026-04-27 07:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3875ab53-a4ed-5b6a-91c5-3147c8e669a8, identifier: SL72652
2026-04-27 07:55:19 [auto1.es] INFO: Found listing with ID: VP18575
2026-04-27 07:55:19 [auto1.es] INFO: Scrape type for VP18575: 2
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e52a6b0-dca0-5012-a65d-6ba35f04fb01 with identifier: VP18575
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e52a6b0-dca0-5012-a65d-6ba35f04fb01 with scrape type 2
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e52a6b0-dca0-5012-a65d-6ba35f04fb01 with scrape type 2
2026-04-27 07:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e52a6b0-dca0-5012-a65d-6ba35f04fb01, identifier: VP18575
2026-04-27 07:55:19 [auto1.es] INFO: Found listing with ID: EU66649
2026-04-27 07:55:19 [auto1.es] INFO: Scrape type for EU66649: 2
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f978f8-154b-5b1e-a716-3e34c37d2a03 with identifier: EU66649
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f978f8-154b-5b1e-a716-3e34c37d2a03 with scrape type 2
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f978f8-154b-5b1e-a716-3e34c37d2a03 with scrape type 2
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4f978f8-154b-5b1e-a716-3e34c37d2a03, identifier: EU66649
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_a1390142c648e1a7260024d8b35624bf.jpg not downloaded yet
2026-04-27 07:55:20 [auto1.es] INFO: Found listing with ID: VC68158
2026-04-27 07:55:20 [auto1.es] INFO: Scrape type for VC68158: 1
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_bf5ef0ba102c0d8e5cec5b85a6b3c340.jpg not downloaded yet
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_e303d9c685c1976709f6727ee65bb34a.jpg not downloaded yet
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_5917fe70908371ef7fe0cab4f87f8079.jpg not downloaded yet
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR89718/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT40413> (referer: https://www.auto1.com/v1/car-details-view/WT40413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB16607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL65807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487357d0>
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ea66a0-f792-5e8a-9f4c-9eac34dfddc7/68ea66a0-f792-5e8a-9f4c-9eac34dfddc7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_13775cdfef8d7ddc39aea95bc1295c60.jpg saved to cache
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3875ab53-a4ed-5b6a-91c5-3147c8e669a8 with identifier: SL72652
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3875ab53-a4ed-5b6a-91c5-3147c8e669a8 with identifier: SL72652
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3875ab53-a4ed-5b6a-91c5-3147c8e669a8 with identifier: SL72652 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:04:03Z',
'fuel_type': 'diesel',
'id': '3875ab53-a4ed-5b6a-91c5-3147c8e669a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL72652',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 109906,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-15',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Inscription 2WD',
'transmission': 'automatic',
'trim': 'Inscription 2WD',
'year': 2019}
2026-04-27 07:55:20 [auto1.es] INFO: Saving data for SL72652: {'auction_closing_time': 1777388643.0, 'created_time': 1777018597.751483, 'has_photos': True, 'last_price_update_time': 1777276520.521951}
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e52a6b0-dca0-5012-a65d-6ba35f04fb01 with identifier: VP18575
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e52a6b0-dca0-5012-a65d-6ba35f04fb01 with identifier: VP18575
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5e52a6b0-dca0-5012-a65d-6ba35f04fb01 with identifier: VP18575 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:31:16Z',
'fuel_type': 'diesel',
'id': '5e52a6b0-dca0-5012-a65d-6ba35f04fb01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP18575',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 421450,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-04-25',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Last Edition',
'transmission': 'manual',
'trim': 'Last Edition',
'year': 2006}
2026-04-27 07:55:20 [auto1.es] INFO: Saving data for VP18575: {'auction_closing_time': 1777390276.0, 'created_time': 1777020341.575454, 'has_photos': True, 'last_price_update_time': 1777276520.975817}
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4f978f8-154b-5b1e-a716-3e34c37d2a03 with identifier: EU66649
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4f978f8-154b-5b1e-a716-3e34c37d2a03 with identifier: EU66649
2026-04-27 07:55:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4f978f8-154b-5b1e-a716-3e34c37d2a03 with identifier: EU66649 to the API
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:55:45Z',
'fuel_type': 'petrol',
'id': 'a4f978f8-154b-5b1e-a716-3e34c37d2a03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU66649',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 85781,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-12-03',
'seller_name': None,
'title': 'Renault Megane 1.6 Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2008}
2026-04-27 07:55:21 [auto1.es] INFO: Saving data for EU66649: {'auction_closing_time': 1777391745.0, 'created_time': 1777020289.718098, 'has_photos': True, 'last_price_update_time': 1777276521.292529}
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a3b50>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_240419caa2c5cf5f8a6781fd56201b8d.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:21 [auto1.es] INFO: Found listing with ID: NP76599
2026-04-27 07:55:21 [auto1.es] INFO: Scrape type for NP76599: 2
2026-04-27 07:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03 with identifier: NP76599
2026-04-27 07:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03 with scrape type 2
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03 with scrape type 2
2026-04-27 07:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03, identifier: NP76599
2026-04-27 07:55:21 [auto1.es] INFO: Found listing with ID: UJ26804
2026-04-27 07:55:21 [auto1.es] INFO: Scrape type for UJ26804: 1
2026-04-27 07:55:21 [auto1.es] INFO: Found listing with ID: YV92122
2026-04-27 07:55:21 [auto1.es] INFO: Scrape type for YV92122: 2
2026-04-27 07:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32e4036-9190-52cd-a852-6f1c47ab5baa with identifier: YV92122
2026-04-27 07:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32e4036-9190-52cd-a852-6f1c47ab5baa with scrape type 2
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32e4036-9190-52cd-a852-6f1c47ab5baa with scrape type 2
2026-04-27 07:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a32e4036-9190-52cd-a852-6f1c47ab5baa, identifier: YV92122
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_db41613fbd17d152b50d79d316f22308.jpg not downloaded yet
2026-04-27 07:55:21 [auto1.es] INFO: Found listing with ID: TM12117
2026-04-27 07:55:21 [auto1.es] INFO: Scrape type for TM12117: 1
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_a74cc4fa147a3af95332be7ed25be353.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_30062182a8a0ac5333718c53a5fbaf5e.jpg not downloaded yet
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB55085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU46355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048541590>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88203590-28b7-5f00-bb71-520fb66c3e5a/88203590-28b7-5f00-bb71-520fb66c3e5a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_dc2a6785ef98fe50d8d5dab607461517.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88203590-28b7-5f00-bb71-520fb66c3e5a
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_54a160e432a7680cefc1d74ca3b62cd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_2991de8a883ba486a27243d13e09dac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03 with identifier: NP76599
2026-04-27 07:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03 with identifier: NP76599
2026-04-27 07:55:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c2e0069-bc9f-5b4b-81a5-22e5d1067f03 with identifier: NP76599 to the API
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:47:12Z',
'fuel_type': 'petrol',
'id': '4c2e0069-bc9f-5b4b-81a5-22e5d1067f03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP76599',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Fabia',
'odometer': 199825,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-09-05',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2013}
2026-04-27 07:55:22 [auto1.es] INFO: Saving data for NP76599: {'auction_closing_time': 1777391232.0, 'created_time': 1777019151.328343, 'has_photos': True, 'last_price_update_time': 1777276522.063813}
2026-04-27 07:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a32e4036-9190-52cd-a852-6f1c47ab5baa with identifier: YV92122
2026-04-27 07:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a32e4036-9190-52cd-a852-6f1c47ab5baa with identifier: YV92122
2026-04-27 07:55:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a32e4036-9190-52cd-a852-6f1c47ab5baa with identifier: YV92122 to the API
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:12:43Z',
'fuel_type': 'diesel',
'id': 'a32e4036-9190-52cd-a852-6f1c47ab5baa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV92122',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 229575,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-08-09',
'seller_name': None,
'title': 'Renault Grand Scenic 2.0 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2007}
2026-04-27 07:55:22 [auto1.es] INFO: Saving data for YV92122: {'auction_closing_time': 1777389163.0, 'created_time': 1777020341.912189, 'has_photos': True, 'last_price_update_time': 1777276522.392803}
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048674ad0>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b485986f-fa0a-52de-a0d5-27d250c60795/b485986f-fa0a-52de-a0d5-27d250c60795_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_b5a598f252e9fb1657156f271ff7bad0.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b485986f-fa0a-52de-a0d5-27d250c60795
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c6e50>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd81c38-6402-51ad-96f1-7bf4a59afa30/bfd81c38-6402-51ad-96f1-7bf4a59afa30_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/38/08380d29138473c828ee94fb00508e54/pa/JD60065_a704905486ac5528311aa686799baf8b.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfd81c38-6402-51ad-96f1-7bf4a59afa30
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_ea5d0a8d072ebfa71014b49a7f1865f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:22 [auto1.es] INFO: Found listing with ID: AS98814
2026-04-27 07:55:22 [auto1.es] INFO: Scrape type for AS98814: 2
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed3975e-9e69-5b42-9272-a07a473478c0 with identifier: AS98814
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed3975e-9e69-5b42-9272-a07a473478c0 with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed3975e-9e69-5b42-9272-a07a473478c0 with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ed3975e-9e69-5b42-9272-a07a473478c0, identifier: AS98814
2026-04-27 07:55:22 [auto1.es] INFO: Found listing with ID: TX97178
2026-04-27 07:55:22 [auto1.es] INFO: Scrape type for TX97178: 2
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cac823-1d1d-5569-b6fa-9be8cf60378b with identifier: TX97178
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cac823-1d1d-5569-b6fa-9be8cf60378b with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8cac823-1d1d-5569-b6fa-9be8cf60378b with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8cac823-1d1d-5569-b6fa-9be8cf60378b, identifier: TX97178
2026-04-27 07:55:22 [auto1.es] INFO: Found listing with ID: ZA66561
2026-04-27 07:55:22 [auto1.es] INFO: Scrape type for ZA66561: 2
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b06d53-9003-5e8e-91a2-6ebb0709540a with identifier: ZA66561
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b06d53-9003-5e8e-91a2-6ebb0709540a with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b06d53-9003-5e8e-91a2-6ebb0709540a with scrape type 2
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62b06d53-9003-5e8e-91a2-6ebb0709540a, identifier: ZA66561
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_90dafa6f19bf98c220f809f2fd97f000.jpg not downloaded yet
2026-04-27 07:55:22 [auto1.es] INFO: Found listing with ID: RR08873
2026-04-27 07:55:22 [auto1.es] INFO: Scrape type for RR08873: 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_5e49da5fd7941ae87b9da5e2909f063f.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9771c750-1823-574f-b4e4-9396ca92a731 with identifier: WT40413
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9771c750-1823-574f-b4e4-9396ca92a731 with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9771c750-1823-574f-b4e4-9396ca92a731
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_82c527b8d0b4d98d3099087e1b92e968.jpg not downloaded yet
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_f194fe146897142314e2464f3ae071dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ed3975e-9e69-5b42-9272-a07a473478c0 with identifier: AS98814
2026-04-27 07:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ed3975e-9e69-5b42-9272-a07a473478c0 with identifier: AS98814
2026-04-27 07:55:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ed3975e-9e69-5b42-9272-a07a473478c0 with identifier: AS98814 to the API
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 209,
'expiration_date': '2026-04-28T15:11:35Z',
'fuel_type': 'diesel',
'id': '5ed3975e-9e69-5b42-9272-a07a473478c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS98814',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 130968,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-12-19',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
'transmission': 'automatic',
'trim': 'Veloce Q4',
'year': 2021}
2026-04-27 07:55:23 [auto1.es] INFO: Saving data for AS98814: {'auction_closing_time': 1777389095.0, 'created_time': 1777019908.3139, 'has_photos': True, 'last_price_update_time': 1777276523.273354}
2026-04-27 07:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8cac823-1d1d-5569-b6fa-9be8cf60378b with identifier: TX97178
2026-04-27 07:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8cac823-1d1d-5569-b6fa-9be8cf60378b with identifier: TX97178
2026-04-27 07:55:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8cac823-1d1d-5569-b6fa-9be8cf60378b with identifier: TX97178 to the API
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:13:50Z',
'fuel_type': 'diesel',
'id': 'c8cac823-1d1d-5569-b6fa-9be8cf60378b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX97178',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 209569,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-03-14',
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-04-27 07:55:23 [auto1.es] INFO: Saving data for TX97178: {'auction_closing_time': 1777389230.0, 'created_time': 1777019802.887251, 'has_photos': True, 'last_price_update_time': 1777276523.669455}
2026-04-27 07:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62b06d53-9003-5e8e-91a2-6ebb0709540a with identifier: ZA66561
2026-04-27 07:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62b06d53-9003-5e8e-91a2-6ebb0709540a with identifier: ZA66561
2026-04-27 07:55:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 62b06d53-9003-5e8e-91a2-6ebb0709540a with identifier: ZA66561 to the API
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-28T15:51:37Z',
'fuel_type': 'diesel',
'id': '62b06d53-9003-5e8e-91a2-6ebb0709540a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA66561',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC90',
'odometer': 195110,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-12-22',
'seller_name': None,
'title': 'Volvo XC90 2.4 D5 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2005}
2026-04-27 07:55:24 [auto1.es] INFO: Saving data for ZA66561: {'auction_closing_time': 1777391497.0, 'created_time': 1777018987.897089, 'has_photos': True, 'last_price_update_time': 1777276524.010357}
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_7cefe21a2a77b2ccd4adea553d54bd51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_f197e63f328dc1af9b8448e8dadd9666.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_29cc97cb4d976678abab1a86d542f6e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: WR69222
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for WR69222: 1
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: NF65765
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for NF65765: 1
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: EW77707
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for EW77707: 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_0176b90c21216f095339cc1556cd4aa1.jpg not downloaded yet
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: ES88319
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for ES88319: 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_fd4741783a29913ab902428fe67cc60a.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_12c37c11b7d5f5d131a1463d50b1d092.jpg not downloaded yet
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c5610>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b485986f-fa0a-52de-a0d5-27d250c60795/b485986f-fa0a-52de-a0d5-27d250c60795_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_54a160e432a7680cefc1d74ca3b62cd1.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b485986f-fa0a-52de-a0d5-27d250c60795
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822d9d0>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88203590-28b7-5f00-bb71-520fb66c3e5a/88203590-28b7-5f00-bb71-520fb66c3e5a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_2991de8a883ba486a27243d13e09dac7.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88203590-28b7-5f00-bb71-520fb66c3e5a
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_5917fe70908371ef7fe0cab4f87f8079.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891ab10>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ea66a0-f792-5e8a-9f4c-9eac34dfddc7/68ea66a0-f792-5e8a-9f4c-9eac34dfddc7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_ea5d0a8d072ebfa71014b49a7f1865f4.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_e303d9c685c1976709f6727ee65bb34a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_bf5ef0ba102c0d8e5cec5b85a6b3c340.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: SH77373
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for SH77373: 2
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2817b944-9047-5e86-80fb-dc6ba6d12e73 with identifier: SH77373
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2817b944-9047-5e86-80fb-dc6ba6d12e73 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2817b944-9047-5e86-80fb-dc6ba6d12e73 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2817b944-9047-5e86-80fb-dc6ba6d12e73, identifier: SH77373
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: UG14230
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for UG14230: 2
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623cfb79-11bc-5853-9b83-96c04d204c00 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 623cfb79-11bc-5853-9b83-96c04d204c00 with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 623cfb79-11bc-5853-9b83-96c04d204c00, identifier: UG14230
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: NS19372
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for NS19372: 2
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985041e8-4008-5dc9-ab4f-3ca3399d946c with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 985041e8-4008-5dc9-ab4f-3ca3399d946c with scrape type 2
2026-04-27 07:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 985041e8-4008-5dc9-ab4f-3ca3399d946c, identifier: NS19372
2026-04-27 07:55:24 [auto1.es] INFO: Found listing with ID: WK75378
2026-04-27 07:55:24 [auto1.es] INFO: Scrape type for WK75378: 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_00a223816f0adf68d43df18152fddec0.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_37a3db8f63424a7f78d163dd5d7c3617.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW07664> (referer: https://www.auto1.com/v1/car-details-view/XW07664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2817b944-9047-5e86-80fb-dc6ba6d12e73 with identifier: SH77373
2026-04-27 07:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2817b944-9047-5e86-80fb-dc6ba6d12e73 with identifier: SH77373
2026-04-27 07:55:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2817b944-9047-5e86-80fb-dc6ba6d12e73 with identifier: SH77373 to the API
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-04-28T15:41:53Z',
'fuel_type': 'petrol',
'id': '2817b944-9047-5e86-80fb-dc6ba6d12e73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH77373',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 141175,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-06-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2009}
2026-04-27 07:55:25 [auto1.es] INFO: Saving data for SH77373: {'auction_closing_time': 1777390913.0, 'created_time': 1777018644.21978, 'has_photos': True, 'last_price_update_time': 1777276525.033496}
2026-04-27 07:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230
2026-04-27 07:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230
2026-04-27 07:55:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230 to the API
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-04-28T15:09:16Z',
'fuel_type': 'petrol',
'id': '623cfb79-11bc-5853-9b83-96c04d204c00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG14230',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Mondeo',
'odometer': 67256,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-12-17',
'seller_name': None,
'title': 'Ford Mondeo 1.5 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2018}
2026-04-27 07:55:25 [auto1.es] INFO: Saving data for UG14230: {'auction_closing_time': 1777388956.0, 'created_time': 1777018653.638021, 'has_photos': True, 'last_price_update_time': 1777276525.574503}
2026-04-27 07:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372
2026-04-27 07:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372
2026-04-27 07:55:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 985041e8-4008-5dc9-ab4f-3ca3399d946c with identifier: NS19372 to the API
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-04-28T15:58:17Z',
'fuel_type': 'hybrid',
'id': '985041e8-4008-5dc9-ab4f-3ca3399d946c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS19372',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '2er',
'odometer': 174639,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-12-09',
'seller_name': None,
'title': 'BMW 2er 225xe Active Tourer',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-04-27 07:55:25 [auto1.es] INFO: Saving data for NS19372: {'auction_closing_time': 1777391897.0, 'created_time': 1777019595.873135, 'has_photos': True, 'last_price_update_time': 1777276525.917499}
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487baad0>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88203590-28b7-5f00-bb71-520fb66c3e5a/88203590-28b7-5f00-bb71-520fb66c3e5a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_f194fe146897142314e2464f3ae071dd.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88203590-28b7-5f00-bb71-520fb66c3e5a
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824ec50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ea66a0-f792-5e8a-9f4c-9eac34dfddc7/68ea66a0-f792-5e8a-9f4c-9eac34dfddc7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_7cefe21a2a77b2ccd4adea553d54bd51.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048510890>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b485986f-fa0a-52de-a0d5-27d250c60795/b485986f-fa0a-52de-a0d5-27d250c60795_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_f197e63f328dc1af9b8448e8dadd9666.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b485986f-fa0a-52de-a0d5-27d250c60795
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872e110>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e01b17-54fb-5cef-ae7e-6e9b459cf532/70e01b17-54fb-5cef-ae7e-6e9b459cf532_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/b0/dab00d1526df1cf69c531c74738b4bed/pa/GU60658_29cc97cb4d976678abab1a86d542f6e9.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70e01b17-54fb-5cef-ae7e-6e9b459cf532
2026-04-27 07:55:26 [auto1.es] INFO: Found listing with ID: FU18990
2026-04-27 07:55:26 [auto1.es] INFO: Scrape type for FU18990: 2
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eccc9aae-c087-598b-9825-635b91c18730 with identifier: FU18990
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eccc9aae-c087-598b-9825-635b91c18730 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eccc9aae-c087-598b-9825-635b91c18730 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eccc9aae-c087-598b-9825-635b91c18730, identifier: FU18990
2026-04-27 07:55:26 [auto1.es] INFO: Found listing with ID: GB19673
2026-04-27 07:55:26 [auto1.es] INFO: Scrape type for GB19673: 2
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8492af4a-efe0-5d3b-afa5-7ef54c789d29 with identifier: GB19673
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8492af4a-efe0-5d3b-afa5-7ef54c789d29 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8492af4a-efe0-5d3b-afa5-7ef54c789d29 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8492af4a-efe0-5d3b-afa5-7ef54c789d29, identifier: GB19673
2026-04-27 07:55:26 [auto1.es] INFO: Found listing with ID: ZU47105
2026-04-27 07:55:26 [auto1.es] INFO: Scrape type for ZU47105: 2
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75bb642a-433e-57f0-95ed-20cab4f23ee1 with identifier: ZU47105
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75bb642a-433e-57f0-95ed-20cab4f23ee1 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75bb642a-433e-57f0-95ed-20cab4f23ee1 with scrape type 2
2026-04-27 07:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75bb642a-433e-57f0-95ed-20cab4f23ee1, identifier: ZU47105
2026-04-27 07:55:26 [auto1.es] INFO: Found listing with ID: CL46946
2026-04-27 07:55:26 [auto1.es] INFO: Scrape type for CL46946: 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_8244375a6d3360b20492078fe6fc1020.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_364ab3b44a0433e134f4b47b6e40bfb3.jpg not downloaded yet
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_82c527b8d0b4d98d3099087e1b92e968.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_30062182a8a0ac5333718c53a5fbaf5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eccc9aae-c087-598b-9825-635b91c18730 with identifier: FU18990
2026-04-27 07:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eccc9aae-c087-598b-9825-635b91c18730 with identifier: FU18990
2026-04-27 07:55:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eccc9aae-c087-598b-9825-635b91c18730 with identifier: FU18990 to the API
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:29:56Z',
'fuel_type': 'diesel',
'id': 'eccc9aae-c087-598b-9825-635b91c18730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU18990',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 217806,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-03-21',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-04-27 07:55:26 [auto1.es] INFO: Saving data for FU18990: {'auction_closing_time': 1777390196.0, 'created_time': 1777019025.76233, 'has_photos': True, 'last_price_update_time': 1777276526.929435}
2026-04-27 07:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8492af4a-efe0-5d3b-afa5-7ef54c789d29 with identifier: GB19673
2026-04-27 07:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8492af4a-efe0-5d3b-afa5-7ef54c789d29 with identifier: GB19673
2026-04-27 07:55:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8492af4a-efe0-5d3b-afa5-7ef54c789d29 with identifier: GB19673 to the API
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:46:44Z',
'fuel_type': 'diesel',
'id': '8492af4a-efe0-5d3b-afa5-7ef54c789d29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB19673',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'DS Automobiles',
'model': 'DS5',
'odometer': 369088,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'DS Automobiles DS5 2.0 Blue-HDi Limited Edition 1955',
'transmission': 'automatic',
'trim': 'Limited Edition 1955',
'year': 2015}
2026-04-27 07:55:27 [auto1.es] INFO: Saving data for GB19673: {'auction_closing_time': 1777391204.0, 'created_time': 1777020543.543701, 'has_photos': True, 'last_price_update_time': 1777276527.257995}
2026-04-27 07:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75bb642a-433e-57f0-95ed-20cab4f23ee1 with identifier: ZU47105
2026-04-27 07:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75bb642a-433e-57f0-95ed-20cab4f23ee1 with identifier: ZU47105
2026-04-27 07:55:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75bb642a-433e-57f0-95ed-20cab4f23ee1 with identifier: ZU47105 to the API
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:34:59Z',
'fuel_type': 'diesel',
'id': '75bb642a-433e-57f0-95ed-20cab4f23ee1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU47105',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'V60',
'odometer': 167556,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-07-27',
'seller_name': None,
'title': 'Volvo V60 2.0 D2 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2016}
2026-04-27 07:55:27 [auto1.es] INFO: Saving data for ZU47105: {'auction_closing_time': 1777390499.0, 'created_time': 1777019406.430677, 'has_photos': True, 'last_price_update_time': 1777276527.652807}
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048226e10>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88203590-28b7-5f00-bb71-520fb66c3e5a/88203590-28b7-5f00-bb71-520fb66c3e5a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_5917fe70908371ef7fe0cab4f87f8079.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88203590-28b7-5f00-bb71-520fb66c3e5a
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482068d0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b485986f-fa0a-52de-a0d5-27d250c60795/b485986f-fa0a-52de-a0d5-27d250c60795_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_e303d9c685c1976709f6727ee65bb34a.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b485986f-fa0a-52de-a0d5-27d250c60795
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c1cd0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ea66a0-f792-5e8a-9f4c-9eac34dfddc7/68ea66a0-f792-5e8a-9f4c-9eac34dfddc7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/89/fa89fce23dc755ced1e2cd36eb85f7c7/pa/TB92438_bf5ef0ba102c0d8e5cec5b85a6b3c340.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68ea66a0-f792-5e8a-9f4c-9eac34dfddc7
2026-04-27 07:55:27 [auto1.es] INFO: Found listing with ID: UR41471
2026-04-27 07:55:27 [auto1.es] INFO: Scrape type for UR41471: 2
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb49083-4051-5f10-8540-661d39b261d9 with identifier: UR41471
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb49083-4051-5f10-8540-661d39b261d9 with scrape type 2
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb49083-4051-5f10-8540-661d39b261d9 with scrape type 2
2026-04-27 07:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dbb49083-4051-5f10-8540-661d39b261d9, identifier: UR41471
2026-04-27 07:55:27 [auto1.es] INFO: Found listing with ID: UU20141
2026-04-27 07:55:27 [auto1.es] INFO: Scrape type for UU20141: 2
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e910d34-69ee-5999-9867-bc99485ee249 with scrape type 2
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e910d34-69ee-5999-9867-bc99485ee249 with scrape type 2
2026-04-27 07:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3e910d34-69ee-5999-9867-bc99485ee249, identifier: UU20141
2026-04-27 07:55:28 [auto1.es] INFO: Found listing with ID: EM71633
2026-04-27 07:55:28 [auto1.es] INFO: Scrape type for EM71633: 2
2026-04-27 07:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f398742-05f3-5888-97f5-b0bc93c32ce3 with identifier: EM71633
2026-04-27 07:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f398742-05f3-5888-97f5-b0bc93c32ce3 with scrape type 2
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f398742-05f3-5888-97f5-b0bc93c32ce3 with scrape type 2
2026-04-27 07:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f398742-05f3-5888-97f5-b0bc93c32ce3, identifier: EM71633
2026-04-27 07:55:28 [auto1.es] INFO: Found listing with ID: YN92752
2026-04-27 07:55:28 [auto1.es] INFO: Scrape type for YN92752: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_6ddc92c1ae6841a05ba25c1f4426ae6c.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25719a48-ad21-5964-82ce-1092f745553e with identifier: XW07664
2026-04-27 07:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25719a48-ad21-5964-82ce-1092f745553e with scrape type 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 25719a48-ad21-5964-82ce-1092f745553e
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_34eb6a45d3b497cbc3e7718a38b5ab5f.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dbb49083-4051-5f10-8540-661d39b261d9 with identifier: UR41471
2026-04-27 07:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dbb49083-4051-5f10-8540-661d39b261d9 with identifier: UR41471
2026-04-27 07:55:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dbb49083-4051-5f10-8540-661d39b261d9 with identifier: UR41471 to the API
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-04-28T15:41:29Z',
'fuel_type': 'diesel',
'id': 'dbb49083-4051-5f10-8540-661d39b261d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR41471',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Trafic',
'odometer': 115764,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-12-31',
'seller_name': None,
'title': 'Renault Trafic 1.6 dCi Energy L1H1 2,7t Expression',
'transmission': 'manual',
'trim': 'L1H1 2,7t Expression',
'year': 2018}
2026-04-27 07:55:28 [auto1.es] INFO: Saving data for UR41471: {'auction_closing_time': 1777390889.0, 'created_time': 1777019457.229686, 'has_photos': True, 'last_price_update_time': 1777276528.586588}
2026-04-27 07:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141
2026-04-27 07:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141
2026-04-27 07:55:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141 to the API
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:59:03Z',
'fuel_type': 'diesel',
'id': '3e910d34-69ee-5999-9867-bc99485ee249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU20141',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 111332,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-07-24',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-04-27 07:55:28 [auto1.es] INFO: Saving data for UU20141: {'auction_closing_time': 1777391943.0, 'created_time': 1777018731.483235, 'has_photos': True, 'last_price_update_time': 1777276528.933545}
2026-04-27 07:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f398742-05f3-5888-97f5-b0bc93c32ce3 with identifier: EM71633
2026-04-27 07:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f398742-05f3-5888-97f5-b0bc93c32ce3 with identifier: EM71633
2026-04-27 07:55:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f398742-05f3-5888-97f5-b0bc93c32ce3 with identifier: EM71633 to the API
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-04-28T15:34:40Z',
'fuel_type': 'diesel',
'id': '2f398742-05f3-5888-97f5-b0bc93c32ce3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM71633',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '307',
'odometer': 134555,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-05-13',
'seller_name': None,
'title': 'Peugeot 307 2.0 HDi SW Pack',
'transmission': 'manual',
'trim': 'SW Pack',
'year': 2004}
2026-04-27 07:55:29 [auto1.es] INFO: Saving data for EM71633: {'auction_closing_time': 1777390480.0, 'created_time': 1777019053.378204, 'has_photos': True, 'last_price_update_time': 1777276529.220114}
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_12c37c11b7d5f5d131a1463d50b1d092.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [auto1.es] INFO: Found listing with ID: LH37494
2026-04-27 07:55:29 [auto1.es] INFO: Scrape type for LH37494: 2
2026-04-27 07:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cec28491-7da2-5d8b-9246-63ada9a823e1 with identifier: LH37494
2026-04-27 07:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cec28491-7da2-5d8b-9246-63ada9a823e1 with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cec28491-7da2-5d8b-9246-63ada9a823e1 with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cec28491-7da2-5d8b-9246-63ada9a823e1, identifier: LH37494
2026-04-27 07:55:29 [auto1.es] INFO: Found listing with ID: PM42549
2026-04-27 07:55:29 [auto1.es] INFO: Scrape type for PM42549: 1
2026-04-27 07:55:29 [auto1.es] INFO: Found listing with ID: EU45486
2026-04-27 07:55:29 [auto1.es] INFO: Scrape type for EU45486: 1
2026-04-27 07:55:29 [auto1.es] INFO: Found listing with ID: CL48879
2026-04-27 07:55:29 [auto1.es] INFO: Scrape type for CL48879: 1
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_29d9236843ea4a252bc5f6eaed26807f.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_1c214e212bd7525e729cfc9c92464238.jpg not downloaded yet
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c02d0>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9771c750-1823-574f-b4e4-9396ca92a731/9771c750-1823-574f-b4e4-9396ca92a731_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_82c527b8d0b4d98d3099087e1b92e968.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9771c750-1823-574f-b4e4-9396ca92a731
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872f710>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88203590-28b7-5f00-bb71-520fb66c3e5a/88203590-28b7-5f00-bb71-520fb66c3e5a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/28/fe28a4459788eeb80025c34b49e11791/pa/XT63016_30062182a8a0ac5333718c53a5fbaf5e.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88203590-28b7-5f00-bb71-520fb66c3e5a
2026-04-27 07:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cec28491-7da2-5d8b-9246-63ada9a823e1 with identifier: LH37494
2026-04-27 07:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cec28491-7da2-5d8b-9246-63ada9a823e1 with identifier: LH37494
2026-04-27 07:55:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cec28491-7da2-5d8b-9246-63ada9a823e1 with identifier: LH37494 to the API
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 63,
'expiration_date': '2026-04-28T15:50:29Z',
'fuel_type': 'petrol',
'id': 'cec28491-7da2-5d8b-9246-63ada9a823e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH37494',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'Getz',
'odometer': 169469,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-11-21',
'seller_name': None,
'title': 'Hyundai Getz 1.1 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2005}
2026-04-27 07:55:29 [auto1.es] INFO: Saving data for LH37494: {'auction_closing_time': 1777391429.0, 'created_time': 1777019249.602095, 'has_photos': True, 'last_price_update_time': 1777276529.855451}
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE93313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_00a223816f0adf68d43df18152fddec0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_37a3db8f63424a7f78d163dd5d7c3617.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [auto1.es] INFO: Found listing with ID: NH36425
2026-04-27 07:55:29 [auto1.es] INFO: Scrape type for NH36425: 0
2026-04-27 07:55:29 [auto1.es] INFO: Found listing with ID: YB25271
2026-04-27 07:55:30 [auto1.es] INFO: Scrape type for YB25271: 2
2026-04-27 07:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e55bb5-46a8-5c87-905f-16db60e575e6 with identifier: YB25271
2026-04-27 07:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e55bb5-46a8-5c87-905f-16db60e575e6 with scrape type 2
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16e55bb5-46a8-5c87-905f-16db60e575e6 with scrape type 2
2026-04-27 07:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16e55bb5-46a8-5c87-905f-16db60e575e6, identifier: YB25271
2026-04-27 07:55:30 [auto1.es] INFO: Found listing with ID: AP64708
2026-04-27 07:55:30 [auto1.es] INFO: Scrape type for AP64708: 1
2026-04-27 07:55:30 [auto1.es] INFO: Found listing with ID: CJ71608
2026-04-27 07:55:30 [auto1.es] INFO: Scrape type for CJ71608: 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_9803f61b7b7cb3cf28f9871b918969cf.jpg not downloaded yet
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC68158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16e55bb5-46a8-5c87-905f-16db60e575e6 with identifier: YB25271
2026-04-27 07:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16e55bb5-46a8-5c87-905f-16db60e575e6 with identifier: YB25271
2026-04-27 07:55:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16e55bb5-46a8-5c87-905f-16db60e575e6 with identifier: YB25271 to the API
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-04-28T15:16:59Z',
'fuel_type': 'petrol',
'id': '16e55bb5-46a8-5c87-905f-16db60e575e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB25271',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 141403,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-02-04',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Trend +',
'transmission': 'manual',
'trim': 'Trend +',
'year': 2014}
2026-04-27 07:55:30 [auto1.es] INFO: Saving data for YB25271: {'auction_closing_time': 1777389419.0, 'created_time': 1777020342.783716, 'has_photos': True, 'last_price_update_time': 1777276530.518048}
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff064b60990>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9771c750-1823-574f-b4e4-9396ca92a731/9771c750-1823-574f-b4e4-9396ca92a731_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_12c37c11b7d5f5d131a1463d50b1d092.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9771c750-1823-574f-b4e4-9396ca92a731
2026-04-27 07:55:30 [auto1.es] INFO: Found listing with ID: RU76574
2026-04-27 07:55:30 [auto1.es] INFO: Scrape type for RU76574: 2
2026-04-27 07:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4069013a-ef79-585d-8199-b57ba7661c6a with identifier: RU76574
2026-04-27 07:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4069013a-ef79-585d-8199-b57ba7661c6a with scrape type 2
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4069013a-ef79-585d-8199-b57ba7661c6a with scrape type 2
2026-04-27 07:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4069013a-ef79-585d-8199-b57ba7661c6a, identifier: RU76574
2026-04-27 07:55:30 [auto1.es] INFO: Found listing with ID: EB93661
2026-04-27 07:55:31 [auto1.es] INFO: Scrape type for EB93661: 1
2026-04-27 07:55:31 [auto1.es] INFO: Found listing with ID: GH03628
2026-04-27 07:55:31 [auto1.es] INFO: Scrape type for GH03628: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_9e3271fef8b813daf6932ed2e498fa03.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_34eb6a45d3b497cbc3e7718a38b5ab5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4069013a-ef79-585d-8199-b57ba7661c6a with identifier: RU76574
2026-04-27 07:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4069013a-ef79-585d-8199-b57ba7661c6a with identifier: RU76574
2026-04-27 07:55:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4069013a-ef79-585d-8199-b57ba7661c6a with identifier: RU76574 to the API
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:21:28Z',
'fuel_type': 'diesel',
'id': '4069013a-ef79-585d-8199-b57ba7661c6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU76574',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 151638,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-11-27',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-04-27 07:55:31 [auto1.es] INFO: Saving data for RU76574: {'auction_closing_time': 1777389688.0, 'created_time': 1777019862.829888, 'has_photos': True, 'last_price_update_time': 1777276531.808199}
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW45273/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN89364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824a10>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b485986f-fa0a-52de-a0d5-27d250c60795/b485986f-fa0a-52de-a0d5-27d250c60795_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/c0/d9c0791192c6d123579e52317a93fbab/pa/HY15551_00a223816f0adf68d43df18152fddec0.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b485986f-fa0a-52de-a0d5-27d250c60795
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823aad0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9771c750-1823-574f-b4e4-9396ca92a731/9771c750-1823-574f-b4e4-9396ca92a731_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_37a3db8f63424a7f78d163dd5d7c3617.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9771c750-1823-574f-b4e4-9396ca92a731
2026-04-27 07:55:31 [auto1.es] INFO: Found listing with ID: RB02327
2026-04-27 07:55:31 [auto1.es] INFO: Scrape type for RB02327: 2
2026-04-27 07:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b2a09c-7246-5441-bd2f-59bd68a4f7b7 with identifier: RB02327
2026-04-27 07:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b2a09c-7246-5441-bd2f-59bd68a4f7b7 with scrape type 2
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b2a09c-7246-5441-bd2f-59bd68a4f7b7 with scrape type 2
2026-04-27 07:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4b2a09c-7246-5441-bd2f-59bd68a4f7b7, identifier: RB02327
2026-04-27 07:55:32 [auto1.es] INFO: Found listing with ID: JR98843
2026-04-27 07:55:32 [auto1.es] INFO: Scrape type for JR98843: 2
2026-04-27 07:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900c4730-65e9-5aba-be8a-bc1331b13c7a with identifier: JR98843
2026-04-27 07:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900c4730-65e9-5aba-be8a-bc1331b13c7a with scrape type 2
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 900c4730-65e9-5aba-be8a-bc1331b13c7a with scrape type 2
2026-04-27 07:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 900c4730-65e9-5aba-be8a-bc1331b13c7a, identifier: JR98843
2026-04-27 07:55:32 [auto1.es] INFO: Found listing with ID: PB07588
2026-04-27 07:55:32 [auto1.es] INFO: Scrape type for PB07588: 1
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_813ed1e2bc92b39c4da1271288168341.jpg not downloaded yet
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV76791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB33691> (referer: https://www.auto1.com/v1/car-details-view/BB33691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2013 | hits on page: 40
2026-04-27 07:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4b2a09c-7246-5441-bd2f-59bd68a4f7b7 with identifier: RB02327
2026-04-27 07:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4b2a09c-7246-5441-bd2f-59bd68a4f7b7 with identifier: RB02327
2026-04-27 07:55:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4b2a09c-7246-5441-bd2f-59bd68a4f7b7 with identifier: RB02327 to the API
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-04-28T15:09:21Z',
'fuel_type': 'diesel',
'id': 'd4b2a09c-7246-5441-bd2f-59bd68a4f7b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB02327',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 105755,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-01-20',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
'transmission': 'automatic',
'trim': 'Executive Q4',
'year': 2020}
2026-04-27 07:55:32 [auto1.es] INFO: Saving data for RB02327: {'auction_closing_time': 1777388961.0, 'created_time': 1777020262.636285, 'has_photos': True, 'last_price_update_time': 1777276532.597865}
2026-04-27 07:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 900c4730-65e9-5aba-be8a-bc1331b13c7a with identifier: JR98843
2026-04-27 07:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 900c4730-65e9-5aba-be8a-bc1331b13c7a with identifier: JR98843
2026-04-27 07:55:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 900c4730-65e9-5aba-be8a-bc1331b13c7a with identifier: JR98843 to the API
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:49:36Z',
'fuel_type': 'diesel',
'id': '900c4730-65e9-5aba-be8a-bc1331b13c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR98843',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 111392,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-02-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2008}
2026-04-27 07:55:32 [auto1.es] INFO: Saving data for JR98843: {'auction_closing_time': 1777391376.0, 'created_time': 1777020023.917194, 'has_photos': True, 'last_price_update_time': 1777276532.916104}
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA87642> (referer: https://www.auto1.com/v1/car-details-view/XA87642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_29d9236843ea4a252bc5f6eaed26807f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_1c214e212bd7525e729cfc9c92464238.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [auto1.es] INFO: Found listing with ID: YH33238
2026-04-27 07:55:32 [auto1.es] INFO: Scrape type for YH33238: 2
2026-04-27 07:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a5b7b2-ef48-5dc8-b181-b63293afc9a2 with identifier: YH33238
2026-04-27 07:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a5b7b2-ef48-5dc8-b181-b63293afc9a2 with scrape type 2
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a5b7b2-ef48-5dc8-b181-b63293afc9a2 with scrape type 2
2026-04-27 07:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38a5b7b2-ef48-5dc8-b181-b63293afc9a2, identifier: YH33238
2026-04-27 07:55:33 [auto1.es] INFO: Found listing with ID: DZ01360
2026-04-27 07:55:33 [auto1.es] INFO: Scrape type for DZ01360: 2
2026-04-27 07:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8202fd87-496d-57b3-b814-4b30bf200a35 with identifier: DZ01360
2026-04-27 07:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8202fd87-496d-57b3-b814-4b30bf200a35 with scrape type 2
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8202fd87-496d-57b3-b814-4b30bf200a35 with scrape type 2
2026-04-27 07:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8202fd87-496d-57b3-b814-4b30bf200a35, identifier: DZ01360
2026-04-27 07:55:33 [auto1.es] INFO: Found listing with ID: ZL51893
2026-04-27 07:55:33 [auto1.es] INFO: Scrape type for ZL51893: 1
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_fd309782bfcdae3e655fd71fd997d18b.jpg not downloaded yet
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [auto1.es] INFO: Found listing with ID: DG21633
2026-04-27 07:55:33 [auto1.es] INFO: Scrape type for DG21633: 1
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a423d0>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25719a48-ad21-5964-82ce-1092f745553e/25719a48-ad21-5964-82ce-1092f745553e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_34eb6a45d3b497cbc3e7718a38b5ab5f.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25719a48-ad21-5964-82ce-1092f745553e
2026-04-27 07:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38a5b7b2-ef48-5dc8-b181-b63293afc9a2 with identifier: YH33238
2026-04-27 07:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38a5b7b2-ef48-5dc8-b181-b63293afc9a2 with identifier: YH33238
2026-04-27 07:55:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38a5b7b2-ef48-5dc8-b181-b63293afc9a2 with identifier: YH33238 to the API
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:25:05Z',
'fuel_type': 'petrol',
'id': '38a5b7b2-ef48-5dc8-b181-b63293afc9a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH33238',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Cupra',
'model': 'Formentor',
'odometer': 29790,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-10-24',
'seller_name': None,
'title': 'Cupra Formentor 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-04-27 07:55:33 [auto1.es] INFO: Saving data for YH33238: {'auction_closing_time': 1777389905.0, 'created_time': 1777019265.873345, 'has_photos': True, 'last_price_update_time': 1777276533.663594}
2026-04-27 07:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8202fd87-496d-57b3-b814-4b30bf200a35 with identifier: DZ01360
2026-04-27 07:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8202fd87-496d-57b3-b814-4b30bf200a35 with identifier: DZ01360
2026-04-27 07:55:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8202fd87-496d-57b3-b814-4b30bf200a35 with identifier: DZ01360 to the API
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:45:01Z',
'fuel_type': 'diesel',
'id': '8202fd87-496d-57b3-b814-4b30bf200a35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ01360',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 84438,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-08-31',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2015}
2026-04-27 07:55:34 [auto1.es] INFO: Saving data for DZ01360: {'auction_closing_time': 1777391101.0, 'created_time': 1777018652.854938, 'has_photos': True, 'last_price_update_time': 1777276534.051823}
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_9803f61b7b7cb3cf28f9871b918969cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.extensions.logstats] INFO: Crawled 78 pages (at 36 pages/min), scraped 176 items (at 94 items/min)
2026-04-27 07:55:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 378MiB
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: ZT79266
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for ZT79266: 2
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf0707f-3f3b-5b73-8023-561f6181af45 with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf0707f-3f3b-5b73-8023-561f6181af45 with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2cf0707f-3f3b-5b73-8023-561f6181af45, identifier: ZT79266
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: AG74382
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for AG74382: 1
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: AK29659
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for AK29659: 1
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: GT36830
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for GT36830: 1
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a49bf361-e0b9-5e49-8ff5-35508fe52d6b with identifier: BB33691
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a49bf361-e0b9-5e49-8ff5-35508fe52d6b with scrape type 1
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a49bf361-e0b9-5e49-8ff5-35508fe52d6b
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_a7098f88c04763a0bd9dfb43e81e4fca.jpg not downloaded yet
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_9e3271fef8b813daf6932ed2e498fa03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266
2026-04-27 07:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266
2026-04-27 07:55:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266 to the API
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:43:33Z',
'fuel_type': 'diesel',
'id': '2cf0707f-3f3b-5b73-8023-561f6181af45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT79266',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 321901,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-09-08',
'seller_name': None,
'title': 'Audi A4 Allroad 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 07:55:34 [auto1.es] INFO: Saving data for ZT79266: {'auction_closing_time': 1777391013.0, 'created_time': 1777021280.16199, 'has_photos': True, 'last_price_update_time': 1777276534.649743}
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f with identifier: XA87642
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f with scrape type 1
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_d192d8a38e0a67a68b1f52f8ac351e21.jpg not downloaded yet
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485a5690>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9771c750-1823-574f-b4e4-9396ca92a731/9771c750-1823-574f-b4e4-9396ca92a731_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/48/27483bb9e2c89df503b9a85d32285425/pa/WT40413_29d9236843ea4a252bc5f6eaed26807f.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9771c750-1823-574f-b4e4-9396ca92a731
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c5b10>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25719a48-ad21-5964-82ce-1092f745553e/25719a48-ad21-5964-82ce-1092f745553e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_1c214e212bd7525e729cfc9c92464238.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25719a48-ad21-5964-82ce-1092f745553e
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: WT21682
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for WT21682: 1
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: FU08046
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for FU08046: 2
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 635583a3-3728-5efc-ac64-316aa5d34cef with identifier: FU08046
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 635583a3-3728-5efc-ac64-316aa5d34cef with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 635583a3-3728-5efc-ac64-316aa5d34cef with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 635583a3-3728-5efc-ac64-316aa5d34cef, identifier: FU08046
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: YH90465
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for YH90465: 1
2026-04-27 07:55:34 [auto1.es] INFO: Found listing with ID: RF85744
2026-04-27 07:55:34 [auto1.es] INFO: Scrape type for RF85744: 2
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5d7459-a842-5ef3-9f84-e532ad349a16 with scrape type 2
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5d7459-a842-5ef3-9f84-e532ad349a16 with scrape type 2
2026-04-27 07:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e5d7459-a842-5ef3-9f84-e532ad349a16, identifier: RF85744
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_2f329abe2998d0bc7c90fee15a838c3b.jpg not downloaded yet
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_813ed1e2bc92b39c4da1271288168341.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 635583a3-3728-5efc-ac64-316aa5d34cef with identifier: FU08046
2026-04-27 07:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 635583a3-3728-5efc-ac64-316aa5d34cef with identifier: FU08046
2026-04-27 07:55:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 635583a3-3728-5efc-ac64-316aa5d34cef with identifier: FU08046 to the API
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:43:04Z',
'fuel_type': 'diesel',
'id': '635583a3-3728-5efc-ac64-316aa5d34cef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU08046',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 253501,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-05-28',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-04-27 07:55:35 [auto1.es] INFO: Saving data for FU08046: {'auction_closing_time': 1777390984.0, 'created_time': 1777020361.900483, 'has_photos': True, 'last_price_update_time': 1777276535.347692}
2026-04-27 07:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744
2026-04-27 07:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744
2026-04-27 07:55:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744 to the API
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:42:47Z',
'fuel_type': 'diesel',
'id': '9e5d7459-a842-5ef3-9f84-e532ad349a16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF85744',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Laguna',
'odometer': 336471,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-10-24',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Avantage',
'transmission': 'manual',
'trim': 'Avantage',
'year': 2006}
2026-04-27 07:55:35 [auto1.es] INFO: Saving data for RF85744: {'auction_closing_time': 1777390967.0, 'created_time': 1777018012.904362, 'has_photos': True, 'last_price_update_time': 1777276535.642557}
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_70005b825a9c77deca891f90f0389ed4.jpg not downloaded yet
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048aa4ad0>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25719a48-ad21-5964-82ce-1092f745553e/25719a48-ad21-5964-82ce-1092f745553e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_9803f61b7b7cb3cf28f9871b918969cf.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25719a48-ad21-5964-82ce-1092f745553e
2026-04-27 07:55:35 [auto1.es] INFO: Found listing with ID: CD34626
2026-04-27 07:55:35 [auto1.es] INFO: Scrape type for CD34626: 1
2026-04-27 07:55:35 [auto1.es] INFO: Found listing with ID: YK72868
2026-04-27 07:55:35 [auto1.es] INFO: Scrape type for YK72868: 2
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f4a181b-8234-5766-8aab-cfd8f49a5e63 with identifier: YK72868
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f4a181b-8234-5766-8aab-cfd8f49a5e63 with scrape type 2
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f4a181b-8234-5766-8aab-cfd8f49a5e63 with scrape type 2
2026-04-27 07:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f4a181b-8234-5766-8aab-cfd8f49a5e63, identifier: YK72868
2026-04-27 07:55:35 [auto1.es] INFO: Found listing with ID: PL52930
2026-04-27 07:55:35 [auto1.es] INFO: Scrape type for PL52930: 1
2026-04-27 07:55:35 [auto1.es] INFO: Found listing with ID: SB45150
2026-04-27 07:55:35 [auto1.es] INFO: Scrape type for SB45150: 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_b8d5ec1d1446ad75585f35460687ce01.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f4a181b-8234-5766-8aab-cfd8f49a5e63 with identifier: YK72868
2026-04-27 07:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f4a181b-8234-5766-8aab-cfd8f49a5e63 with identifier: YK72868
2026-04-27 07:55:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f4a181b-8234-5766-8aab-cfd8f49a5e63 with identifier: YK72868 to the API
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:20:50Z',
'fuel_type': 'petrol',
'id': '7f4a181b-8234-5766-8aab-cfd8f49a5e63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK72868',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 75719,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-04-15',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2007}
2026-04-27 07:55:36 [auto1.es] INFO: Saving data for YK72868: {'auction_closing_time': 1777389650.0, 'created_time': 1777018849.73371, 'has_photos': True, 'last_price_update_time': 1777276536.203401}
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_526a5e4f06c8eefcc53db4530918c255.jpg not downloaded yet
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a56490>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25719a48-ad21-5964-82ce-1092f745553e/25719a48-ad21-5964-82ce-1092f745553e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_9e3271fef8b813daf6932ed2e498fa03.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25719a48-ad21-5964-82ce-1092f745553e
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: YG97734
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for YG97734: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: HU49070
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for HU49070: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: PM96129
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for PM96129: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: GF69614
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for GF69614: 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_9f1cc8ee3308cbcbeb25e0a5aa002872.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL65807> (referer: https://www.auto1.com/v1/car-details-view/DL65807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048238290>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25719a48-ad21-5964-82ce-1092f745553e/25719a48-ad21-5964-82ce-1092f745553e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/70/2d70ef64368d74c23074eb18bb968a02/pa/XW07664_813ed1e2bc92b39c4da1271288168341.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25719a48-ad21-5964-82ce-1092f745553e
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_bebe6f43f64f43f6e04f51d7ced1ea0a.jpg not downloaded yet
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_d192d8a38e0a67a68b1f52f8ac351e21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: JV00835
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for JV00835: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: VH48959
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for VH48959: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: LF88675
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for LF88675: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: NJ68356
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for NJ68356: 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_c833124a1f9874b040d0d78120b717f5.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB16607> (referer: https://www.auto1.com/v1/car-details-view/GB16607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_34cb66d2e0cd024eb1e811967d6618d1.jpg not downloaded yet
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: VB40335
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for VB40335: 0
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: SJ57569
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for SJ57569: 2
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf964c6-44e4-5943-beb5-dd6f1dade521 with scrape type 2
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf964c6-44e4-5943-beb5-dd6f1dade521 with scrape type 2
2026-04-27 07:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdf964c6-44e4-5943-beb5-dd6f1dade521, identifier: SJ57569
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: FM69829
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for FM69829: 1
2026-04-27 07:55:36 [auto1.es] INFO: Found listing with ID: GJ86172
2026-04-27 07:55:36 [auto1.es] INFO: Scrape type for GJ86172: 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_4f511c43ed7f6a0f935ea1379578694a.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR89718> (referer: https://www.auto1.com/v1/car-details-view/SR89718/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569
2026-04-27 07:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569
2026-04-27 07:55:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569 to the API
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-04-28T15:33:02Z',
'fuel_type': 'diesel',
'id': 'fdf964c6-44e4-5943-beb5-dd6f1dade521',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ57569',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC90',
'odometer': 474797,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-23',
'seller_name': None,
'title': 'Volvo XC90 2.4 D5 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2011}
2026-04-27 07:55:37 [auto1.es] INFO: Saving data for SJ57569: {'auction_closing_time': 1777390382.0, 'created_time': 1777020010.645698, 'has_photos': True, 'last_price_update_time': 1777276537.271609}
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_e23f642fc5dda45a954860205e2530b6.jpg not downloaded yet
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_9f1cc8ee3308cbcbeb25e0a5aa002872.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [auto1.es] INFO: Found listing with ID: CM70741
2026-04-27 07:55:37 [auto1.es] INFO: Scrape type for CM70741: 2
2026-04-27 07:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86bcf17-4f3f-5229-997f-c9b37b33104b with identifier: CM70741
2026-04-27 07:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86bcf17-4f3f-5229-997f-c9b37b33104b with scrape type 2
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a86bcf17-4f3f-5229-997f-c9b37b33104b with scrape type 2
2026-04-27 07:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a86bcf17-4f3f-5229-997f-c9b37b33104b, identifier: CM70741
2026-04-27 07:55:37 [auto1.es] INFO: Found listing with ID: TU40126
2026-04-27 07:55:37 [auto1.es] INFO: Scrape type for TU40126: 1
2026-04-27 07:55:37 [auto1.es] INFO: Found listing with ID: VP31353
2026-04-27 07:55:37 [auto1.es] INFO: Scrape type for VP31353: 1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_177c24b43fb91c016ecd21fde12b8e13.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf72b375-dd00-5ecb-94d6-cd47a4b397d1 with identifier: DL65807
2026-04-27 07:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1 with scrape type 1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_639585b1f92e680660c5f5fb218062fc.jpg not downloaded yet
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048745990>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f/8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_d192d8a38e0a67a68b1f52f8ac351e21.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f
2026-04-27 07:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a86bcf17-4f3f-5229-997f-c9b37b33104b with identifier: CM70741
2026-04-27 07:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a86bcf17-4f3f-5229-997f-c9b37b33104b with identifier: CM70741
2026-04-27 07:55:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a86bcf17-4f3f-5229-997f-c9b37b33104b with identifier: CM70741 to the API
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:47:50Z',
'fuel_type': 'petrol',
'id': 'a86bcf17-4f3f-5229-997f-c9b37b33104b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM70741',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 115374,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-11-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2018}
2026-04-27 07:55:37 [auto1.es] INFO: Saving data for CM70741: {'auction_closing_time': 1777391270.0, 'created_time': 1777020100.985702, 'has_photos': True, 'last_price_update_time': 1777276537.959798}
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_bebe6f43f64f43f6e04f51d7ced1ea0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [auto1.es] INFO: Found listing with ID: TW94946
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for TW94946: 2
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf8b380-754a-554a-842f-ebb4023ee0d4 with scrape type 2
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf8b380-754a-554a-842f-ebb4023ee0d4 with scrape type 2
2026-04-27 07:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abf8b380-754a-554a-842f-ebb4023ee0d4, identifier: TW94946
2026-04-27 07:55:38 [auto1.es] INFO: Found listing with ID: FU61873
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for FU61873: 1
2026-04-27 07:55:38 [auto1.es] INFO: Found listing with ID: LX19900
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for LX19900: 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_bd40317c761252081be7a0fd696484df.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_27ecdd4b98b2af3879862fe5f34d238d.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-04-27 07:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-04-27 07:55:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946 to the API
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:11:19Z',
'fuel_type': 'diesel',
'id': 'abf8b380-754a-554a-842f-ebb4023ee0d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW94946',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Clio',
'odometer': 108969,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-02-28',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2007}
2026-04-27 07:55:38 [auto1.es] INFO: Saving data for TW94946: {'auction_closing_time': 1777389079.0, 'created_time': 1777018655.098343, 'has_photos': True, 'last_price_update_time': 1777276538.629492}
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU46355> (referer: https://www.auto1.com/v1/car-details-view/FU46355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f84e4d-a125-5c76-a1c7-c7d13a33a488 with identifier: GB16607
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488 with scrape type 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_389b0084e9b8022c7956f68fae3a98cd.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e14c9e8-c252-5eb4-b94c-6ccb90be8407 with identifier: SR89718
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e14c9e8-c252-5eb4-b94c-6ccb90be8407 with scrape type 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1e14c9e8-c252-5eb4-b94c-6ccb90be8407
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_51b2f034648fef3653d83f25d5962aa0.jpg not downloaded yet
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048801b90>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49bf361-e0b9-5e49-8ff5-35508fe52d6b/a49bf361-e0b9-5e49-8ff5-35508fe52d6b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_9f1cc8ee3308cbcbeb25e0a5aa002872.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a49bf361-e0b9-5e49-8ff5-35508fe52d6b
2026-04-27 07:55:38 [auto1.es] INFO: Found listing with ID: EY59429
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for EY59429: 1
2026-04-27 07:55:38 [auto1.es] INFO: Found listing with ID: MV24721
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for MV24721: 1
2026-04-27 07:55:38 [auto1.es] INFO: Found listing with ID: SF27083
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for SF27083: 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_243eabce0d29703af3d6d7422bb97f60.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_500108156066ef8bab24ac3f0e0ce9d6.jpg not downloaded yet
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_4f511c43ed7f6a0f935ea1379578694a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_188a8a8664fcf308f3e0b6410ddf5b75.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_268fd80b2aed149fe9f0adecb7fe3ce9.jpg not downloaded yet
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM42549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048456050>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f/8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/98/2698757935b4a0c4429b5bc914aabc1a/pa/XA87642_bebe6f43f64f43f6e04f51d7ced1ea0a.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fc1b20f-b345-5de4-b90c-1b9be1d6ce5f
2026-04-27 07:55:38 [auto1.es] INFO: Found listing with ID: UD05464
2026-04-27 07:55:38 [auto1.es] INFO: Scrape type for UD05464: 2
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aea72349-fb62-52f6-bc2a-a1538e194d55 with identifier: UD05464
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aea72349-fb62-52f6-bc2a-a1538e194d55 with scrape type 2
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aea72349-fb62-52f6-bc2a-a1538e194d55 with scrape type 2
2026-04-27 07:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aea72349-fb62-52f6-bc2a-a1538e194d55, identifier: UD05464
2026-04-27 07:55:39 [auto1.es] INFO: Found listing with ID: HH46016
2026-04-27 07:55:39 [auto1.es] INFO: Scrape type for HH46016: 1
2026-04-27 07:55:39 [auto1.es] INFO: Found listing with ID: VA52410
2026-04-27 07:55:39 [auto1.es] INFO: Scrape type for VA52410: 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_b883913191028e225c6c9d8da3d3eebc.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_833404ecdbf583691223e73bf6847dbd.jpg not downloaded yet
2026-04-27 07:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU45486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL48879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aea72349-fb62-52f6-bc2a-a1538e194d55 with identifier: UD05464
2026-04-27 07:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aea72349-fb62-52f6-bc2a-a1538e194d55 with identifier: UD05464
2026-04-27 07:55:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aea72349-fb62-52f6-bc2a-a1538e194d55 with identifier: UD05464 to the API
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:24:07Z',
'fuel_type': 'diesel',
'id': 'aea72349-fb62-52f6-bc2a-a1538e194d55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD05464',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 186394,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-01-08',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2012}
2026-04-27 07:55:39 [auto1.es] INFO: Saving data for UD05464: {'auction_closing_time': 1777389847.0, 'created_time': 1777019979.510286, 'has_photos': True, 'last_price_update_time': 1777276539.482247}
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_da1a3a3126c06f316646111477a531f4.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_4d69f76fc0890dbc467b42c169df6d3f.jpg not downloaded yet
2026-04-27 07:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799fe6c6-0f4e-540b-baea-262e9311d715 with identifier: FU46355
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799fe6c6-0f4e-540b-baea-262e9311d715 with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_c6a90b078867bf7c7468d24a2520f09b.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_639585b1f92e680660c5f5fb218062fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [auto1.es] INFO: Found listing with ID: CA24896
2026-04-27 07:55:39 [auto1.es] INFO: Scrape type for CA24896: 2
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853 with identifier: CA24896
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853 with scrape type 2
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853 with scrape type 2
2026-04-27 07:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853, identifier: CA24896
2026-04-27 07:55:39 [auto1.es] INFO: Found listing with ID: RZ14437
2026-04-27 07:55:39 [auto1.es] INFO: Scrape type for RZ14437: 1
2026-04-27 07:55:39 [auto1.es] INFO: Found listing with ID: NX01244
2026-04-27 07:55:39 [auto1.es] INFO: Scrape type for NX01244: 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_207ac6e937edadce0c809e10ee5da83f.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_27ecdd4b98b2af3879862fe5f34d238d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853 with identifier: CA24896
2026-04-27 07:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853 with identifier: CA24896
2026-04-27 07:55:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853 with identifier: CA24896 to the API
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-04-28T15:50:03Z',
'fuel_type': 'petrol',
'id': '859dbfd3-6cff-5a5a-bb0e-0ac7f7d75853',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA24896',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'Clubman',
'odometer': 121374,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-23',
'seller_name': None,
'title': 'MINI Clubman Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-04-27 07:55:40 [auto1.es] INFO: Saving data for CA24896: {'auction_closing_time': 1777391403.0, 'created_time': 1777018222.446164, 'has_photos': True, 'last_price_update_time': 1777276540.204363}
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_cdd5b27231d1dae34fcefeeaaf670d5b.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_32de37466bffb174929054cbd72390dd.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_0b48dc62301eba2a227979091a51722d.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885990>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49bf361-e0b9-5e49-8ff5-35508fe52d6b/a49bf361-e0b9-5e49-8ff5-35508fe52d6b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/41/a5418e624c23c9aa011a7ba5944cf33f/pa/BB33691_4f511c43ed7f6a0f935ea1379578694a.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a49bf361-e0b9-5e49-8ff5-35508fe52d6b
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_51b2f034648fef3653d83f25d5962aa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [auto1.es] INFO: Found listing with ID: WA89477
2026-04-27 07:55:40 [auto1.es] INFO: Scrape type for WA89477: 1
2026-04-27 07:55:40 [auto1.es] INFO: Found listing with ID: TK02059
2026-04-27 07:55:40 [auto1.es] INFO: Scrape type for TK02059: 1
2026-04-27 07:55:40 [auto1.es] INFO: Found listing with ID: LN12503
2026-04-27 07:55:40 [auto1.es] INFO: Scrape type for LN12503: 2
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with scrape type 2
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with scrape type 2
2026-04-27 07:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce, identifier: LN12503
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_ee5eef80fc536f59b87c08eb2fd6b203.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH03628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_188a8a8664fcf308f3e0b6410ddf5b75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_500108156066ef8bab24ac3f0e0ce9d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503
2026-04-27 07:55:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503
2026-04-27 07:55:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503 to the API
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:05:27Z',
'fuel_type': 'diesel',
'id': 'adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN12503',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '206',
'odometer': 174772,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-06-27',
'seller_name': None,
'title': 'Peugeot 206 1.4 HDi XT',
'transmission': 'manual',
'trim': 'XT',
'year': 2002}
2026-04-27 07:55:40 [auto1.es] INFO: Saving data for LN12503: {'auction_closing_time': 1777388727.0, 'created_time': 1777020608.371836, 'has_photos': True, 'last_price_update_time': 1777276540.807722}
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_880fd87048fa2c4f0cfe8039dc575a77.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_6a53bb1327caeba56837683e9f6e2b4a.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_6727006966cd95e3cc7eb4d139cb897f.jpg not downloaded yet
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE93313> (referer: https://www.auto1.com/v1/car-details-view/KE93313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048736850>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_639585b1f92e680660c5f5fb218062fc.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_268fd80b2aed149fe9f0adecb7fe3ce9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [auto1.es] INFO: Found listing with ID: NK96984
2026-04-27 07:55:40 [auto1.es] INFO: Scrape type for NK96984: 1
2026-04-27 07:55:40 [auto1.es] INFO: Found listing with ID: NB45585
2026-04-27 07:55:40 [auto1.es] INFO: Scrape type for NB45585: 1
2026-04-27 07:55:40 [auto1.es] INFO: Found listing with ID: MZ14425
2026-04-27 07:55:41 [auto1.es] INFO: Scrape type for MZ14425: 1
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_3c69e51cd29dc42e4229596c26581a14.jpg not downloaded yet
2026-04-27 07:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e3710>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_27ecdd4b98b2af3879862fe5f34d238d.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_833404ecdbf583691223e73bf6847dbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_14d2b59b1cbc3fb23f16ff78f0e4064b.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_b8d8d423bbce097bd23a96912d21f76c.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_f3727af61e9ccccf55ec7dbf46c48c99.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB93661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_c6a90b078867bf7c7468d24a2520f09b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [auto1.es] INFO: Found listing with ID: RY22174
2026-04-27 07:55:41 [auto1.es] INFO: Scrape type for RY22174: 1
2026-04-27 07:55:41 [auto1.es] INFO: Found listing with ID: BR33518
2026-04-27 07:55:41 [auto1.es] INFO: Scrape type for BR33518: 1
2026-04-27 07:55:41 [auto1.es] INFO: Found listing with ID: BB01662
2026-04-27 07:55:41 [auto1.es] INFO: Scrape type for BB01662: 2
2026-04-27 07:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9574f20f-6f04-5718-81c2-3a4854cbe304 with identifier: BB01662
2026-04-27 07:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9574f20f-6f04-5718-81c2-3a4854cbe304 with scrape type 2
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9574f20f-6f04-5718-81c2-3a4854cbe304 with scrape type 2
2026-04-27 07:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9574f20f-6f04-5718-81c2-3a4854cbe304, identifier: BB01662
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_622bbd0d417a7b557c4961d09428a636.jpg not downloaded yet
2026-04-27 07:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057cc3810>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e14c9e8-c252-5eb4-b94c-6ccb90be8407/1e14c9e8-c252-5eb4-b94c-6ccb90be8407_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_51b2f034648fef3653d83f25d5962aa0.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e14c9e8-c252-5eb4-b94c-6ccb90be8407
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486f3e10>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f84e4d-a125-5c76-a1c7-c7d13a33a488/c1f84e4d-a125-5c76-a1c7-c7d13a33a488_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_188a8a8664fcf308f3e0b6410ddf5b75.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048487d50>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_500108156066ef8bab24ac3f0e0ce9d6.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9574f20f-6f04-5718-81c2-3a4854cbe304 with identifier: BB01662
2026-04-27 07:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9574f20f-6f04-5718-81c2-3a4854cbe304 with identifier: BB01662
2026-04-27 07:55:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9574f20f-6f04-5718-81c2-3a4854cbe304 with identifier: BB01662 to the API
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-04-28T15:45:50Z',
'fuel_type': 'petrol',
'id': '9574f20f-6f04-5718-81c2-3a4854cbe304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB01662',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'i10',
'odometer': 54115,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-01-06',
'seller_name': None,
'title': 'Hyundai i10 1.0 Klass Bluedrive',
'transmission': 'manual',
'trim': 'Klass Bluedrive',
'year': 2016}
2026-04-27 07:55:41 [auto1.es] INFO: Saving data for BB01662: {'auction_closing_time': 1777391150.0, 'created_time': 1777020413.645018, 'has_photos': True, 'last_price_update_time': 1777276541.792864}
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_d2f0cbf8fd22214a9985de3660766ca8.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_ec9cc1ef9d628e4961b7dc1c968e1ba1.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_207ac6e937edadce0c809e10ee5da83f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [auto1.es] INFO: Found listing with ID: WW00174
2026-04-27 07:55:41 [auto1.es] INFO: Scrape type for WW00174: 2
2026-04-27 07:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621 with identifier: WW00174
2026-04-27 07:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621 with scrape type 2
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621 with scrape type 2
2026-04-27 07:55:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621, identifier: WW00174
2026-04-27 07:55:42 [auto1.es] INFO: Found listing with ID: XW80315
2026-04-27 07:55:42 [auto1.es] INFO: Scrape type for XW80315: 1
2026-04-27 07:55:42 [auto1.es] INFO: Found listing with ID: RK72644
2026-04-27 07:55:42 [auto1.es] INFO: Scrape type for RK72644: 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_d213437b8676a7ee1fde496207707945.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_0b48dc62301eba2a227979091a51722d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_32de37466bffb174929054cbd72390dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621 with identifier: WW00174
2026-04-27 07:55:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621 with identifier: WW00174
2026-04-27 07:55:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c49a1ff-0ba6-5ac9-b5e5-6da96524c621 with identifier: WW00174 to the API
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:12:51Z',
'fuel_type': 'petrol',
'id': '3c49a1ff-0ba6-5ac9-b5e5-6da96524c621',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW00174',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 117962,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2000-05-31',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.3 1300',
'transmission': 'manual',
'trim': '1300',
'year': 2000}
2026-04-27 07:55:42 [auto1.es] INFO: Saving data for WW00174: {'auction_closing_time': 1777389171.0, 'created_time': 1777019055.982283, 'has_photos': True, 'last_price_update_time': 1777276542.454189}
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_fb406531e5336ce2286ba22695a42663.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_99e6b76c09b88ef549e4bd45eec38878.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 with identifier: KE93313
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_63309f2ca9974a0ea1409d97d8aab506.jpg not downloaded yet
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a949d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e14c9e8-c252-5eb4-b94c-6ccb90be8407/1e14c9e8-c252-5eb4-b94c-6ccb90be8407_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_268fd80b2aed149fe9f0adecb7fe3ce9.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e14c9e8-c252-5eb4-b94c-6ccb90be8407
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d6550>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_833404ecdbf583691223e73bf6847dbd.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fddd0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_c6a90b078867bf7c7468d24a2520f09b.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:55:42 [auto1.es] INFO: Found listing with ID: FL94661
2026-04-27 07:55:42 [auto1.es] INFO: Scrape type for FL94661: 2
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23cdb26-99b8-50fe-87c9-5043eefce341 with identifier: FL94661
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23cdb26-99b8-50fe-87c9-5043eefce341 with scrape type 2
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b23cdb26-99b8-50fe-87c9-5043eefce341 with scrape type 2
2026-04-27 07:55:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b23cdb26-99b8-50fe-87c9-5043eefce341, identifier: FL94661
2026-04-27 07:55:42 [auto1.es] INFO: Found listing with ID: UL42272
2026-04-27 07:55:42 [auto1.es] INFO: Scrape type for UL42272: 2
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 856526a8-6dc6-5857-8abf-eeab1bb710ad with identifier: UL42272
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 856526a8-6dc6-5857-8abf-eeab1bb710ad with scrape type 2
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 856526a8-6dc6-5857-8abf-eeab1bb710ad with scrape type 2
2026-04-27 07:55:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 856526a8-6dc6-5857-8abf-eeab1bb710ad, identifier: UL42272
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_16dda4dbd1b93e1741e57851163da9ea.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_3c69e51cd29dc42e4229596c26581a14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b23cdb26-99b8-50fe-87c9-5043eefce341 with identifier: FL94661
2026-04-27 07:55:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b23cdb26-99b8-50fe-87c9-5043eefce341 with identifier: FL94661
2026-04-27 07:55:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b23cdb26-99b8-50fe-87c9-5043eefce341 with identifier: FL94661 to the API
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:27:59Z',
'fuel_type': 'petrol',
'id': 'b23cdb26-99b8-50fe-87c9-5043eefce341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL94661',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 X',
'odometer': 23831,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2025-03-24',
'seller_name': None,
'title': 'Citroen C4 X 1.2 PureTech Mild-Hybrid Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2025}
2026-04-27 07:55:43 [auto1.es] INFO: Saving data for FL94661: {'auction_closing_time': 1777390079.0, 'created_time': 1777019686.331623, 'has_photos': True, 'last_price_update_time': 1777276543.261404}
2026-04-27 07:55:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 856526a8-6dc6-5857-8abf-eeab1bb710ad with identifier: UL42272
2026-04-27 07:55:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 856526a8-6dc6-5857-8abf-eeab1bb710ad with identifier: UL42272
2026-04-27 07:55:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 856526a8-6dc6-5857-8abf-eeab1bb710ad with identifier: UL42272 to the API
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:34:18Z',
'fuel_type': 'diesel',
'id': '856526a8-6dc6-5857-8abf-eeab1bb710ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL42272',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 189334,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-01-03',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2016}
2026-04-27 07:55:43 [auto1.es] INFO: Saving data for UL42272: {'auction_closing_time': 1777390458.0, 'created_time': 1777020441.233861, 'has_photos': True, 'last_price_update_time': 1777276543.589532}
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_b06567f3ef487d98367fe2fa3aa653a4.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_4e0c9f3308e8e27b59997de148688765.jpg not downloaded yet
2026-04-27 07:55:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_30ce7daf3b89264aceb75e05114d4e9a.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC68158> (referer: https://www.auto1.com/v1/car-details-view/VC68158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048836010>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_207ac6e937edadce0c809e10ee5da83f.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:43 [auto1.es] INFO: Found listing with ID: BG94034
2026-04-27 07:55:43 [auto1.es] INFO: Scrape type for BG94034: 1
2026-04-27 07:55:43 [auto1.es] INFO: Found listing with ID: GC86131
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for GC86131: 2
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fa6765e-607b-5762-9a8d-fd1e180bc1d5 with identifier: GC86131
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fa6765e-607b-5762-9a8d-fd1e180bc1d5 with scrape type 2
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fa6765e-607b-5762-9a8d-fd1e180bc1d5 with scrape type 2
2026-04-27 07:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1fa6765e-607b-5762-9a8d-fd1e180bc1d5, identifier: GC86131
2026-04-27 07:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048727790>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_0b48dc62301eba2a227979091a51722d.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870f650>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e14c9e8-c252-5eb4-b94c-6ccb90be8407/1e14c9e8-c252-5eb4-b94c-6ccb90be8407_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/ff/28ff2917079f4ab4c5754b373cb872d6/pa/SR89718_32de37466bffb174929054cbd72390dd.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e14c9e8-c252-5eb4-b94c-6ccb90be8407
2026-04-27 07:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1fa6765e-607b-5762-9a8d-fd1e180bc1d5 with identifier: GC86131
2026-04-27 07:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1fa6765e-607b-5762-9a8d-fd1e180bc1d5 with identifier: GC86131
2026-04-27 07:55:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1fa6765e-607b-5762-9a8d-fd1e180bc1d5 with identifier: GC86131 to the API
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:43:48Z',
'fuel_type': 'petrol',
'id': '1fa6765e-607b-5762-9a8d-fd1e180bc1d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC86131',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 94014,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2003-02-06',
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-04-27 07:55:44 [auto1.es] INFO: Saving data for GC86131: {'auction_closing_time': 1777391028.0, 'created_time': 1777020321.806917, 'has_photos': True, 'last_price_update_time': 1777276544.509345}
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_f3d5f98a52e91804c1ead1858faf5057.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_8cb6bb38f2f1313d1e34c10214efb51c.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_d6f6c01c99ddb78407406f9087058679.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN89364> (referer: https://www.auto1.com/v1/car-details-view/SN89364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG21633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_ec9cc1ef9d628e4961b7dc1c968e1ba1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: GY57218
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for GY57218: 1
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: LB05133
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for LB05133: 1
2026-04-27 07:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:44 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2014 | hits on page: 40
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f7bd0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_3c69e51cd29dc42e4229596c26581a14.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc81e69-f6a8-5895-aa39-13828b38365d with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_45a45662ad1accbadfe6297d35a3f83a.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_d2f0cbf8fd22214a9985de3660766ca8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_75119e7ec425e3fde3315c1adb37a5bd.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_973695c44432e9b1f67fe763bca47482.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_63309f2ca9974a0ea1409d97d8aab506.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: ZK75464
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for ZK75464: 1
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: WT06803
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for WT06803: 1
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: BR91881
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for BR91881: 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_2acf4bc51a1c17a0c577de448388e9c6.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF69614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_3f701bd8432e6472ee46118f03b7df99.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_789d3520656e4896ae75957eb6173b5a.jpg not downloaded yet
2026-04-27 07:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c0f5a6-79bf-5192-9c3d-330bc67fa5be with identifier: SN89364
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8fc05083bc3b7edfa86af74adc39dbbf.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048836ed0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_ec9cc1ef9d628e4961b7dc1c968e1ba1.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: YR57981
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for YR57981: 1
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: FW49739
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for FW49739: 1
2026-04-27 07:55:44 [auto1.es] INFO: Found listing with ID: CH36349
2026-04-27 07:55:44 [auto1.es] INFO: Scrape type for CH36349: 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dacfe94b6c19c928309438decfc96930.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_16dda4dbd1b93e1741e57851163da9ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_0b2226fd062810a84504100e3ad4cc67.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_13f6af1a90b914782af2bde73e1d40d2.jpg not downloaded yet
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_4e0c9f3308e8e27b59997de148688765.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_30ce7daf3b89264aceb75e05114d4e9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [auto1.es] INFO: Found listing with ID: DS58896
2026-04-27 07:55:45 [auto1.es] INFO: Scrape type for DS58896: 1
2026-04-27 07:55:45 [auto1.es] INFO: Found listing with ID: JV95856
2026-04-27 07:55:45 [auto1.es] INFO: Scrape type for JV95856: 1
2026-04-27 07:55:45 [auto1.es] INFO: Found listing with ID: JA46032
2026-04-27 07:55:45 [auto1.es] INFO: Scrape type for JA46032: 2
2026-04-27 07:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d27fd4-0cdd-5e87-af95-ec714471090e with identifier: JA46032
2026-04-27 07:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d27fd4-0cdd-5e87-af95-ec714471090e with scrape type 2
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26d27fd4-0cdd-5e87-af95-ec714471090e with scrape type 2
2026-04-27 07:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26d27fd4-0cdd-5e87-af95-ec714471090e, identifier: JA46032
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_29a38446f6cdbfb9e87dbc0a90d3c114.jpg not downloaded yet
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ86172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836dc50>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f84e4d-a125-5c76-a1c7-c7d13a33a488/c1f84e4d-a125-5c76-a1c7-c7d13a33a488_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_d2f0cbf8fd22214a9985de3660766ca8.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c3810>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_63309f2ca9974a0ea1409d97d8aab506.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_45a45662ad1accbadfe6297d35a3f83a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_d6f6c01c99ddb78407406f9087058679.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26d27fd4-0cdd-5e87-af95-ec714471090e with identifier: JA46032
2026-04-27 07:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26d27fd4-0cdd-5e87-af95-ec714471090e with identifier: JA46032
2026-04-27 07:55:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26d27fd4-0cdd-5e87-af95-ec714471090e with identifier: JA46032 to the API
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:26:56Z',
'fuel_type': 'diesel',
'id': '26d27fd4-0cdd-5e87-af95-ec714471090e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA46032',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'S-Max',
'odometer': 296876,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-04-19',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium S',
'transmission': 'automatic',
'trim': 'Titanium S',
'year': 2012}
2026-04-27 07:55:45 [auto1.es] INFO: Saving data for JA46032: {'auction_closing_time': 1777303616.0, 'created_time': 1777020720.329907, 'has_photos': True, 'last_price_update_time': 1777276545.739558}
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_0a2db49d8b7b96a3f4a934c5649e9faf.jpg not downloaded yet
2026-04-27 07:55:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM42549> (referer: https://www.auto1.com/v1/car-details-view/PM42549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_973695c44432e9b1f67fe763bca47482.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [auto1.es] INFO: Found listing with ID: SK85653
2026-04-27 07:55:45 [auto1.es] INFO: Scrape type for SK85653: 1
2026-04-27 07:55:45 [auto1.es] INFO: Found listing with ID: AT34418
2026-04-27 07:55:45 [auto1.es] INFO: Scrape type for AT34418: 1
2026-04-27 07:55:45 [auto1.es] INFO: Found listing with ID: VZ79262
2026-04-27 07:55:46 [auto1.es] INFO: Scrape type for VZ79262: 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_64427c69006bed43442c3d26a0fd0d73.jpg not downloaded yet
2026-04-27 07:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_84839ac77bacbbd04ed314f9578604ea.jpg not downloaded yet
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048456490>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf72b375-dd00-5ecb-94d6-cd47a4b397d1/bf72b375-dd00-5ecb-94d6-cd47a4b397d1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/a0/fba03b6e2266d0832ff8f9da9263ecc0/pa/DL65807_16dda4dbd1b93e1741e57851163da9ea.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf72b375-dd00-5ecb-94d6-cd47a4b397d1
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884c50>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_4e0c9f3308e8e27b59997de148688765.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bd710>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_30ce7daf3b89264aceb75e05114d4e9a.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:55:46 [auto1.es] INFO: Found listing with ID: ER14870
2026-04-27 07:55:46 [auto1.es] INFO: Scrape type for ER14870: 1
2026-04-27 07:55:46 [auto1.es] INFO: Found listing with ID: DW60608
2026-04-27 07:55:46 [auto1.es] INFO: Scrape type for DW60608: 1
2026-04-27 07:55:46 [auto1.es] INFO: Found listing with ID: DV40298
2026-04-27 07:55:46 [auto1.es] INFO: Scrape type for DV40298: 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_ea7490c45cbb2714fb317b9676a7e88d.jpg not downloaded yet
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c4fd0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_45a45662ad1accbadfe6297d35a3f83a.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048212bd0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_d6f6c01c99ddb78407406f9087058679.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dacfe94b6c19c928309438decfc96930.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_2bab905bbce38f0195fcc5ad3e99be69.jpg not downloaded yet
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_29a38446f6cdbfb9e87dbc0a90d3c114.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_13f6af1a90b914782af2bde73e1d40d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_0b2226fd062810a84504100e3ad4cc67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [auto1.es] INFO: Found listing with ID: NA64654
2026-04-27 07:55:46 [auto1.es] INFO: Scrape type for NA64654: 2
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with scrape type 2
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with scrape type 2
2026-04-27 07:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9, identifier: NA64654
2026-04-27 07:55:46 [auto1.es] INFO: Found listing with ID: JT84996
2026-04-27 07:55:46 [auto1.es] INFO: Scrape type for JT84996: 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dc31801eb9382fbd4776f3fb26ba443d.jpg not downloaded yet
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL48879> (referer: https://www.auto1.com/v1/car-details-view/CL48879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb92b0fc-748c-5159-9890-a8e4b420eba8 with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_f4865cb7937b6273370abb0f2cbae9b1.jpg not downloaded yet
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485cbdd0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_973695c44432e9b1f67fe763bca47482.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654
2026-04-27 07:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654
2026-04-27 07:55:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654 to the API
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:09:02Z',
'fuel_type': 'diesel',
'id': '708f0a8e-9f33-522c-b86b-0b4a09e7ccb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA64654',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 281934,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-04-26',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Last Edition',
'transmission': 'manual',
'trim': 'Last Edition',
'year': 2006}
2026-04-27 07:55:47 [auto1.es] INFO: Saving data for NA64654: {'auction_closing_time': 1777388942.0, 'created_time': 1777018459.434522, 'has_photos': True, 'last_price_update_time': 1777276547.009945}
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_524eb31f5f9beed60ac73fd5eeff72a2.jpg not downloaded yet
2026-04-27 07:55:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:47 [auto1.es] INFO: Found listing with ID: RF40380
2026-04-27 07:55:47 [auto1.es] INFO: Scrape type for RF40380: 1
2026-04-27 07:55:47 [auto1.es] INFO: Found listing with ID: RG93825
2026-04-27 07:55:47 [auto1.es] INFO: Scrape type for RG93825: 2
2026-04-27 07:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c37e24b-b3c5-5c73-9342-acfc3ffff050 with identifier: RG93825
2026-04-27 07:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c37e24b-b3c5-5c73-9342-acfc3ffff050 with scrape type 2
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c37e24b-b3c5-5c73-9342-acfc3ffff050 with scrape type 2
2026-04-27 07:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c37e24b-b3c5-5c73-9342-acfc3ffff050, identifier: RG93825
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_b3e75d7bf1e7a8ee0ab1538d0c559d91.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_ead1909903b002fbb6ab32eece0e57f0.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c37e24b-b3c5-5c73-9342-acfc3ffff050 with identifier: RG93825
2026-04-27 07:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c37e24b-b3c5-5c73-9342-acfc3ffff050 with identifier: RG93825
2026-04-27 07:55:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c37e24b-b3c5-5c73-9342-acfc3ffff050 with identifier: RG93825 to the API
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-04-27T15:36:03Z',
'fuel_type': 'diesel',
'id': '0c37e24b-b3c5-5c73-9342-acfc3ffff050',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG93825',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 34944,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-03-29',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2022}
2026-04-27 07:55:47 [auto1.es] INFO: Saving data for RG93825: {'auction_closing_time': 1777304163.0, 'created_time': 1777020862.734408, 'has_photos': True, 'last_price_update_time': 1777276547.718001}
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_d0373d95d044201604d578381c0959aa.jpg not downloaded yet
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481cc150>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dacfe94b6c19c928309438decfc96930.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488d2cd0>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_29a38446f6cdbfb9e87dbc0a90d3c114.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ec550>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_13f6af1a90b914782af2bde73e1d40d2.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887cb10>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_0b2226fd062810a84504100e3ad4cc67.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_ea7490c45cbb2714fb317b9676a7e88d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_84839ac77bacbbd04ed314f9578604ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [auto1.es] INFO: Found listing with ID: EX56252
2026-04-27 07:55:47 [auto1.es] INFO: Scrape type for EX56252: 2
2026-04-27 07:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00664450-66b7-510b-b60a-47d6e9cd174d with identifier: EX56252
2026-04-27 07:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00664450-66b7-510b-b60a-47d6e9cd174d with scrape type 2
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00664450-66b7-510b-b60a-47d6e9cd174d with scrape type 2
2026-04-27 07:55:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00664450-66b7-510b-b60a-47d6e9cd174d, identifier: EX56252
2026-04-27 07:55:48 [auto1.es] INFO: Found listing with ID: LA59477
2026-04-27 07:55:48 [auto1.es] INFO: Scrape type for LA59477: 1
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_20eeecde86b5ec50fe31aed8eee12831.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_7d676b9dc9f871626a9f9021ff61d0f7.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00664450-66b7-510b-b60a-47d6e9cd174d with identifier: EX56252
2026-04-27 07:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00664450-66b7-510b-b60a-47d6e9cd174d with identifier: EX56252
2026-04-27 07:55:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00664450-66b7-510b-b60a-47d6e9cd174d with identifier: EX56252 to the API
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:44:45Z',
'fuel_type': 'diesel',
'id': '00664450-66b7-510b-b60a-47d6e9cd174d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX56252',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Kuga',
'odometer': 38188,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium Limited Edition',
'transmission': 'manual',
'trim': 'Titanium Limited Edition',
'year': 2019}
2026-04-27 07:55:48 [auto1.es] INFO: Saving data for EX56252: {'auction_closing_time': 1777391085.0, 'created_time': 1777020063.4652, 'has_photos': True, 'last_price_update_time': 1777276548.453432}
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8a5a4f2f9a6a0718fdc3835d059e9070.jpg not downloaded yet
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB45585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ14425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cb2c75-d89f-5c25-9dd0-e9a0539273ba with identifier: CL48879
2026-04-27 07:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba with scrape type 1
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_81251d5268c79b4eaf87609801029db6.jpg not downloaded yet
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_2bab905bbce38f0195fcc5ad3e99be69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [auto1.es] INFO: Found listing with ID: DW68209
2026-04-27 07:55:48 [auto1.es] INFO: Scrape type for DW68209: 2
2026-04-27 07:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 202288cf-1edf-5cfb-85c1-ca9d58ac34ef with identifier: DW68209
2026-04-27 07:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202288cf-1edf-5cfb-85c1-ca9d58ac34ef with scrape type 2
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 202288cf-1edf-5cfb-85c1-ca9d58ac34ef with scrape type 2
2026-04-27 07:55:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 202288cf-1edf-5cfb-85c1-ca9d58ac34ef, identifier: DW68209
2026-04-27 07:55:48 [auto1.es] INFO: Found listing with ID: YX28722
2026-04-27 07:55:48 [auto1.es] INFO: Scrape type for YX28722: 1
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_3aa64b2042a38a352e3c453647771655.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_98be3f40f1f64af7940d8601275e162c.jpg not downloaded yet
2026-04-27 07:55:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH03628> (referer: https://www.auto1.com/v1/car-details-view/GH03628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU45486> (referer: https://www.auto1.com/v1/car-details-view/EU45486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 202288cf-1edf-5cfb-85c1-ca9d58ac34ef with identifier: DW68209
2026-04-27 07:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 202288cf-1edf-5cfb-85c1-ca9d58ac34ef with identifier: DW68209
2026-04-27 07:55:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 202288cf-1edf-5cfb-85c1-ca9d58ac34ef with identifier: DW68209 to the API
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 204,
'expiration_date': '2026-04-28T15:47:01Z',
'fuel_type': 'diesel',
'id': '202288cf-1edf-5cfb-85c1-ca9d58ac34ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW68209',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A6',
'odometer': 197511,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2021}
2026-04-27 07:55:49 [auto1.es] INFO: Saving data for DW68209: {'auction_closing_time': 1777391221.0, 'created_time': 1777021260.256259, 'has_photos': True, 'last_price_update_time': 1777276549.176005}
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_a897a75d64f6e8b1c3bd68e7e3b7f8f1.jpg not downloaded yet
2026-04-27 07:55:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_c8cebc6f7e489fa585cc5ee06fb490a9.jpg not downloaded yet
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048862f50>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_ea7490c45cbb2714fb317b9676a7e88d.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894d1d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_84839ac77bacbbd04ed314f9578604ea.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:49 [auto1.es] INFO: Found listing with ID: VP80906
2026-04-27 07:55:49 [auto1.es] INFO: Scrape type for VP80906: 1
2026-04-27 07:55:49 [auto1.es] INFO: Found listing with ID: GM36563
2026-04-27 07:55:49 [auto1.es] INFO: Scrape type for GM36563: 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_66c7a3072f7aca29e1f170d12fc7da61.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB93661> (referer: https://www.auto1.com/v1/car-details-view/EB93661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8d728beed0161b0bbfc3a23ce969845a.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_65f359f07000f9383f88d6fa2b159ab9.jpg not downloaded yet
2026-04-27 07:55:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_20eeecde86b5ec50fe31aed8eee12831.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_d0373d95d044201604d578381c0959aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_ead1909903b002fbb6ab32eece0e57f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [auto1.es] INFO: Found listing with ID: DH25542
2026-04-27 07:55:49 [auto1.es] INFO: Scrape type for DH25542: 2
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa3b5449-de2d-5fc0-8b86-5e9106826330 with identifier: DH25542
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3b5449-de2d-5fc0-8b86-5e9106826330 with scrape type 2
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa3b5449-de2d-5fc0-8b86-5e9106826330 with scrape type 2
2026-04-27 07:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa3b5449-de2d-5fc0-8b86-5e9106826330, identifier: DH25542
2026-04-27 07:55:49 [auto1.es] INFO: Found listing with ID: GT44883
2026-04-27 07:55:49 [auto1.es] INFO: Scrape type for GT44883: 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_c5dbc0a77eecadc4f4f3b4e3c847a901.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG94034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048886450>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_2bab905bbce38f0195fcc5ad3e99be69.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3a5a72-1560-571f-b80b-a36f343dc2bd with identifier: GH03628
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3a5a72-1560-571f-b80b-a36f343dc2bd with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_f85cae5d44b34561171bd5bede034ae7.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e30c6087-daa6-5211-868a-cf365847f9f1 with identifier: EU45486
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e30c6087-daa6-5211-868a-cf365847f9f1 with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_41515405bc70e76dba5fbfe58e9cf01b.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_7d676b9dc9f871626a9f9021ff61d0f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa3b5449-de2d-5fc0-8b86-5e9106826330 with identifier: DH25542
2026-04-27 07:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa3b5449-de2d-5fc0-8b86-5e9106826330 with identifier: DH25542
2026-04-27 07:55:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aa3b5449-de2d-5fc0-8b86-5e9106826330 with identifier: DH25542 to the API
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-04-28T15:34:49Z',
'fuel_type': 'diesel',
'id': 'aa3b5449-de2d-5fc0-8b86-5e9106826330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH25542',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC90',
'odometer': 436848,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-07-31',
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2016}
2026-04-27 07:55:49 [auto1.es] INFO: Saving data for DH25542: {'auction_closing_time': 1777390489.0, 'created_time': 1777021780.328815, 'has_photos': True, 'last_price_update_time': 1777276549.994192}
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_ce69555252397d0637e53273d032d249.jpg not downloaded yet
2026-04-27 07:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_81251d5268c79b4eaf87609801029db6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [auto1.es] INFO: Found listing with ID: RY82802
2026-04-27 07:55:50 [auto1.es] INFO: Scrape type for RY82802: 1
2026-04-27 07:55:50 [auto1.es] INFO: Found listing with ID: MF04433
2026-04-27 07:55:50 [auto1.es] INFO: Scrape type for MF04433: 1
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7e24402e2e49463909c650b4cba17fca.jpg not downloaded yet
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_242d9ce6184d2d06e3045f850fcf1b3e.jpg not downloaded yet
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8a5a4f2f9a6a0718fdc3835d059e9070.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_3b5db0ea5a1089b3d22d2dc3c0c11f3c.jpg not downloaded yet
2026-04-27 07:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661
2026-04-27 07:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with scrape type 1
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_055abd7e40abeb1691321e96c92d9598.jpg not downloaded yet
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048340990>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_20eeecde86b5ec50fe31aed8eee12831.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048234190>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_d0373d95d044201604d578381c0959aa.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483799d0>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_ead1909903b002fbb6ab32eece0e57f0.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_66c7a3072f7aca29e1f170d12fc7da61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [auto1.es] INFO: Found listing with ID: LX85324
2026-04-27 07:55:50 [auto1.es] INFO: Scrape type for LX85324: 1
2026-04-27 07:55:50 [auto1.es] INFO: Found listing with ID: MN42055
2026-04-27 07:55:50 [auto1.es] INFO: Scrape type for MN42055: 1
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7093d842337e4d72bde6d7869cc2a93e.jpg not downloaded yet
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_31d1d7b28f5edfa9aea8fa42d4f70e3d.jpg not downloaded yet
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04847ac10>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_7d676b9dc9f871626a9f9021ff61d0f7.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_c8cebc6f7e489fa585cc5ee06fb490a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_9881589ae3328cec8cdee9fd556b15e5.jpg not downloaded yet
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_396e732f8cfc29ef544864cbb858443f.jpg not downloaded yet
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH36349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484acc10>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_81251d5268c79b4eaf87609801029db6.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8d728beed0161b0bbfc3a23ce969845a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [auto1.es] INFO: Found listing with ID: MB02716
2026-04-27 07:55:50 [auto1.es] INFO: Scrape type for MB02716: 2
2026-04-27 07:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d397e424-08d3-59a4-bf37-69a03f267d3d with identifier: MB02716
2026-04-27 07:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d397e424-08d3-59a4-bf37-69a03f267d3d with scrape type 2
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d397e424-08d3-59a4-bf37-69a03f267d3d with scrape type 2
2026-04-27 07:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d397e424-08d3-59a4-bf37-69a03f267d3d, identifier: MB02716
2026-04-27 07:55:50 [auto1.es] INFO: Found listing with ID: AS89718
2026-04-27 07:55:50 [auto1.es] INFO: Scrape type for AS89718: 1
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_10c6cc0c9aa9b081a7d59cf809d72e6e.jpg not downloaded yet
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_f7b72b6bfd021e2070afe6eed167486a.jpg not downloaded yet
2026-04-27 07:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838d450>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8a5a4f2f9a6a0718fdc3835d059e9070.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_65f359f07000f9383f88d6fa2b159ab9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_41515405bc70e76dba5fbfe58e9cf01b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d397e424-08d3-59a4-bf37-69a03f267d3d with identifier: MB02716
2026-04-27 07:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d397e424-08d3-59a4-bf37-69a03f267d3d with identifier: MB02716
2026-04-27 07:55:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d397e424-08d3-59a4-bf37-69a03f267d3d with identifier: MB02716 to the API
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-28T15:20:14Z',
'fuel_type': 'diesel',
'id': 'd397e424-08d3-59a4-bf37-69a03f267d3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB02716',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Combo Life',
'odometer': 181480,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-06-08',
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2020}
2026-04-27 07:55:51 [auto1.es] INFO: Saving data for MB02716: {'auction_closing_time': 1777389614.0, 'created_time': 1777018381.048936, 'has_photos': True, 'last_price_update_time': 1777276551.07073}
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_331d44fc0828a2db672e2138bef5af53.jpg not downloaded yet
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_35dba6ed8f69f75add0b746f3986a0d1.jpg not downloaded yet
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fb10>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_66c7a3072f7aca29e1f170d12fc7da61.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_ce69555252397d0637e53273d032d249.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [auto1.es] INFO: Found listing with ID: DU74019
2026-04-27 07:55:51 [auto1.es] INFO: Scrape type for DU74019: 1
2026-04-27 07:55:51 [auto1.es] INFO: Found listing with ID: JJ54433
2026-04-27 07:55:51 [auto1.es] INFO: Scrape type for JJ54433: 1
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b88106b1cf8a94b744409a2de6febf4f.jpg not downloaded yet
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_cef3e97c2e85335e08561f688cf6f8ba.jpg not downloaded yet
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_242d9ce6184d2d06e3045f850fcf1b3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_52c6b16d3e85dc475047dab3294e582c.jpg not downloaded yet
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_6491a0fb29dbeab603e6495123e25829.jpg not downloaded yet
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048820890>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_c8cebc6f7e489fa585cc5ee06fb490a9.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048462d50>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8d728beed0161b0bbfc3a23ce969845a.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:55:51 [auto1.es] INFO: Found listing with ID: CY83374
2026-04-27 07:55:51 [auto1.es] INFO: Scrape type for CY83374: 2
2026-04-27 07:55:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49fe0b4a-a53a-5829-8400-3ebd004412e1 with identifier: CY83374
2026-04-27 07:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49fe0b4a-a53a-5829-8400-3ebd004412e1 with scrape type 2
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49fe0b4a-a53a-5829-8400-3ebd004412e1 with scrape type 2
2026-04-27 07:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49fe0b4a-a53a-5829-8400-3ebd004412e1, identifier: CY83374
2026-04-27 07:55:51 [auto1.es] INFO: Found listing with ID: PD96380
2026-04-27 07:55:51 [auto1.es] INFO: Scrape type for PD96380: 1
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_5b53ca5a2e92a970bd04fb08945e8fd1.jpg not downloaded yet
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_421942afddd0d2b445a9f4dd5cd7f0f9.jpg not downloaded yet
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW49739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR57981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF69614> (referer: https://www.auto1.com/v1/car-details-view/GF69614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ86172> (referer: https://www.auto1.com/v1/car-details-view/GJ86172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a95190>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_65f359f07000f9383f88d6fa2b159ab9.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a38c50>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_41515405bc70e76dba5fbfe58e9cf01b.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_396e732f8cfc29ef544864cbb858443f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_9881589ae3328cec8cdee9fd556b15e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7093d842337e4d72bde6d7869cc2a93e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_31d1d7b28f5edfa9aea8fa42d4f70e3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49fe0b4a-a53a-5829-8400-3ebd004412e1 with identifier: CY83374
2026-04-27 07:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49fe0b4a-a53a-5829-8400-3ebd004412e1 with identifier: CY83374
2026-04-27 07:55:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49fe0b4a-a53a-5829-8400-3ebd004412e1 with identifier: CY83374 to the API
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:54:34Z',
'fuel_type': 'petrol',
'id': '49fe0b4a-a53a-5829-8400-3ebd004412e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY83374',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 118702,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-10-16',
'seller_name': None,
'title': 'Renault Megane 1.2 GT-Style',
'transmission': 'manual',
'trim': 'GT-Style',
'year': 2013}
2026-04-27 07:55:52 [auto1.es] INFO: Saving data for CY83374: {'auction_closing_time': 1777305274.0, 'created_time': 1777020813.917741, 'has_photos': True, 'last_price_update_time': 1777276552.344315}
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_03cb231d40516667cbc857a9d0f5dfbf.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_caa7295d1e6fe59139113f010fd5cfda.jpg not downloaded yet
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV40298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:52 [auto1.es] INFO: Found listing with ID: DB60699
2026-04-27 07:55:52 [auto1.es] INFO: Scrape type for DB60699: 1
2026-04-27 07:55:52 [auto1.es] INFO: Found listing with ID: MT83895
2026-04-27 07:55:52 [auto1.es] INFO: Scrape type for MT83895: 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_020386717a78606eaee6852b378a5082.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_a3337ae058178aae63a3a327e9246cb6.jpg not downloaded yet
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048870fd0>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_ce69555252397d0637e53273d032d249.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484795d0>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_242d9ce6184d2d06e3045f850fcf1b3e.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_f7b72b6bfd021e2070afe6eed167486a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_7f24b0f8f8c83fbfaa0502e1ffea0fcc.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_489343237d885bba170f2572cc408b8b.jpg not downloaded yet
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_35dba6ed8f69f75add0b746f3986a0d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [auto1.es] INFO: Found listing with ID: HD96692
2026-04-27 07:55:52 [auto1.es] INFO: Scrape type for HD96692: 2
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8203dd35-a59c-502b-8aa6-d774af0c2753 with identifier: HD96692
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8203dd35-a59c-502b-8aa6-d774af0c2753 with scrape type 2
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8203dd35-a59c-502b-8aa6-d774af0c2753 with scrape type 2
2026-04-27 07:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8203dd35-a59c-502b-8aa6-d774af0c2753, identifier: HD96692
2026-04-27 07:55:52 [auto1.es] INFO: Found listing with ID: DB92602
2026-04-27 07:55:52 [auto1.es] INFO: Scrape type for DB92602: 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b0d8428c26f52e757f61b716bd9f7b6a.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_64de8489ad727518be5b8540ffe5119f.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ddaae84-6c58-5e10-942c-bda08df5ef49 with identifier: GF69614
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ddaae84-6c58-5e10-942c-bda08df5ef49 with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_c46ff08d57284ac411e20c448d9fce2b.jpg not downloaded yet
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eec026b-58ea-5c45-ab2d-065ecf6b1561 with identifier: GJ86172
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561 with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_539a2660046488958725cd47f0e6a41b.jpg not downloaded yet
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c6d10>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_396e732f8cfc29ef544864cbb858443f.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869d890>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_9881589ae3328cec8cdee9fd556b15e5.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714950>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7093d842337e4d72bde6d7869cc2a93e.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ae190>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_31d1d7b28f5edfa9aea8fa42d4f70e3d.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8203dd35-a59c-502b-8aa6-d774af0c2753 with identifier: HD96692
2026-04-27 07:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8203dd35-a59c-502b-8aa6-d774af0c2753 with identifier: HD96692
2026-04-27 07:55:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8203dd35-a59c-502b-8aa6-d774af0c2753 with identifier: HD96692 to the API
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:19:52Z',
'fuel_type': 'petrol',
'id': '8203dd35-a59c-502b-8aa6-d774af0c2753',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD96692',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Fabia',
'odometer': 63812,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-01-25',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Comfort Line',
'transmission': 'manual',
'trim': 'Comfort Line',
'year': 2007}
2026-04-27 07:55:53 [auto1.es] INFO: Saving data for HD96692: {'auction_closing_time': 1777303192.0, 'created_time': 1777020679.074466, 'has_photos': True, 'last_price_update_time': 1777276553.341582}
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_e251d31b5ec5a0e5993ffd256749cdba.jpg not downloaded yet
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA59477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:53 [auto1.es] INFO: Found listing with ID: UN89621
2026-04-27 07:55:53 [auto1.es] INFO: Scrape type for UN89621: 1
2026-04-27 07:55:53 [auto1.es] INFO: Found listing with ID: TW09945
2026-04-27 07:55:53 [auto1.es] INFO: Scrape type for TW09945: 1
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_e9a0cef7eb66e08015852bf7a3770ac8.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_e0ee7fe915d0cab7c64fa73a51c7711d.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_cee76bfaf2e6166a0a76f6d117bedcba.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_9b51e206300f6c69e78b9d3f2e318146.jpg not downloaded yet
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_52c6b16d3e85dc475047dab3294e582c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_cef3e97c2e85335e08561f688cf6f8ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_421942afddd0d2b445a9f4dd5cd7f0f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b88106b1cf8a94b744409a2de6febf4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_6491a0fb29dbeab603e6495123e25829.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_5b53ca5a2e92a970bd04fb08945e8fd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_d5e1a62234e1f3fc1dc3abf6d37a0aa7.jpg not downloaded yet
2026-04-27 07:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04849f790>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_f7b72b6bfd021e2070afe6eed167486a.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a1b050>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_35dba6ed8f69f75add0b746f3986a0d1.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_caa7295d1e6fe59139113f010fd5cfda.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [auto1.es] INFO: Found listing with ID: ES62151
2026-04-27 07:55:53 [auto1.es] INFO: Scrape type for ES62151: 1
2026-04-27 07:55:53 [auto1.es] INFO: Found listing with ID: TV69131
2026-04-27 07:55:53 [auto1.es] INFO: Scrape type for TV69131: 2
2026-04-27 07:55:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f with identifier: TV69131
2026-04-27 07:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f with scrape type 2
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f with scrape type 2
2026-04-27 07:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f, identifier: TV69131
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_03ef14a773ecf7fccdbc7aca8bd2f3c9.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_88c2b1bf9f5005675bfcff818d49aced.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_27b20783a19908efedddb34195da73db.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_5cb39cce14c963de5396c4db77c3a2c0.jpg not downloaded yet
2026-04-27 07:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f with identifier: TV69131
2026-04-27 07:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f with identifier: TV69131
2026-04-27 07:55:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d95b12d-2a8f-513b-b8e1-09d6edb22f3f with identifier: TV69131 to the API
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:54:21Z',
'fuel_type': 'diesel',
'id': '5d95b12d-2a8f-513b-b8e1-09d6edb22f3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV69131',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 97860,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-12-21',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2016}
2026-04-27 07:55:54 [auto1.es] INFO: Saving data for TV69131: {'auction_closing_time': 1777305261.0, 'created_time': 1777020846.728727, 'has_photos': True, 'last_price_update_time': 1777276554.195138}
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_844cca037120dab0dd0d9652421f1972.jpg not downloaded yet
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM36563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_a3337ae058178aae63a3a327e9246cb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [auto1.es] INFO: Found listing with ID: BR91881
2026-04-27 07:55:54 [auto1.es] INFO: Found listing with ID: MH00523
2026-04-27 07:55:54 [auto1.es] INFO: Scrape type for MH00523: 2
2026-04-27 07:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebac8e98-9f0b-5d7d-97aa-5847e7fd4934 with identifier: MH00523
2026-04-27 07:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebac8e98-9f0b-5d7d-97aa-5847e7fd4934 with scrape type 2
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebac8e98-9f0b-5d7d-97aa-5847e7fd4934 with scrape type 2
2026-04-27 07:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ebac8e98-9f0b-5d7d-97aa-5847e7fd4934, identifier: MH00523
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_07e10450fe9a662896c4d15b823a6c2a.jpg not downloaded yet
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c4c24170be3a2b06ed8b7e46d5c76aff.jpg not downloaded yet
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484716d0>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_52c6b16d3e85dc475047dab3294e582c.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853810>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_cef3e97c2e85335e08561f688cf6f8ba.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485da510>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_421942afddd0d2b445a9f4dd5cd7f0f9.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048628ad0>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b88106b1cf8a94b744409a2de6febf4f.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048610e90>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_6491a0fb29dbeab603e6495123e25829.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048211d50>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_5b53ca5a2e92a970bd04fb08945e8fd1.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ebac8e98-9f0b-5d7d-97aa-5847e7fd4934 with identifier: MH00523
2026-04-27 07:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ebac8e98-9f0b-5d7d-97aa-5847e7fd4934 with identifier: MH00523
2026-04-27 07:55:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ebac8e98-9f0b-5d7d-97aa-5847e7fd4934 with identifier: MH00523 to the API
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:36:13Z',
'fuel_type': 'diesel',
'id': 'ebac8e98-9f0b-5d7d-97aa-5847e7fd4934',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH00523',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 423170,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-09-28',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Momentum 2WD',
'transmission': 'manual',
'trim': 'Momentum 2WD',
'year': 2011}
2026-04-27 07:55:55 [auto1.es] INFO: Saving data for MH00523: {'auction_closing_time': 1777304173.0, 'created_time': 1777020728.30535, 'has_photos': True, 'last_price_update_time': 1777276555.083709}
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_1543fa5c80c4784748aae045bf8eec19.jpg not downloaded yet
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB55085> (referer: https://www.auto1.com/v1/car-details-view/HB55085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048865350>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_caa7295d1e6fe59139113f010fd5cfda.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_c46ff08d57284ac411e20c448d9fce2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_539a2660046488958725cd47f0e6a41b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_64de8489ad727518be5b8540ffe5119f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_e251d31b5ec5a0e5993ffd256749cdba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [auto1.es] INFO: Found listing with ID: SH74673
2026-04-27 07:55:55 [auto1.es] INFO: Scrape type for SH74673: 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_130c2329a72fc14e5282663a2be169a6.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_1df522eedf8e6263bfa74d16a1ae9845.jpg not downloaded yet
2026-04-27 07:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_9b51e206300f6c69e78b9d3f2e318146.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1150>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_a3337ae058178aae63a3a327e9246cb6.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:55 [auto1.es] INFO: Found listing with ID: AR83818
2026-04-27 07:55:55 [auto1.es] INFO: Scrape type for AR83818: 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_4e0f3829646ecc702f99ab696a783775.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_143bfa23d37e5bf3c48f67b9ed0bf720.jpg not downloaded yet
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP80906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085
2026-04-27 07:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423e501a-28ee-5602-859b-ce18172ab882 with scrape type 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_052ba51807c05069b9552bc858b993a1.jpg not downloaded yet
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_5cb39cce14c963de5396c4db77c3a2c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [auto1.es] INFO: Found listing with ID: RB94972
2026-04-27 07:55:55 [auto1.es] INFO: Scrape type for RB94972: 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_b1da75182072c061a566b6bc0f363793.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_8ab721d11d30f7f951218983fd71f863.jpg not downloaded yet
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837e590>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_c46ff08d57284ac411e20c448d9fce2b.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b8490>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_539a2660046488958725cd47f0e6a41b.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048783e50>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_64de8489ad727518be5b8540ffe5119f.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048859190>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_e251d31b5ec5a0e5993ffd256749cdba.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_27b20783a19908efedddb34195da73db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_ffb77122e8af35003aacecbb411bfa44.jpg not downloaded yet
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH36349> (referer: https://www.auto1.com/v1/car-details-view/CH36349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048581a50>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_9b51e206300f6c69e78b9d3f2e318146.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_88c2b1bf9f5005675bfcff818d49aced.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_1543fa5c80c4784748aae045bf8eec19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c4c24170be3a2b06ed8b7e46d5c76aff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_844cca037120dab0dd0d9652421f1972.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [auto1.es] INFO: Found listing with ID: SC66247
2026-04-27 07:55:55 [auto1.es] INFO: Scrape type for SC66247: 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_fae5ade7b5387b87df1ad5e088306c1e.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_87a31b54145c8a1f9b1914ae896d1830.jpg not downloaded yet
2026-04-27 07:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_07e10450fe9a662896c4d15b823a6c2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_11db0a7bdcde7df4db791f527bfb87b6.jpg not downloaded yet
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048847050>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_5cb39cce14c963de5396c4db77c3a2c0.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:55 [auto1.es] INFO: Found listing with ID: YG93174
2026-04-27 07:55:55 [auto1.es] INFO: Scrape type for YG93174: 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_d4ff83639d75aee4b0be95873325d4e8.jpg not downloaded yet
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c6b064aa55313767f351a3dfd9690330.jpg not downloaded yet
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD96380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_143bfa23d37e5bf3c48f67b9ed0bf720.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_9c1863d051b6b94d6608d9cfb512eda4.jpg not downloaded yet
2026-04-27 07:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_052ba51807c05069b9552bc858b993a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [auto1.es] INFO: Found listing with ID: UY64124
2026-04-27 07:55:56 [auto1.es] INFO: Scrape type for UY64124: 2
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59abeabe-dba0-5c60-b52b-e2da25a50192 with identifier: UY64124
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59abeabe-dba0-5c60-b52b-e2da25a50192 with scrape type 2
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59abeabe-dba0-5c60-b52b-e2da25a50192 with scrape type 2
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 59abeabe-dba0-5c60-b52b-e2da25a50192, identifier: UY64124
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_f66ca9ffe5ef5ee13eb147ff47168ee8.jpg not downloaded yet
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_cd4ad280e496310c3d2c7461c4424f18.jpg not downloaded yet
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048747250>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_27b20783a19908efedddb34195da73db.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69ae208-d97b-58c7-a630-ecbe822d6f6e with identifier: CH36349
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69ae208-d97b-58c7-a630-ecbe822d6f6e with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_6c52be630efd5e227d8085e4d4c2b6f4.jpg not downloaded yet
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488d3e50>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_88c2b1bf9f5005675bfcff818d49aced.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048342790>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_1543fa5c80c4784748aae045bf8eec19.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869ebd0>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c4c24170be3a2b06ed8b7e46d5c76aff.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7aa50>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_844cca037120dab0dd0d9652421f1972.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_4e0f3829646ecc702f99ab696a783775.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_8ab721d11d30f7f951218983fd71f863.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 59abeabe-dba0-5c60-b52b-e2da25a50192 with identifier: UY64124
2026-04-27 07:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 59abeabe-dba0-5c60-b52b-e2da25a50192 with identifier: UY64124
2026-04-27 07:55:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 59abeabe-dba0-5c60-b52b-e2da25a50192 with identifier: UY64124 to the API
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:01:15Z',
'fuel_type': 'petrol',
'id': '59abeabe-dba0-5c60-b52b-e2da25a50192',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY64124',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 253968,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-15',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2009}
2026-04-27 07:55:57 [auto1.es] INFO: Saving data for UY64124: {'auction_closing_time': 1777302075.0, 'created_time': 1772028086.622324, 'has_photos': False, 'last_price_update_time': 1777276557.07626}
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_38b04c80828080ff49a8d7378351793b.jpg not downloaded yet
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_b1da75182072c061a566b6bc0f363793.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_ffb77122e8af35003aacecbb411bfa44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [auto1.es] INFO: Found listing with ID: SA01398
2026-04-27 07:55:57 [auto1.es] INFO: Scrape type for SA01398: 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_965bfcfd63329c7cc0be26c16098a7fa.jpg not downloaded yet
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV40298> (referer: https://www.auto1.com/v1/car-details-view/DV40298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG94034> (referer: https://www.auto1.com/v1/car-details-view/BG94034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488d3e10>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_07e10450fe9a662896c4d15b823a6c2a.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_a295fc9c38476a131bb6184dff28d757.jpg not downloaded yet
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ54433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR57981> (referer: https://www.auto1.com/v1/car-details-view/YR57981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a371d0>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_143bfa23d37e5bf3c48f67b9ed0bf720.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048688950>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_052ba51807c05069b9552bc858b993a1.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c6b064aa55313767f351a3dfd9690330.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [auto1.es] INFO: Found listing with ID: AX80040
2026-04-27 07:55:57 [auto1.es] INFO: Scrape type for AX80040: 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_699fe83616e9f72291c3fc16e2b82c77.jpg not downloaded yet
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04849f490>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_4e0f3829646ecc702f99ab696a783775.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff056e6bed0>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_8ab721d11d30f7f951218983fd71f863.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_d4ff83639d75aee4b0be95873325d4e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_7fe717a3dbc78b0420b323300b00e3e2.jpg not downloaded yet
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_6c52be630efd5e227d8085e4d4c2b6f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_cd4ad280e496310c3d2c7461c4424f18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [auto1.es] INFO: Found listing with ID: YR99295
2026-04-27 07:55:57 [auto1.es] INFO: Scrape type for YR99295: 2
2026-04-27 07:55:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62862b4d-7bed-5193-a292-dab606b0d736 with identifier: YR99295
2026-04-27 07:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62862b4d-7bed-5193-a292-dab606b0d736 with scrape type 2
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62862b4d-7bed-5193-a292-dab606b0d736 with scrape type 2
2026-04-27 07:55:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62862b4d-7bed-5193-a292-dab606b0d736, identifier: YR99295
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_3e17bb5c7adb5329ba009f6d9d381bb0.jpg not downloaded yet
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b28d0>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_b1da75182072c061a566b6bc0f363793.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891f2d0>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_ffb77122e8af35003aacecbb411bfa44.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298
2026-04-27 07:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43842ab-152c-5aba-872a-bb6a49f17473 with scrape type 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2b46647b357d9ed0db2793c3997b6c21.jpg not downloaded yet
2026-04-27 07:55:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3240a3f-7ad3-5044-bf2d-73ccbae367fb with identifier: BG94034
2026-04-27 07:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb with scrape type 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_62fe367531575e6a9b40af911d1ee0d8.jpg not downloaded yet
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_9c1863d051b6b94d6608d9cfb512eda4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62862b4d-7bed-5193-a292-dab606b0d736 with identifier: YR99295
2026-04-27 07:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62862b4d-7bed-5193-a292-dab606b0d736 with identifier: YR99295
2026-04-27 07:55:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 62862b4d-7bed-5193-a292-dab606b0d736 with identifier: YR99295 to the API
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:56:27Z',
'fuel_type': 'diesel',
'id': '62862b4d-7bed-5193-a292-dab606b0d736',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR99295',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Mondeo',
'odometer': 134574,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-10-27',
'seller_name': None,
'title': 'Ford Mondeo 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-04-27 07:55:58 [auto1.es] INFO: Saving data for YR99295: {'auction_closing_time': 1777305387.0, 'created_time': 1777020833.360241, 'has_photos': True, 'last_price_update_time': 1777276558.121688}
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_230931953892f43950ced7ecee8ae4b6.jpg not downloaded yet
2026-04-27 07:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6beaabe-41cc-5ac6-9cb2-a465f962efba with identifier: YR57981
2026-04-27 07:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6beaabe-41cc-5ac6-9cb2-a465f962efba with scrape type 1
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_b2b98f3a1f5221a3bfb321972f64078d.jpg not downloaded yet
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ea3d0>
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c6b064aa55313767f351a3dfd9690330.jpg saved to cache
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_965bfcfd63329c7cc0be26c16098a7fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:58 [auto1.es] INFO: Found listing with ID: YA92841
2026-04-27 07:55:58 [auto1.es] INFO: Scrape type for YA92841: 2
2026-04-27 07:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6b79c5-aaa1-5a28-96e9-52e23807ee67 with identifier: YA92841
2026-04-27 07:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6b79c5-aaa1-5a28-96e9-52e23807ee67 with scrape type 2
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6b79c5-aaa1-5a28-96e9-52e23807ee67 with scrape type 2
2026-04-27 07:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de6b79c5-aaa1-5a28-96e9-52e23807ee67, identifier: YA92841
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_b2eebe9992e2c524ce7880f09a103e96.jpg not downloaded yet
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_5eb3803131f17ede0f75280cdf3831bd.jpg not downloaded yet
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_5da33c922ffd99af24627eb1cb6eefaf.jpg not downloaded yet
2026-04-27 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_11db0a7bdcde7df4db791f527bfb87b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_f66ca9ffe5ef5ee13eb147ff47168ee8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_38b04c80828080ff49a8d7378351793b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de6b79c5-aaa1-5a28-96e9-52e23807ee67 with identifier: YA92841
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de6b79c5-aaa1-5a28-96e9-52e23807ee67 with identifier: YA92841
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de6b79c5-aaa1-5a28-96e9-52e23807ee67 with identifier: YA92841 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:38:13Z',
'fuel_type': 'petrol',
'id': 'de6b79c5-aaa1-5a28-96e9-52e23807ee67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA92841',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Grand Modus',
'odometer': 120650,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-07-15',
'seller_name': None,
'title': 'Renault Grand Modus 1.6 Dynamique',
'transmission': 'automatic',
'trim': 'Dynamique',
'year': 2008}
2026-04-27 07:55:58 [auto1.es] INFO: Saving data for YA92841: {'auction_closing_time': 1777304293.0, 'created_time': 1777021300.736568, 'has_photos': True, 'last_price_update_time': 1777276558.853188}
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_09857f90d17aee89907f45ca928e869e.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_62147ffc018cc4b7301fc16d8ab2fbbd.jpg not downloaded yet
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ad950>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_d4ff83639d75aee4b0be95873325d4e8.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ef010>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_6c52be630efd5e227d8085e4d4c2b6f4.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048252090>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_cd4ad280e496310c3d2c7461c4424f18.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_699fe83616e9f72291c3fc16e2b82c77.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [auto1.es] INFO: Found listing with ID: ZM69944
2026-04-27 07:55:59 [auto1.es] INFO: Scrape type for ZM69944: 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_4b16dcf5ea354a342d21e76b00c3cb32.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1ffceae3690cc7ba824ce60d2fec19af.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b61a478184c3bdb4d80310a0cb3b94e9.jpg not downloaded yet
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW49739> (referer: https://www.auto1.com/v1/car-details-view/FW49739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048330d90>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_9c1863d051b6b94d6608d9cfb512eda4.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_0c57625131511e7889e891987d91b5ea.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4d62ef2fb5d1050905447d65368e14b3.jpg not downloaded yet
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB94972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM36563> (referer: https://www.auto1.com/v1/car-details-view/GM36563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484d5410>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_965bfcfd63329c7cc0be26c16098a7fa.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_7fe717a3dbc78b0420b323300b00e3e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [auto1.es] INFO: Found listing with ID: FM87418
2026-04-27 07:55:59 [auto1.es] INFO: Scrape type for FM87418: 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_5cb8f1687cb545576c10a98782ac8a54.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2de0b3716512f78efbc31b1bca91b736.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_78cb4628586db6132786eca81cca02bc.jpg not downloaded yet
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA59477> (referer: https://www.auto1.com/v1/car-details-view/LA59477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04888fbd0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_11db0a7bdcde7df4db791f527bfb87b6.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048855d50>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_f66ca9ffe5ef5ee13eb147ff47168ee8.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a4fd0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_38b04c80828080ff49a8d7378351793b.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_62fe367531575e6a9b40af911d1ee0d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_d178c573b7180894490a5b912fe80070.jpg not downloaded yet
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481b40d0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_699fe83616e9f72291c3fc16e2b82c77.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_b2b98f3a1f5221a3bfb321972f64078d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_230931953892f43950ced7ecee8ae4b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [auto1.es] INFO: Found listing with ID: KB52077
2026-04-27 07:55:59 [auto1.es] INFO: Scrape type for KB52077: 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_2a9a93401107bfab17bcf06541366bd7.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1f75651445e970041c193f162573286d.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b0464180325c1b155b74073d04d4eb98.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739
2026-04-27 07:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141be34-685c-5aae-bf76-6e9159ea9e94 with scrape type 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg not downloaded yet
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_5da33c922ffd99af24627eb1cb6eefaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_76a633e7a088462b3ef78da36847e327.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563
2026-04-27 07:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 372d5168-1e06-5ded-8186-c560498ffebb with scrape type 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_47bca8e2fb6130695abca0be8839d948.jpg not downloaded yet
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048570fd0>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_7fe717a3dbc78b0420b323300b00e3e2.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7093a15e-00e6-5335-99c6-f11151003bb7 with identifier: LA59477
2026-04-27 07:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7093a15e-00e6-5335-99c6-f11151003bb7 with scrape type 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_430d9f90039866bf5b91920dc24f59e6.jpg not downloaded yet
2026-04-27 07:55:59 [auto1.es] INFO: Found listing with ID: EZ94996
2026-04-27 07:55:59 [auto1.es] INFO: Scrape type for EZ94996: 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_587403c931f4c542938c857a6437c04c.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_e626674e33ef60ac2998f08c4d29876f.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_e2e902d44224f2edcfcce3385d7c599c.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg not downloaded yet
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_4b16dcf5ea354a342d21e76b00c3cb32.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b61a478184c3bdb4d80310a0cb3b94e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_62147ffc018cc4b7301fc16d8ab2fbbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_f10d8820d836728bf6338a1ed783365e.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_d47b782b064557669f64333ec4d35d5f.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_e659ffc1a695eab8811e2c9bdeae723a.jpg not downloaded yet
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1ffceae3690cc7ba824ce60d2fec19af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [auto1.es] INFO: Found listing with ID: EU88532
2026-04-27 07:55:59 [auto1.es] INFO: Scrape type for EU88532: 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_0d7502a810ea49d63b23f45429b840a9.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_098532bc4c5f86e98f4f7dda59ffb87d.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg not downloaded yet
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837e310>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_62fe367531575e6a9b40af911d1ee0d8.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885b90>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_b2b98f3a1f5221a3bfb321972f64078d.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dc110>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_230931953892f43950ced7ecee8ae4b6.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833ef90>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_5da33c922ffd99af24627eb1cb6eefaf.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_78cb4628586db6132786eca81cca02bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2de0b3716512f78efbc31b1bca91b736.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4d62ef2fb5d1050905447d65368e14b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_2f561b454385e6a8099cdced395c37a5.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_3426de5e9d57481ba4a752dec6378c98.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_0828546451041101d658c9bcd1b26c45.jpg not downloaded yet
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_0c57625131511e7889e891987d91b5ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [auto1.es] INFO: Found listing with ID: JR39532
2026-04-27 07:56:00 [auto1.es] INFO: Scrape type for JR39532: 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1036582f173b64145181e6e03f5fc77b.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg not downloaded yet
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR83818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4b9e3097ca2a7899d1a3f0e61be16517.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa34325443dcd2f9480abeb9a9ba39f7.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_b5c8f4e269fe082f7010f522a216c396.jpg not downloaded yet
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA01398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP80906> (referer: https://www.auto1.com/v1/car-details-view/VP80906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048695f50>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_4b16dcf5ea354a342d21e76b00c3cb32.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487819d0>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b61a478184c3bdb4d80310a0cb3b94e9.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485e6010>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_62147ffc018cc4b7301fc16d8ab2fbbd.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a971d0>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1ffceae3690cc7ba824ce60d2fec19af.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_587403c931f4c542938c857a6437c04c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [auto1.es] INFO: Found listing with ID: AK94783
2026-04-27 07:56:00 [auto1.es] INFO: Scrape type for AK94783: 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_a2f09af3717324e61bfc1838f50dc1c3.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg not downloaded yet
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_e659ffc1a695eab8811e2c9bdeae723a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_0f7dfdb156c8ab014e1a5ba9459d16c0.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa2de299f06d63e43ed54f2932903bb7.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_bb55e244f7cb597852a91ba2d0903ab5.jpg not downloaded yet
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048236490>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_78cb4628586db6132786eca81cca02bc.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048802150>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2de0b3716512f78efbc31b1bca91b736.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862b690>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4d62ef2fb5d1050905447d65368e14b3.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_d178c573b7180894490a5b912fe80070.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_e626674e33ef60ac2998f08c4d29876f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_d47b782b064557669f64333ec4d35d5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [auto1.es] INFO: Found listing with ID: VG63599
2026-04-27 07:56:00 [auto1.es] INFO: Scrape type for VG63599: 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_c4c1f77f3cea637bcd43fcaacdeeaa39.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg not downloaded yet
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_e2e902d44224f2edcfcce3385d7c599c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_f10d8820d836728bf6338a1ed783365e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_9da5ebae4788a051ce6f9252b46be42b.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_9456d12c58398f2b61daf354250950bf.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b9c836b190d357474a574f5b63f254d.jpg not downloaded yet
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_0828546451041101d658c9bcd1b26c45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [auto1.es] INFO: Found listing with ID: KK62636
2026-04-27 07:56:01 [auto1.es] INFO: Scrape type for KK62636: 2
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8201950c-2d4c-5017-8612-fb29b3d8e8ce with identifier: KK62636
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8201950c-2d4c-5017-8612-fb29b3d8e8ce with scrape type 2
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8201950c-2d4c-5017-8612-fb29b3d8e8ce with scrape type 2
2026-04-27 07:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8201950c-2d4c-5017-8612-fb29b3d8e8ce, identifier: KK62636
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg not downloaded yet
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c5790>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_0c57625131511e7889e891987d91b5ea.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91d6d39-35cd-571d-8fc8-685003fe5bf7 with identifier: VP80906
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91d6d39-35cd-571d-8fc8-685003fe5bf7 with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_8381da519b9d56fff1f18c4e93244bf5.jpg not downloaded yet
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048580190>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_587403c931f4c542938c857a6437c04c.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836a2d0>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_e659ffc1a695eab8811e2c9bdeae723a.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7b1d0>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_b5c8f4e269fe082f7010f522a216c396.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8201950c-2d4c-5017-8612-fb29b3d8e8ce with identifier: KK62636
2026-04-27 07:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8201950c-2d4c-5017-8612-fb29b3d8e8ce with identifier: KK62636
2026-04-27 07:56:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8201950c-2d4c-5017-8612-fb29b3d8e8ce with identifier: KK62636 to the API
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:57:03Z',
'fuel_type': 'diesel',
'id': '8201950c-2d4c-5017-8612-fb29b3d8e8ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK62636',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T5 Shuttle',
'odometer': 318387,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-02-19',
'seller_name': None,
'title': 'Volkswagen T5 Shuttle 2.5 TDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2006}
2026-04-27 07:56:02 [auto1.es] INFO: Saving data for KK62636: {'auction_closing_time': 1777305423.0, 'created_time': 1777020777.723971, 'has_photos': True, 'last_price_update_time': 1777276562.205815}
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_8b346662c19bb0a3493510666f66d0fc.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4b9e3097ca2a7899d1a3f0e61be16517.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa34325443dcd2f9480abeb9a9ba39f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_20b3e151f04d3bd45f1a73d8cd96ef4b.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX80040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG93174/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD96380> (referer: https://www.auto1.com/v1/car-details-view/PD96380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5f2c8749ab0e2917929ef35cf331bb4e.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ54433> (referer: https://www.auto1.com/v1/car-details-view/JJ54433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04899acd0>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_d178c573b7180894490a5b912fe80070.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048361a50>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_e626674e33ef60ac2998f08c4d29876f.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048845290>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_d47b782b064557669f64333ec4d35d5f.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b9b50>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_e2e902d44224f2edcfcce3385d7c599c.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048251490>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_f10d8820d836728bf6338a1ed783365e.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256950>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_0828546451041101d658c9bcd1b26c45.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1036582f173b64145181e6e03f5fc77b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_a2f09af3717324e61bfc1838f50dc1c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_3343dd87a3427fbbda64e4338a171841.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b82d8617a9bd926d36163776def03e6.jpg not downloaded yet
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048845650>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_b5c8f4e269fe082f7010f522a216c396.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823ee90>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_c4c1f77f3cea637bcd43fcaacdeeaa39.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_49fcd232e3c3c4a3d08fef393b34cbf4.jpg not downloaded yet
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822f850>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04867bad0>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4b9e3097ca2a7899d1a3f0e61be16517.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488935d0>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa34325443dcd2f9480abeb9a9ba39f7.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c0a775-97ea-5e1a-be67-4c322ffcf552 with identifier: PD96380
2026-04-27 07:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c0a775-97ea-5e1a-be67-4c322ffcf552 with scrape type 1
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_049636368c7367f2f7da4de796b4600c.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 with identifier: JJ54433
2026-04-27 07:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 with scrape type 1
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_dae03077ac80011286bf5104899a01c9.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b9c836b190d357474a574f5b63f254d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_9456d12c58398f2b61daf354250950bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_eb2c80e0f94653ec1e2b683d4efe97ca.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_8b346662c19bb0a3493510666f66d0fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_8381da519b9d56fff1f18c4e93244bf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_2659d66b59578eb665384be4ee75f4a9.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_8ae00245e963bc3e6f4f430762042a63.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_bb82eeaa05f0df3ba40e9b49d3db9c22.jpg not downloaded yet
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04867bcd0>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a4c10>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1036582f173b64145181e6e03f5fc77b.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486aad50>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_a2f09af3717324e61bfc1838f50dc1c3.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048aa5e90>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_9da5ebae4788a051ce6f9252b46be42b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_20b3e151f04d3bd45f1a73d8cd96ef4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_dfaa5ab264815e7801f0bb2c8c9debd1.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_5baf0f8d06e147fba024b13a28d0d2a5.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_fdc0a2ec634f8d3fa28d55f0f1cf68c3.jpg not downloaded yet
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824aa50>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_c4c1f77f3cea637bcd43fcaacdeeaa39.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848ee50>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b9c836b190d357474a574f5b63f254d.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824fe90>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_9456d12c58398f2b61daf354250950bf.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838c950>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_8b346662c19bb0a3493510666f66d0fc.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a41110>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_8381da519b9d56fff1f18c4e93244bf5.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048886450>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_bb55e244f7cb597852a91ba2d0903ab5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_c5dcfeec3a8f24137d17ba1bd31fdeea.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_af05c43bdea448cdd1bc750b9d3863a0.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_173e9936eb74cd905e177843eb253cba.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5f2c8749ab0e2917929ef35cf331bb4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa2de299f06d63e43ed54f2932903bb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_dae03077ac80011286bf5104899a01c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_049636368c7367f2f7da4de796b4600c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_3343dd87a3427fbbda64e4338a171841.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_52c0e1424862c2799a58e7dbf25f6576.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_57c0b648390238ff529118a9197b7df8.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_30126183daa2be9ecfbec8c0d4e173ac.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG63599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04829fb50>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_9da5ebae4788a051ce6f9252b46be42b.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04829dc90>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_20b3e151f04d3bd45f1a73d8cd96ef4b.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ba990>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_eb2c80e0f94653ec1e2b683d4efe97ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_11625dd6d8afa57985ab0d475aad4778.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_eb84d121970d6aea931440a75abbb9a1.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_e1f33bb63876b67946b027e7e2476af2.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_49fcd232e3c3c4a3d08fef393b34cbf4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK94783/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a5dad0>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_bb55e244f7cb597852a91ba2d0903ab5.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a94810>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5f2c8749ab0e2917929ef35cf331bb4e.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04888d1d0>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa2de299f06d63e43ed54f2932903bb7.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823d050>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_dae03077ac80011286bf5104899a01c9.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048977f50>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_049636368c7367f2f7da4de796b4600c.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823d350>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_3343dd87a3427fbbda64e4338a171841.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_af05c43bdea448cdd1bc750b9d3863a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_7dae5a2ddbaa1b41d7ac6472bd926f75.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_2393c05bd0bb592ef7568365f9ddff58.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_bb82eeaa05f0df3ba40e9b49d3db9c22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_c5dcfeec3a8f24137d17ba1bd31fdeea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_173e9936eb74cd905e177843eb253cba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_fdc0a2ec634f8d3fa28d55f0f1cf68c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_8ae00245e963bc3e6f4f430762042a63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_924989656ada657e3f677fad73c8be7d.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA01398> (referer: https://www.auto1.com/v1/car-details-view/SA01398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR83818> (referer: https://www.auto1.com/v1/car-details-view/AR83818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3fed0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_eb2c80e0f94653ec1e2b683d4efe97ca.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cf690>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_49fcd232e3c3c4a3d08fef393b34cbf4.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_5baf0f8d06e147fba024b13a28d0d2a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_57c0b648390238ff529118a9197b7df8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_0d62d3915bb78c90b39638505f8a327a.jpg not downloaded yet
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_2659d66b59578eb665384be4ee75f4a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_30126183daa2be9ecfbec8c0d4e173ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_dfaa5ab264815e7801f0bb2c8c9debd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ee250>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_af05c43bdea448cdd1bc750b9d3863a0.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846ded0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_bb82eeaa05f0df3ba40e9b49d3db9c22.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b0ed0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_c5dcfeec3a8f24137d17ba1bd31fdeea.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a36dd0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_173e9936eb74cd905e177843eb253cba.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b2650>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_fdc0a2ec634f8d3fa28d55f0f1cf68c3.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486aa050>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_8ae00245e963bc3e6f4f430762042a63.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_e1f33bb63876b67946b027e7e2476af2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_4edfe2eb6ebfe28c4a5f1241e919d70a.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_52c0e1424862c2799a58e7dbf25f6576.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_eb84d121970d6aea931440a75abbb9a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_11625dd6d8afa57985ab0d475aad4778.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG93174> (referer: https://www.auto1.com/v1/car-details-view/YG93174/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 519f062f-7f34-58b9-8964-02cfe26a09a3 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_9a1cd6ad6cdc49d7717636439f553ece.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_1a21bf26dc078b51c6ff36691950a79b.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048821d10>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_5baf0f8d06e147fba024b13a28d0d2a5.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04867b750>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_57c0b648390238ff529118a9197b7df8.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b82d8617a9bd926d36163776def03e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_7dae5a2ddbaa1b41d7ac6472bd926f75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_2393c05bd0bb592ef7568365f9ddff58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_07c6a983fd5c9ec36a20c9c06bfc8515.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4fb693bcf3c2f82759a0cff890f905b3.jpg not downloaded yet
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a3f50>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_2659d66b59578eb665384be4ee75f4a9.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3fbd0>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_30126183daa2be9ecfbec8c0d4e173ac.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a2910>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_dfaa5ab264815e7801f0bb2c8c9debd1.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484f95d0>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_e1f33bb63876b67946b027e7e2476af2.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048735c10>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_52c0e1424862c2799a58e7dbf25f6576.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04878d810>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_eb84d121970d6aea931440a75abbb9a1.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65c0a775-97ea-5e1a-be67-4c322ffcf552
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65c0a775-97ea-5e1a-be67-4c322ffcf552, skipping ID generation
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c0a775-97ea-5e1a-be67-4c322ffcf552 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65c0a775-97ea-5e1a-be67-4c322ffcf552 sending to next pipeline
2026-04-27 07:56:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65c0a775-97ea-5e1a-be67-4c322ffcf552, identifier: PD96380
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487e1750>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_11625dd6d8afa57985ab0d475aad4778.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5221bc-734e-5017-80e8-3c863f217aac with identifier: YG93174
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5221bc-734e-5017-80e8-3c863f217aac with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_4a5ea22d517e0c8cf6af4175a31d99ff.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_bbb066e0784db8af31c826644e750783.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_65719e335f2c7d75ca8081377e8ecc88.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65c0a775-97ea-5e1a-be67-4c322ffcf552 with identifier: PD96380
2026-04-27 07:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65c0a775-97ea-5e1a-be67-4c322ffcf552 with identifier: PD96380
2026-04-27 07:56:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65c0a775-97ea-5e1a-be67-4c322ffcf552 with identifier: PD96380 to the API
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_eb84d121970d6aea931440a75abbb9a1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Esquivias',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:30:26Z',
'fuel_type': 'diesel',
'id': '65c0a775-97ea-5e1a-be67-4c322ffcf552',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD96380',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Citroen',
'model': 'C4',
'odometer': 261447,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_049636368c7367f2f7da4de796b4600c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_8ae00245e963bc3e6f4f430762042a63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_5baf0f8d06e147fba024b13a28d0d2a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_af05c43bdea448cdd1bc750b9d3863a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_57c0b648390238ff529118a9197b7df8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65c0a775-97ea-5e1a-be67-4c322ffcf552/65c0a775-97ea-5e1a-be67-4c322ffcf552_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/4d/614d97e3d9aa60c9cb6e50d289d64bb6/pa/PD96380_eb84d121970d6aea931440a75abbb9a1.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2009-08-17',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2009}
2026-04-27 07:56:06 [auto1.es] INFO: Saving data for PD96380: {'created_time': 1777276566.510845, 'last_price_update_time': 1777276566.510855, 'has_photos': True, 'auction_closing_time': 1777303826.0}
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_098532bc4c5f86e98f4f7dda59ffb87d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_0d62d3915bb78c90b39638505f8a327a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_aa82dca7b9bc82d57bb3936efec6d112.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_924989656ada657e3f677fad73c8be7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_3426de5e9d57481ba4a752dec6378c98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_0f7dfdb156c8ab014e1a5ba9459d16c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_2f561b454385e6a8099cdced395c37a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0b3f95ca0f1edf9f6ddf2cbeb139c5e5.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_bd9e65688e6ee7869ddb38c465b0e1d1.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX80040> (referer: https://www.auto1.com/v1/car-details-view/AX80040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG63599> (referer: https://www.auto1.com/v1/car-details-view/VG63599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b6a90>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b82d8617a9bd926d36163776def03e6.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048694890>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e3e10>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_7dae5a2ddbaa1b41d7ac6472bd926f75.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f91d6d39-35cd-571d-8fc8-685003fe5bf7
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f91d6d39-35cd-571d-8fc8-685003fe5bf7, skipping ID generation
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91d6d39-35cd-571d-8fc8-685003fe5bf7 with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f91d6d39-35cd-571d-8fc8-685003fe5bf7 sending to next pipeline
2026-04-27 07:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f91d6d39-35cd-571d-8fc8-685003fe5bf7, identifier: VP80906
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048694790>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_2393c05bd0bb592ef7568365f9ddff58.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_4edfe2eb6ebfe28c4a5f1241e919d70a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_b2a1b6c886361e183e4a45b71f80f9ce.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f91d6d39-35cd-571d-8fc8-685003fe5bf7 with identifier: VP80906
2026-04-27 07:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f91d6d39-35cd-571d-8fc8-685003fe5bf7 with identifier: VP80906
2026-04-27 07:56:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f91d6d39-35cd-571d-8fc8-685003fe5bf7 with identifier: VP80906 to the API
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_7dae5a2ddbaa1b41d7ac6472bd926f75.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'A Cañiza Pontevedra',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.4L',
'engine_horse_power': 215,
'expiration_date': '2026-04-28T15:26:54Z',
'fuel_type': 'diesel',
'id': 'f91d6d39-35cd-571d-8fc8-685003fe5bf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP80906',
'listing': 'auction',
'location': 'ES, A Cañiza Pontevedra',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 121608,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_8381da519b9d56fff1f18c4e93244bf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_20b3e151f04d3bd45f1a73d8cd96ef4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_3343dd87a3427fbbda64e4338a171841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_49fcd232e3c3c4a3d08fef393b34cbf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_2659d66b59578eb665384be4ee75f4a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_dfaa5ab264815e7801f0bb2c8c9debd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_c5dcfeec3a8f24137d17ba1bd31fdeea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_52c0e1424862c2799a58e7dbf25f6576.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_11625dd6d8afa57985ab0d475aad4778.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f91d6d39-35cd-571d-8fc8-685003fe5bf7/f91d6d39-35cd-571d-8fc8-685003fe5bf7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/c8/8ec842a7bafa8b842824e6ee49d5f3eb/pa/VP80906_7dae5a2ddbaa1b41d7ac6472bd926f75.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-08-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2011}
2026-04-27 07:56:07 [auto1.es] INFO: Saving data for VP80906: {'created_time': 1777276567.375428, 'last_price_update_time': 1777276567.375438, 'has_photos': True, 'auction_closing_time': 1777390014.0}
2026-04-27 07:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_3092f50a146ee9deb009f8961728e330.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4dc65d324d4d4c5fbed462257bd61017.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_0d7502a810ea49d63b23f45429b840a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_be5df9435ca5c1f00ecf5827f62e5016.jpg not downloaded yet
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37250>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c1b50>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_098532bc4c5f86e98f4f7dda59ffb87d.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862b5d0>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_0d62d3915bb78c90b39638505f8a327a.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a5590>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_924989656ada657e3f677fad73c8be7d.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0590>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_3426de5e9d57481ba4a752dec6378c98.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048628650>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_0f7dfdb156c8ab014e1a5ba9459d16c0.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487b9a50>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_2f561b454385e6a8099cdced395c37a5.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1310e7d-f55d-5cab-bbd6-dcc33019c701 with identifier: AX80040
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1310e7d-f55d-5cab-bbd6-dcc33019c701 with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d1149643e39bae8d41b6d95036d0d277.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f51ea11-75f9-5055-9cec-eed6383397da with identifier: VG63599
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f51ea11-75f9-5055-9cec-eed6383397da with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_68deaed29af48b0fb2d6b07657ca1fd7.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_1a21bf26dc078b51c6ff36691950a79b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_2e4e521e4b0d25cdc86489df28b44a3d.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_425adbfdb47c6e3f74c04e2b7129a8fe.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_bbb066e0784db8af31c826644e750783.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_07c6a983fd5c9ec36a20c9c06bfc8515.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_4a5ea22d517e0c8cf6af4175a31d99ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_9a1cd6ad6cdc49d7717636439f553ece.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_65719e335f2c7d75ca8081377e8ecc88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4fb693bcf3c2f82759a0cff890f905b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6e62f5521f4da078754c5c52a033e159.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_459f23bd6e19bf57e7a54ccafe5cc45a.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_2a3d1d1f387566258f309cf2cdcc2db4.jpg not downloaded yet
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04899ff50>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_4edfe2eb6ebfe28c4a5f1241e919d70a.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25, skipping ID generation
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 sending to next pipeline
2026-04-27 07:56:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25, identifier: JJ54433
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_430d9f90039866bf5b91920dc24f59e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0db1782e7cdb2ebcabdfc50aa690a0e1.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_812a7023f491d0bed56a4e427c223cca.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR39532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK94783> (referer: https://www.auto1.com/v1/car-details-view/AK94783/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 with identifier: JJ54433
2026-04-27 07:56:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 with identifier: JJ54433
2026-04-27 07:56:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25 with identifier: JJ54433 to the API
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_4edfe2eb6ebfe28c4a5f1241e919d70a.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'La Roda De Andalucia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:46:59Z',
'fuel_type': 'petrol',
'id': 'ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ54433',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Ford',
'model': 'Focus',
'odometer': 144116,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_dae03077ac80011286bf5104899a01c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_bb82eeaa05f0df3ba40e9b49d3db9c22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_fdc0a2ec634f8d3fa28d55f0f1cf68c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_173e9936eb74cd905e177843eb253cba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_30126183daa2be9ecfbec8c0d4e173ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_e1f33bb63876b67946b027e7e2476af2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_2393c05bd0bb592ef7568365f9ddff58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_924989656ada657e3f677fad73c8be7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_0d62d3915bb78c90b39638505f8a327a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25/ed1dbe8b-66ed-5dbc-9391-daa28ea9ab25_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/31/7431d6aa268d588174034398cceed80c/pa/JJ54433_4edfe2eb6ebfe28c4a5f1241e919d70a.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2014-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2014}
2026-04-27 07:56:08 [auto1.es] INFO: Saving data for JJ54433: {'created_time': 1777276568.562521, 'last_price_update_time': 1777276568.562537, 'has_photos': True, 'auction_closing_time': 1777304819.0}
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872de10>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_0d7502a810ea49d63b23f45429b840a9.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_30370704e9f0b8cd160350ef134d03a1.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_8f6d625f93681ee1e2db4b94c12ca018.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_94925ef6a560c6c6b8fa892577879f93.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_aa82dca7b9bc82d57bb3936efec6d112.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_73c83b47231528ce15cab74c530e992d.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_9f557ac790f889bb032c52040409adf5.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a84cbd0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_1a21bf26dc078b51c6ff36691950a79b.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e3f10>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_bbb066e0784db8af31c826644e750783.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838ca50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_07c6a983fd5c9ec36a20c9c06bfc8515.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048857b50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_4a5ea22d517e0c8cf6af4175a31d99ff.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048376d90>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_9a1cd6ad6cdc49d7717636439f553ece.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b1e90>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_65719e335f2c7d75ca8081377e8ecc88.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048512c50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4fb693bcf3c2f82759a0cff890f905b3.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4dc65d324d4d4c5fbed462257bd61017.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_b2a1b6c886361e183e4a45b71f80f9ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_47bca8e2fb6130695abca0be8839d948.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_3092f50a146ee9deb009f8961728e330.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_be5df9435ca5c1f00ecf5827f62e5016.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_8f8c548f31a31e9fd7e6dce6958356d1.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_10ce83fde9f59eb5005e0255c81a4032.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_e62172f6c5cc5ed47b691e3dd66bf3a8.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU88532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_68deaed29af48b0fb2d6b07657ca1fd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d1149643e39bae8d41b6d95036d0d277.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_709ebbd525fa30538d6462f831231696.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_29d64fa2e1b0fe722f9e2f86f99d334d.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482125d0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_430d9f90039866bf5b91920dc24f59e6.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7093a15e-00e6-5335-99c6-f11151003bb7
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7093a15e-00e6-5335-99c6-f11151003bb7, skipping ID generation
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7093a15e-00e6-5335-99c6-f11151003bb7 with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7093a15e-00e6-5335-99c6-f11151003bb7 sending to next pipeline
2026-04-27 07:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7093a15e-00e6-5335-99c6-f11151003bb7, identifier: LA59477
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_a993f5a32d89ca54f967e98b7ecdd1d6.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_ae721315ec036b7aaa4d371378c3653d.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_128e83500c4f03e2cb0590d67bff3284.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_21157ff8a30e87cd01ad6f3282c3a03a.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7093a15e-00e6-5335-99c6-f11151003bb7 with identifier: LA59477
2026-04-27 07:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7093a15e-00e6-5335-99c6-f11151003bb7 with identifier: LA59477
2026-04-27 07:56:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7093a15e-00e6-5335-99c6-f11151003bb7 with identifier: LA59477 to the API
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_430d9f90039866bf5b91920dc24f59e6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'city': 'Caldes De Malavella',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:40:34Z',
'fuel_type': 'petrol',
'id': '7093a15e-00e6-5335-99c6-f11151003bb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7743,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA59477',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'location_confidence': 'geocoded',
'longitude': 2.6451,
'make': 'Citroen',
'model': 'C3',
'odometer': 102272,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64693,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_430d9f90039866bf5b91920dc24f59e6.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61124,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_e659ffc1a695eab8811e2c9bdeae723a.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56500,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_0828546451041101d658c9bcd1b26c45.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43941,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_b5c8f4e269fe082f7010f522a216c396.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50601,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_bb55e244f7cb597852a91ba2d0903ab5.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54251,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b9c836b190d357474a574f5b63f254d.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45073,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_8b346662c19bb0a3493510666f66d0fc.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54816,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5f2c8749ab0e2917929ef35cf331bb4e.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53779,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_5b82d8617a9bd926d36163776def03e6.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7093a15e-00e6-5335-99c6-f11151003bb7/7093a15e-00e6-5335-99c6-f11151003bb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40336,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img12/0a/120ad06b002672e453f7c2e8dd10506e/pa/LA59477_eb2c80e0f94653ec1e2b683d4efe97ca.jpg',
'Width': 640}],
'postal_code': '17455',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2019-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-04-27 07:56:10 [auto1.es] INFO: Saving data for LA59477: {'created_time': 1777276570.169377, 'last_price_update_time': 1777276570.16939, 'has_photos': True, 'auction_closing_time': 1777304434.0}
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff05712dd50>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_aa82dca7b9bc82d57bb3936efec6d112.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0b3f95ca0f1edf9f6ddf2cbeb139c5e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0db1782e7cdb2ebcabdfc50aa690a0e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_2a3d1d1f387566258f309cf2cdcc2db4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_38598031757cbffd3257ee0057643c72.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_817d88e62254bef30de6d075e4ea98ee.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_de7807df552f9b705b9591dd9fe42a02.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_94925ef6a560c6c6b8fa892577879f93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_425adbfdb47c6e3f74c04e2b7129a8fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_bd9e65688e6ee7869ddb38c465b0e1d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_812a7023f491d0bed56a4e427c223cca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_3517e96504baabd830a79330d85dcdcc.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_a3674c02b05c88b86087b68d23ee92af.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_ff7b3c815a662f2ea7ab1dbcc7c182d9.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ94996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836a710>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4dc65d324d4d4c5fbed462257bd61017.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c53d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_b2a1b6c886361e183e4a45b71f80f9ce.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483df990>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_47bca8e2fb6130695abca0be8839d948.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 372d5168-1e06-5ded-8186-c560498ffebb
2026-04-27 07:56:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 372d5168-1e06-5ded-8186-c560498ffebb, skipping ID generation
2026-04-27 07:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 372d5168-1e06-5ded-8186-c560498ffebb with scrape type 1
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 372d5168-1e06-5ded-8186-c560498ffebb sending to next pipeline
2026-04-27 07:56:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 372d5168-1e06-5ded-8186-c560498ffebb, identifier: GM36563
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a3bd0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_3092f50a146ee9deb009f8961728e330.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833fb10>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_be5df9435ca5c1f00ecf5827f62e5016.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885ce50>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_68deaed29af48b0fb2d6b07657ca1fd7.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880ff90>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d1149643e39bae8d41b6d95036d0d277.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_8f6d625f93681ee1e2db4b94c12ca018.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_0108f439bb3e721a1a98021948ec3125.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563
2026-04-27 07:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563
2026-04-27 07:56:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563 to the API
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_47bca8e2fb6130695abca0be8839d948.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Caldes De Malavella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO N\\/A',
'engine': '1.0L',
'engine_horse_power': 50,
'expiration_date': '2026-04-27T15:19:35Z',
'fuel_type': 'petrol',
'id': '372d5168-1e06-5ded-8186-c560498ffebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7743,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM36563',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'location_confidence': 'geocoded',
'longitude': 2.6451,
'make': 'Seat',
'model': 'Arosa',
'odometer': 188628,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_47bca8e2fb6130695abca0be8839d948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_d47b782b064557669f64333ec4d35d5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_3426de5e9d57481ba4a752dec6378c98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa34325443dcd2f9480abeb9a9ba39f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_fa2de299f06d63e43ed54f2932903bb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_372d5168-1e06-5ded-8186-c560498ffebb/372d5168-1e06-5ded-8186-c560498ffebb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/88/9088518d689e4035f0b788060e1223bf/pa/GM36563_9456d12c58398f2b61daf354250950bf.jpg',
'Width': 800}],
'postal_code': '17455',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2001-05-16',
'seats_number': 4,
'seller_name': None,
'title': 'Seat Arosa 1.0 Stella',
'transmission': 'manual',
'trim': 'Stella',
'year': 2001}
2026-04-27 07:56:11 [auto1.es] INFO: Saving data for GM36563: {'created_time': 1777276571.094441, 'last_price_update_time': 1777276571.094452, 'has_photos': True, 'auction_closing_time': 1777303175.0}
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6b233e80bad92cd1f870f6bc3fdc8118.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_9d55f86c350bcd0742e0bd50c59a0e20.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8feeef65aab2a13e5eca48ae1f36b5a7.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_73c83b47231528ce15cab74c530e992d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_2e4e521e4b0d25cdc86489df28b44a3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_22bd76a0d51785d517495880a8cf241d.jpg not downloaded yet
2026-04-27 07:56:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a964d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0b3f95ca0f1edf9f6ddf2cbeb139c5e5.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833ab10>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0db1782e7cdb2ebcabdfc50aa690a0e1.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846c650>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_2a3d1d1f387566258f309cf2cdcc2db4.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048510e50>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_94925ef6a560c6c6b8fa892577879f93.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b53d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_425adbfdb47c6e3f74c04e2b7129a8fe.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833a810>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_bd9e65688e6ee7869ddb38c465b0e1d1.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572fa510>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_812a7023f491d0bed56a4e427c223cca.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6e62f5521f4da078754c5c52a033e159.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_459f23bd6e19bf57e7a54ccafe5cc45a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_30370704e9f0b8cd160350ef134d03a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_9f557ac790f889bb032c52040409adf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d814d37b44c166d6abffcb0041d8b4f6.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8a25e14b39b5c67c5dc103bc9be859f7.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048661750>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_8f6d625f93681ee1e2db4b94c12ca018.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_21157ff8a30e87cd01ad6f3282c3a03a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_fc5ba5402ddea1faa80fdd8eaa413ed9.jpg not downloaded yet
2026-04-27 07:56:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_128e83500c4f03e2cb0590d67bff3284.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_aca69535b06b9398942d1ade4ff5b552.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_c6c1d1175a9878af7efb43522a457cdc.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB94972> (referer: https://www.auto1.com/v1/car-details-view/RB94972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048460a50>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_73c83b47231528ce15cab74c530e992d.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837fe90>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_2e4e521e4b0d25cdc86489df28b44a3d.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_709ebbd525fa30538d6462f831231696.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_a993f5a32d89ca54f967e98b7ecdd1d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_5a69546cfba2029f8e49144d2dd3cadd.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_29d64fa2e1b0fe722f9e2f86f99d334d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_c41d7aa4c543604e444bedb06202eaa0.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_6e21bf08194f10d8b856343b498f4814.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a6dd0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6e62f5521f4da078754c5c52a033e159.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048872f50>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_459f23bd6e19bf57e7a54ccafe5cc45a.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895ea50>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_30370704e9f0b8cd160350ef134d03a1.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484357d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_9f557ac790f889bb032c52040409adf5.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_ae721315ec036b7aaa4d371378c3653d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_6ac9fb6edf191a7749927fb67284ff8b.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870aed0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_21157ff8a30e87cd01ad6f3282c3a03a.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851b450>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_128e83500c4f03e2cb0590d67bff3284.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_0108f439bb3e721a1a98021948ec3125.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8feeef65aab2a13e5eca48ae1f36b5a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_9d55f86c350bcd0742e0bd50c59a0e20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_817d88e62254bef30de6d075e4ea98ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_de7807df552f9b705b9591dd9fe42a02.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6b233e80bad92cd1f870f6bc3fdc8118.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_30e11e4210659241cafccc73310840fb.jpg not downloaded yet
2026-04-27 07:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5090e79-ce41-56b6-a457-cae65722f973 with identifier: RB94972
2026-04-27 07:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5090e79-ce41-56b6-a457-cae65722f973 with scrape type 1
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_92fd056847152c6acc993926e2c2be65.jpg not downloaded yet
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a1750>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_709ebbd525fa30538d6462f831231696.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e7490>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_a993f5a32d89ca54f967e98b7ecdd1d6.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fda90>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_29d64fa2e1b0fe722f9e2f86f99d334d.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_ff7b3c815a662f2ea7ab1dbcc7c182d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_ac8dac840b123ef300252f8b261555b5.jpg not downloaded yet
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_031fa01461ff9ad58564b492512b48fe.jpg not downloaded yet
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a8790>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_ae721315ec036b7aaa4d371378c3653d.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8a25e14b39b5c67c5dc103bc9be859f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833dfd0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_0108f439bb3e721a1a98021948ec3125.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048981bd0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8feeef65aab2a13e5eca48ae1f36b5a7.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823a050>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_9d55f86c350bcd0742e0bd50c59a0e20.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff056e72290>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_817d88e62254bef30de6d075e4ea98ee.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2
2026-04-27 07:56:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e62fc21-84df-5efa-a90e-a1c3d105eef2, skipping ID generation
2026-04-27 07:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with scrape type 1
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2 sending to next pipeline
2026-04-27 07:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1e62fc21-84df-5efa-a90e-a1c3d105eef2, identifier: AR83818
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865a990>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_de7807df552f9b705b9591dd9fe42a02.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481b6d10>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6b233e80bad92cd1f870f6bc3fdc8118.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_6ac9fb6edf191a7749927fb67284ff8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_64f4b768a8767c0c9d39a9fa9412d51b.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0d25b0f2272d3680b1e72b60ecf424ac.jpg not downloaded yet
2026-04-27 07:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818
2026-04-27 07:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818
2026-04-27 07:56:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818 to the API
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_817d88e62254bef30de6d075e4ea98ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Sevilla',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-04-27T15:36:55Z',
'fuel_type': 'petrol',
'id': '1e62fc21-84df-5efa-a90e-a1c3d105eef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR83818',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Peugeot',
'model': '208',
'odometer': 66305,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_1a21bf26dc078b51c6ff36691950a79b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4fb693bcf3c2f82759a0cff890f905b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_65719e335f2c7d75ca8081377e8ecc88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_bd9e65688e6ee7869ddb38c465b0e1d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_4dc65d324d4d4c5fbed462257bd61017.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_425adbfdb47c6e3f74c04e2b7129a8fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_812a7023f491d0bed56a4e427c223cca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_9f557ac790f889bb032c52040409adf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_29d64fa2e1b0fe722f9e2f86f99d334d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e62fc21-84df-5efa-a90e-a1c3d105eef2/1e62fc21-84df-5efa-a90e-a1c3d105eef2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/8b/8a8bd9607976fa4e1601d8cc67bad941/pa/AR83818_817d88e62254bef30de6d075e4ea98ee.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2018-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Signature',
'transmission': 'manual',
'trim': 'Signature',
'year': 2018}
2026-04-27 07:56:13 [auto1.es] INFO: Saving data for AR83818: {'created_time': 1777276573.647169, 'last_price_update_time': 1777276573.647181, 'has_photos': True, 'auction_closing_time': 1777304215.0}
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_5a69546cfba2029f8e49144d2dd3cadd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_c6c1d1175a9878af7efb43522a457cdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_22bd76a0d51785d517495880a8cf241d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d814d37b44c166d6abffcb0041d8b4f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_fc5ba5402ddea1faa80fdd8eaa413ed9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_6e21bf08194f10d8b856343b498f4814.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0620a60f3da43d4143e88a2e45c78c1e.jpg not downloaded yet
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ94996> (referer: https://www.auto1.com/v1/car-details-view/EZ94996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488933d0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_ff7b3c815a662f2ea7ab1dbcc7c182d9.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d6d10>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8a25e14b39b5c67c5dc103bc9be859f7.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_c41d7aa4c543604e444bedb06202eaa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR39532> (referer: https://www.auto1.com/v1/car-details-view/JR39532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_bda5afc8cb9a1221e38efff16ad52d30.jpg not downloaded yet
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a5f90>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_6ac9fb6edf191a7749927fb67284ff8b.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_3517e96504baabd830a79330d85dcdcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_92fd056847152c6acc993926e2c2be65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_031fa01461ff9ad58564b492512b48fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_a2dbc3449e7ca5f2287dce61413a20e9.jpg not downloaded yet
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_aca69535b06b9398942d1ade4ff5b552.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_a3674c02b05c88b86087b68d23ee92af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a5450>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_5a69546cfba2029f8e49144d2dd3cadd.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048675950>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_c6c1d1175a9878af7efb43522a457cdc.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c2710>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_22bd76a0d51785d517495880a8cf241d.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048677410>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d814d37b44c166d6abffcb0041d8b4f6.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e0a90>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_fc5ba5402ddea1faa80fdd8eaa413ed9.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048674e50>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_6e21bf08194f10d8b856343b498f4814.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68d0d72-2e80-5547-b98b-dcf7052359a7 with identifier: EZ94996
2026-04-27 07:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68d0d72-2e80-5547-b98b-dcf7052359a7 with scrape type 1
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_b5aa4cbf16c77e573b4463a9f1e919eb.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_dc61977eab1c5095c84eea8b81400a81.jpg not downloaded yet
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0d25b0f2272d3680b1e72b60ecf424ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_30e11e4210659241cafccc73310840fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_38598031757cbffd3257ee0057643c72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_cdd00a599422387124c8714df1b5e405.jpg not downloaded yet
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_ac8dac840b123ef300252f8b261555b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_48b06b357b5b8be238988c86f69c481a.jpg not downloaded yet
2026-04-27 07:56:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ab090>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_c41d7aa4c543604e444bedb06202eaa0.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 706500bd-2429-5763-90c0-21485bd4af38 with identifier: JR39532
2026-04-27 07:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706500bd-2429-5763-90c0-21485bd4af38 with scrape type 1
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f10bf018ce8b4aced80456782d509be0.jpg not downloaded yet
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ae810>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_3517e96504baabd830a79330d85dcdcc.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896b410>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_92fd056847152c6acc993926e2c2be65.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a2890>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_031fa01461ff9ad58564b492512b48fe.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895fa90>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_aca69535b06b9398942d1ade4ff5b552.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ad850>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_a3674c02b05c88b86087b68d23ee92af.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_95abd7dff33034e1d41eabe1c9aa372a.jpg not downloaded yet
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_e62172f6c5cc5ed47b691e3dd66bf3a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_64f4b768a8767c0c9d39a9fa9412d51b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_10ce83fde9f59eb5005e0255c81a4032.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0620a60f3da43d4143e88a2e45c78c1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_359ba21d3023c632aa9dcc951d89951e.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_a08f5fd6a36816c229bd9d7468858ad3.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_d130c28701d1316c614b2d211a362d9c.jpg not downloaded yet
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_8f8c548f31a31e9fd7e6dce6958356d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_8eea736edb3dae6835573d35e823dc37.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_e2b56398e2224ef2bdb78e67425a329a.jpg not downloaded yet
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_43ed5f4a844972988590c6827fde2a61.jpg not downloaded yet
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e1f50>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0d25b0f2272d3680b1e72b60ecf424ac.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485d8110>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_30e11e4210659241cafccc73310840fb.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837a4d0>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_38598031757cbffd3257ee0057643c72.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 519f062f-7f34-58b9-8964-02cfe26a09a3
2026-04-27 07:56:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 519f062f-7f34-58b9-8964-02cfe26a09a3, skipping ID generation
2026-04-27 07:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 519f062f-7f34-58b9-8964-02cfe26a09a3 with scrape type 1
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 519f062f-7f34-58b9-8964-02cfe26a09a3 sending to next pipeline
2026-04-27 07:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 519f062f-7f34-58b9-8964-02cfe26a09a3, identifier: SA01398
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bf890>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_ac8dac840b123ef300252f8b261555b5.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_c2b60ef38420daaaa556e1962a94fcae.jpg not downloaded yet
2026-04-27 07:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398
2026-04-27 07:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398
2026-04-27 07:56:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398 to the API
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_38598031757cbffd3257ee0057643c72.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Esquivias',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:46:53Z',
'fuel_type': 'diesel',
'id': '519f062f-7f34-58b9-8964-02cfe26a09a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA01398',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 104506,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_9a1cd6ad6cdc49d7717636439f553ece.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_07c6a983fd5c9ec36a20c9c06bfc8515.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_bbb066e0784db8af31c826644e750783.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0b3f95ca0f1edf9f6ddf2cbeb139c5e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_3092f50a146ee9deb009f8961728e330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_2e4e521e4b0d25cdc86489df28b44a3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_0db1782e7cdb2ebcabdfc50aa690a0e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_73c83b47231528ce15cab74c530e992d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_709ebbd525fa30538d6462f831231696.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_519f062f-7f34-58b9-8964-02cfe26a09a3/519f062f-7f34-58b9-8964-02cfe26a09a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39214bad0907b8f78e96582ae6248fcb/pa/SA01398_38598031757cbffd3257ee0057643c72.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-10-25',
'seats_number': 5,
'seller_name': None,
'title': "Kia pro_cee'd 1.6 CRDi X-Tech 17",
'transmission': 'manual',
'trim': 'X-Tech 17',
'year': 2017}
2026-04-27 07:56:15 [auto1.es] INFO: Saving data for SA01398: {'created_time': 1777276575.37981, 'last_price_update_time': 1777276575.379821, 'has_photos': True, 'auction_closing_time': 1777304813.0}
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_bda5afc8cb9a1221e38efff16ad52d30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_dc61977eab1c5095c84eea8b81400a81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_2a9a93401107bfab17bcf06541366bd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b0464180325c1b155b74073d04d4eb98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_5f835be6950b54cbb8d860e2aa22b31f.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_a2dbc3449e7ca5f2287dce61413a20e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_76a633e7a088462b3ef78da36847e327.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1f75651445e970041c193f162573286d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f5de0eb13e04167c1c5abf6a8bb23a49.jpg not downloaded yet
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU88532> (referer: https://www.auto1.com/v1/car-details-view/EU88532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485727d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_e62172f6c5cc5ed47b691e3dd66bf3a8.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f51ea11-75f9-5055-9cec-eed6383397da
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f51ea11-75f9-5055-9cec-eed6383397da, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f51ea11-75f9-5055-9cec-eed6383397da with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f51ea11-75f9-5055-9cec-eed6383397da sending to next pipeline
2026-04-27 07:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f51ea11-75f9-5055-9cec-eed6383397da, identifier: VG63599
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a36690>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_64f4b768a8767c0c9d39a9fa9412d51b.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb sending to next pipeline
2026-04-27 07:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb, identifier: AK94783
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048674c90>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_10ce83fde9f59eb5005e0255c81a4032.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1310e7d-f55d-5cab-bbd6-dcc33019c701
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1310e7d-f55d-5cab-bbd6-dcc33019c701, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1310e7d-f55d-5cab-bbd6-dcc33019c701 with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1310e7d-f55d-5cab-bbd6-dcc33019c701 sending to next pipeline
2026-04-27 07:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1310e7d-f55d-5cab-bbd6-dcc33019c701, identifier: AX80040
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488edd90>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0620a60f3da43d4143e88a2e45c78c1e.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048674c90>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_8f8c548f31a31e9fd7e6dce6958356d1.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b5221bc-734e-5017-80e8-3c863f217aac
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b5221bc-734e-5017-80e8-3c863f217aac, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5221bc-734e-5017-80e8-3c863f217aac with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b5221bc-734e-5017-80e8-3c863f217aac sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b5221bc-734e-5017-80e8-3c863f217aac, identifier: YG93174
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cee50>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-04-27 07:56:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5141be34-685c-5aae-bf76-6e9159ea9e94, skipping ID generation
2026-04-27 07:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141be34-685c-5aae-bf76-6e9159ea9e94 with scrape type 1
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5141be34-685c-5aae-bf76-6e9159ea9e94 sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5141be34-685c-5aae-bf76-6e9159ea9e94, identifier: FW49739
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_b5aa4cbf16c77e573b4463a9f1e919eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_6ec76325673c62cbc4e270403c48b86f.jpg not downloaded yet
2026-04-27 07:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f51ea11-75f9-5055-9cec-eed6383397da with identifier: VG63599
2026-04-27 07:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f51ea11-75f9-5055-9cec-eed6383397da with identifier: VG63599
2026-04-27 07:56:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f51ea11-75f9-5055-9cec-eed6383397da with identifier: VG63599 to the API
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_e62172f6c5cc5ed47b691e3dd66bf3a8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 196,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 178,
'expiration_date': '2026-04-27T15:49:19Z',
'fuel_type': 'diesel',
'id': '1f51ea11-75f9-5055-9cec-eed6383397da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG63599',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Ssangyong',
'model': 'Rodius',
'odometer': 223676,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_68deaed29af48b0fb2d6b07657ca1fd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_2a3d1d1f387566258f309cf2cdcc2db4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_94925ef6a560c6c6b8fa892577879f93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_e62172f6c5cc5ed47b691e3dd66bf3a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_21157ff8a30e87cd01ad6f3282c3a03a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_ff7b3c815a662f2ea7ab1dbcc7c182d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8feeef65aab2a13e5eca48ae1f36b5a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_8a25e14b39b5c67c5dc103bc9be859f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_c6c1d1175a9878af7efb43522a457cdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1f51ea11-75f9-5055-9cec-eed6383397da/1f51ea11-75f9-5055-9cec-eed6383397da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/15/781565c82a3771f19e66467ca2fbe095/pa/VG63599_6e21bf08194f10d8b856343b498f4814.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-10-27',
'seats_number': 7,
'seller_name': None,
'title': 'Ssangyong Rodius 2.2 TD Xdi Limited',
'transmission': 'automatic',
'trim': 'Xdi Limited',
'year': 2015}
2026-04-27 07:56:16 [auto1.es] INFO: Saving data for VG63599: {'created_time': 1777276576.566014, 'last_price_update_time': 1777276576.566023, 'has_photos': True, 'auction_closing_time': 1777304959.0}
2026-04-27 07:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783
2026-04-27 07:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783
2026-04-27 07:56:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783 to the API
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_64f4b768a8767c0c9d39a9fa9412d51b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Pedrola',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:52:01Z',
'fuel_type': 'diesel',
'id': '7755331e-2eb8-5ebb-9fbc-adb9e8f605fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK94783',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Volvo',
'model': 'XC60',
'odometer': 194572,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_a993f5a32d89ca54f967e98b7ecdd1d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_de7807df552f9b705b9591dd9fe42a02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_0108f439bb3e721a1a98021948ec3125.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_22bd76a0d51785d517495880a8cf241d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_fc5ba5402ddea1faa80fdd8eaa413ed9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63818,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_5a69546cfba2029f8e49144d2dd3cadd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_6ac9fb6edf191a7749927fb67284ff8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_30e11e4210659241cafccc73310840fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_ac8dac840b123ef300252f8b261555b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7755331e-2eb8-5ebb-9fbc-adb9e8f605fb/7755331e-2eb8-5ebb-9fbc-adb9e8f605fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/96/0396399798cb6b5d02f3977ad9f3ffd3/pa/AK94783_64f4b768a8767c0c9d39a9fa9412d51b.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2014-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
'transmission': 'manual',
'trim': 'Kinetic 2WD',
'year': 2014}
2026-04-27 07:56:16 [auto1.es] INFO: Saving data for AK94783: {'created_time': 1777276576.955754, 'last_price_update_time': 1777276576.955765, 'has_photos': True, 'auction_closing_time': 1777305121.0}
2026-04-27 07:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1310e7d-f55d-5cab-bbd6-dcc33019c701 with identifier: AX80040
2026-04-27 07:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1310e7d-f55d-5cab-bbd6-dcc33019c701 with identifier: AX80040
2026-04-27 07:56:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1310e7d-f55d-5cab-bbd6-dcc33019c701 with identifier: AX80040 to the API
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_10ce83fde9f59eb5005e0255c81a4032.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Hellin',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:29:10Z',
'fuel_type': 'petrol',
'id': 'd1310e7d-f55d-5cab-bbd6-dcc33019c701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.5106,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX80040',
'listing': 'auction',
'location': 'ES, Hellin',
'location_confidence': 'geocoded',
'longitude': -1.701,
'make': 'Honda',
'model': 'CR-V',
'odometer': 148243,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d1149643e39bae8d41b6d95036d0d277.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_459f23bd6e19bf57e7a54ccafe5cc45a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_8f6d625f93681ee1e2db4b94c12ca018.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_10ce83fde9f59eb5005e0255c81a4032.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_128e83500c4f03e2cb0590d67bff3284.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_a3674c02b05c88b86087b68d23ee92af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_9d55f86c350bcd0742e0bd50c59a0e20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_d814d37b44c166d6abffcb0041d8b4f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_aca69535b06b9398942d1ade4ff5b552.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1310e7d-f55d-5cab-bbd6-dcc33019c701/d1310e7d-f55d-5cab-bbd6-dcc33019c701_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/12/d512314e5565eedbd9df382177b9f999/pa/AX80040_c41d7aa4c543604e444bedb06202eaa0.jpg',
'Width': 800}],
'postal_code': '02400',
'price': 0,
'price_includes_vat': True,
'province': 'Albacete',
'province_code': 'ES-AB',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2011-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Honda CR-V 2.0 VTEC Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2011}
2026-04-27 07:56:17 [auto1.es] INFO: Saving data for AX80040: {'created_time': 1777276577.465904, 'last_price_update_time': 1777276577.465916, 'has_photos': True, 'auction_closing_time': 1777303750.0}
2026-04-27 07:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b5221bc-734e-5017-80e8-3c863f217aac with identifier: YG93174
2026-04-27 07:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b5221bc-734e-5017-80e8-3c863f217aac with identifier: YG93174
2026-04-27 07:56:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b5221bc-734e-5017-80e8-3c863f217aac with identifier: YG93174 to the API
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_8f8c548f31a31e9fd7e6dce6958356d1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'city': 'Araia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-04-27T15:01:26Z',
'fuel_type': 'hybrid',
'id': '1b5221bc-734e-5017-80e8-3c863f217aac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG93174',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Kia',
'model': 'Niro',
'odometer': 242011,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_4a5ea22d517e0c8cf6af4175a31d99ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_aa82dca7b9bc82d57bb3936efec6d112.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_b2a1b6c886361e183e4a45b71f80f9ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_be5df9435ca5c1f00ecf5827f62e5016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6e62f5521f4da078754c5c52a033e159.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_30370704e9f0b8cd160350ef134d03a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_8f8c548f31a31e9fd7e6dce6958356d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_ae721315ec036b7aaa4d371378c3653d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_3517e96504baabd830a79330d85dcdcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b5221bc-734e-5017-80e8-3c863f217aac/1b5221bc-734e-5017-80e8-3c863f217aac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/9f/6a9f3dab61d1545946312365f8750728/pa/YG93174_6b233e80bad92cd1f870f6bc3fdc8118.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2017-08-17',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Niro 1.6 Hybrid Emotion',
'transmission': 'automatic',
'trim': 'Emotion',
'year': 2017}
2026-04-27 07:56:17 [auto1.es] INFO: Saving data for YG93174: {'created_time': 1777276577.863591, 'last_price_update_time': 1777276577.863602, 'has_photos': True, 'auction_closing_time': 1777302086.0}
2026-04-27 07:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739
2026-04-27 07:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739
2026-04-27 07:56:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739 to the API
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg>
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'city': 'Sevilla',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 231,
'expiration_date': '2026-04-28T15:18:20Z',
'fuel_type': 'diesel',
'id': '5141be34-685c-5aae-bf76-6e9159ea9e94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW49739',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Audi',
'model': 'A6',
'odometer': 88811,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2019-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-04-27 07:56:18 [auto1.es] INFO: Saving data for FW49739: {'created_time': 1777276578.354997, 'last_price_update_time': 1777276578.355009, 'has_photos': True, 'auction_closing_time': 1777389500.0}
2026-04-27 07:56:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_349f7050118d532eaac7b4197bf692f2.jpg not downloaded yet
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_5cb8f1687cb545576c10a98782ac8a54.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_48b06b357b5b8be238988c86f69c481a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_d130c28701d1316c614b2d211a362d9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4528bc6f11e7d4b70f998689cef3ef56.jpg not downloaded yet
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB52077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a55690>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_bda5afc8cb9a1221e38efff16ad52d30.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a9b90>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_dc61977eab1c5095c84eea8b81400a81.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a1d10>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_2a9a93401107bfab17bcf06541366bd7.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048897a50>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b0464180325c1b155b74073d04d4eb98.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3240a3f-7ad3-5044-bf2d-73ccbae367fb, skipping ID generation
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3240a3f-7ad3-5044-bf2d-73ccbae367fb sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3240a3f-7ad3-5044-bf2d-73ccbae367fb, identifier: BG94034
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c3f50>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_a2dbc3449e7ca5f2287dce61413a20e9.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048386310>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_76a633e7a088462b3ef78da36847e327.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6beaabe-41cc-5ac6-9cb2-a465f962efba
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6beaabe-41cc-5ac6-9cb2-a465f962efba, skipping ID generation
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6beaabe-41cc-5ac6-9cb2-a465f962efba with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6beaabe-41cc-5ac6-9cb2-a465f962efba sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6beaabe-41cc-5ac6-9cb2-a465f962efba, identifier: YR57981
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485da490>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1f75651445e970041c193f162573286d.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53957cb-51e1-5292-af92-853180c1329a with identifier: EU88532
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53957cb-51e1-5292-af92-853180c1329a with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_8c39f3034b89595e794b01cb00995da3.jpg not downloaded yet
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f10bf018ce8b4aced80456782d509be0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_a08f5fd6a36816c229bd9d7468858ad3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_cdd00a599422387124c8714df1b5e405.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_b411fa0573d203c24ff2f83ceebde483.jpg not downloaded yet
2026-04-27 07:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3240a3f-7ad3-5044-bf2d-73ccbae367fb with identifier: BG94034
2026-04-27 07:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3240a3f-7ad3-5044-bf2d-73ccbae367fb with identifier: BG94034
2026-04-27 07:56:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3240a3f-7ad3-5044-bf2d-73ccbae367fb with identifier: BG94034 to the API
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b0464180325c1b155b74073d04d4eb98.jpg>
{'auction_title': '',
'c_o_2_emission_value': 176,
'category': None,
'city': 'Calaf',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-04-28T15:11:38Z',
'fuel_type': 'petrol',
'id': 'b3240a3f-7ad3-5044-bf2d-73ccbae367fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG94034',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 169045,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_62fe367531575e6a9b40af911d1ee0d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_5da33c922ffd99af24627eb1cb6eefaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b61a478184c3bdb4d80310a0cb3b94e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_78cb4628586db6132786eca81cca02bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_b0464180325c1b155b74073d04d4eb98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3240a3f-7ad3-5044-bf2d-73ccbae367fb/b3240a3f-7ad3-5044-bf2d-73ccbae367fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/89/7a89c3ed3566f755ab7bcef494c68f0e/pa/BG94034_e2e902d44224f2edcfcce3385d7c599c.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2008-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 IGolf',
'transmission': 'manual',
'trim': 'IGolf',
'year': 2008}
2026-04-27 07:56:19 [auto1.es] INFO: Saving data for BG94034: {'created_time': 1777276579.356987, 'last_price_update_time': 1777276579.356999, 'has_photos': True, 'auction_closing_time': 1777389098.0}
2026-04-27 07:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6beaabe-41cc-5ac6-9cb2-a465f962efba with identifier: YR57981
2026-04-27 07:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6beaabe-41cc-5ac6-9cb2-a465f962efba with identifier: YR57981
2026-04-27 07:56:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6beaabe-41cc-5ac6-9cb2-a465f962efba with identifier: YR57981 to the API
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_76a633e7a088462b3ef78da36847e327.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'city': 'Aldaya',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:18:45Z',
'fuel_type': 'diesel',
'id': 'f6beaabe-41cc-5ac6-9cb2-a465f962efba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR57981',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C3',
'odometer': 121111,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_b2b98f3a1f5221a3bfb321972f64078d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_62147ffc018cc4b7301fc16d8ab2fbbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4d62ef2fb5d1050905447d65368e14b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_d178c573b7180894490a5b912fe80070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_76a633e7a088462b3ef78da36847e327.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_f10d8820d836728bf6338a1ed783365e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_2f561b454385e6a8099cdced395c37a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_4b9e3097ca2a7899d1a3f0e61be16517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_0f7dfdb156c8ab014e1a5ba9459d16c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6beaabe-41cc-5ac6-9cb2-a465f962efba/f6beaabe-41cc-5ac6-9cb2-a465f962efba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad52fb4a3baef45f3b4c0547914cf63/pa/YR57981_9da5ebae4788a051ce6f9252b46be42b.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Collection',
'transmission': 'manual',
'trim': 'Collection',
'year': 2012}
2026-04-27 07:56:19 [auto1.es] INFO: Saving data for YR57981: {'created_time': 1777276579.961668, 'last_price_update_time': 1777276579.96168, 'has_photos': True, 'auction_closing_time': 1777389525.0}
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_c2b60ef38420daaaa556e1962a94fcae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_9a055bae8328ecb478c766d451c6e925.jpg not downloaded yet
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_443d013ab52065da0697f72dbb2d272c.jpg not downloaded yet
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c4ad0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_b5aa4cbf16c77e573b4463a9f1e919eb.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_359ba21d3023c632aa9dcc951d89951e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_8eea736edb3dae6835573d35e823dc37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_43ed5f4a844972988590c6827fde2a61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_98ee16e89f8326ccc4df2f758c997673.jpg not downloaded yet
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_e2b56398e2224ef2bdb78e67425a329a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4806f4a7406195a0722d059e5309c0be.jpg not downloaded yet
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e5a86ef2c21f719b572947afe1eb8593.jpg not downloaded yet
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_d6e25b41a12e5194e2c3823e216af6e0.jpg not downloaded yet
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048511290>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_5cb8f1687cb545576c10a98782ac8a54.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d7990>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_48b06b357b5b8be238988c86f69c481a.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04888f550>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_d130c28701d1316c614b2d211a362d9c.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0950>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f10bf018ce8b4aced80456782d509be0.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d6890>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_a08f5fd6a36816c229bd9d7468858ad3.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b6fd0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_cdd00a599422387124c8714df1b5e405.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f5de0eb13e04167c1c5abf6a8bb23a49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_6ec76325673c62cbc4e270403c48b86f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_95abd7dff33034e1d41eabe1c9aa372a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_5f835be6950b54cbb8d860e2aa22b31f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e8b92fb31e3b469fea37cc1b3ad2bf5b.jpg not downloaded yet
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_8c39f3034b89595e794b01cb00995da3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4528bc6f11e7d4b70f998689cef3ef56.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_fcbedf8d486a3153887c8d523112e44e.jpg not downloaded yet
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_09857f90d17aee89907f45ca928e869e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_42dc0ff8ba91713373f5c0d0f8f2a2e9.jpg not downloaded yet
2026-04-27 07:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ea710>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_c2b60ef38420daaaa556e1962a94fcae.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209d10>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_359ba21d3023c632aa9dcc951d89951e.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a8c90>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_8eea736edb3dae6835573d35e823dc37.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5090e79-ce41-56b6-a457-cae65722f973
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5090e79-ce41-56b6-a457-cae65722f973, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5090e79-ce41-56b6-a457-cae65722f973 with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5090e79-ce41-56b6-a457-cae65722f973 sending to next pipeline
2026-04-27 07:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5090e79-ce41-56b6-a457-cae65722f973, identifier: RB94972
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048541790>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_43ed5f4a844972988590c6827fde2a61.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048484d90>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_e2b56398e2224ef2bdb78e67425a329a.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5090e79-ce41-56b6-a457-cae65722f973 with identifier: RB94972
2026-04-27 07:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5090e79-ce41-56b6-a457-cae65722f973 with identifier: RB94972
2026-04-27 07:56:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5090e79-ce41-56b6-a457-cae65722f973 with identifier: RB94972 to the API
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_8eea736edb3dae6835573d35e823dc37.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Esquivias',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:06:09Z',
'fuel_type': 'petrol',
'id': 'e5090e79-ce41-56b6-a457-cae65722f973',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB94972',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 41162,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64610,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_92fd056847152c6acc993926e2c2be65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64610,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_031fa01461ff9ad58564b492512b48fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59787,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0d25b0f2272d3680b1e72b60ecf424ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64282,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_0620a60f3da43d4143e88a2e45c78c1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54866,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_bda5afc8cb9a1221e38efff16ad52d30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59065,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_a2dbc3449e7ca5f2287dce61413a20e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51956,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_dc61977eab1c5095c84eea8b81400a81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59084,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_48b06b357b5b8be238988c86f69c481a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62491,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_359ba21d3023c632aa9dcc951d89951e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5090e79-ce41-56b6-a457-cae65722f973/e5090e79-ce41-56b6-a457-cae65722f973_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47110,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img3c/92/3c925fa07831b679865883a04ba70380/pa/RB94972_8eea736edb3dae6835573d35e823dc37.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2018-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza Reference Plus Reference Plus',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-04-27 07:56:21 [auto1.es] INFO: Saving data for RB94972: {'created_time': 1777276581.675396, 'last_price_update_time': 1777276581.675407, 'has_photos': True, 'auction_closing_time': 1777302369.0}
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_b2eebe9992e2c524ce7880f09a103e96.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_5eb3803131f17ede0f75280cdf3831bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2b46647b357d9ed0db2793c3997b6c21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_9b4a5c443d0f4eb931722cc0bf2c3d23.jpg not downloaded yet
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_3e17bb5c7adb5329ba009f6d9d381bb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_b411fa0573d203c24ff2f83ceebde483.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_349f7050118d532eaac7b4197bf692f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM87418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048971f90>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f5de0eb13e04167c1c5abf6a8bb23a49.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0576904d0>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_6ec76325673c62cbc4e270403c48b86f.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048aa4d10>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_95abd7dff33034e1d41eabe1c9aa372a.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04892f290>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_5f835be6950b54cbb8d860e2aa22b31f.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048969650>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_8c39f3034b89595e794b01cb00995da3.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0590>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4528bc6f11e7d4b70f998689cef3ef56.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a95750>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_09857f90d17aee89907f45ca928e869e.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e5a86ef2c21f719b572947afe1eb8593.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_98ee16e89f8326ccc4df2f758c997673.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_048c58e5aed0ff81898a1470ccfac620.jpg not downloaded yet
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4806f4a7406195a0722d059e5309c0be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_9a055bae8328ecb478c766d451c6e925.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_443d013ab52065da0697f72dbb2d272c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_648cdc77e381871770463cec29c50904.jpg not downloaded yet
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485021d0>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_b2eebe9992e2c524ce7880f09a103e96.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714e90>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_5eb3803131f17ede0f75280cdf3831bd.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3650>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2b46647b357d9ed0db2793c3997b6c21.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d43842ab-152c-5aba-872a-bb6a49f17473
2026-04-27 07:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d43842ab-152c-5aba-872a-bb6a49f17473, skipping ID generation
2026-04-27 07:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43842ab-152c-5aba-872a-bb6a49f17473 with scrape type 1
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d43842ab-152c-5aba-872a-bb6a49f17473 sending to next pipeline
2026-04-27 07:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d43842ab-152c-5aba-872a-bb6a49f17473, identifier: DV40298
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848eb90>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_3e17bb5c7adb5329ba009f6d9d381bb0.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f69ae208-d97b-58c7-a630-ecbe822d6f6e
2026-04-27 07:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f69ae208-d97b-58c7-a630-ecbe822d6f6e, skipping ID generation
2026-04-27 07:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69ae208-d97b-58c7-a630-ecbe822d6f6e with scrape type 1
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f69ae208-d97b-58c7-a630-ecbe822d6f6e sending to next pipeline
2026-04-27 07:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f69ae208-d97b-58c7-a630-ecbe822d6f6e, identifier: CH36349
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c690>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_b411fa0573d203c24ff2f83ceebde483.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481b6110>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_349f7050118d532eaac7b4197bf692f2.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e8b92fb31e3b469fea37cc1b3ad2bf5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298
2026-04-27 07:56:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298 to the API
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2b46647b357d9ed0db2793c3997b6c21.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 165,
'expiration_date': '2026-04-27T15:24:46Z',
'fuel_type': 'diesel',
'id': 'd43842ab-152c-5aba-872a-bb6a49f17473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV40298',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Opel',
'model': 'Astra',
'odometer': 155682,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2b46647b357d9ed0db2793c3997b6c21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_5eb3803131f17ede0f75280cdf3831bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1ffceae3690cc7ba824ce60d2fec19af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_2de0b3716512f78efbc31b1bca91b736.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1f75651445e970041c193f162573286d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_e626674e33ef60ac2998f08c4d29876f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_098532bc4c5f86e98f4f7dda59ffb87d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_1036582f173b64145181e6e03f5fc77b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_a2f09af3717324e61bfc1838f50dc1c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d43842ab-152c-5aba-872a-bb6a49f17473/d43842ab-152c-5aba-872a-bb6a49f17473_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/67/0b674bf0fd710af904ae8b2708323b26/pa/DV40298_c4c1f77f3cea637bcd43fcaacdeeaa39.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 2.0 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2015}
2026-04-27 07:56:23 [auto1.es] INFO: Saving data for DV40298: {'created_time': 1777276583.060399, 'last_price_update_time': 1777276583.060408, 'has_photos': True, 'auction_closing_time': 1777303486.0}
2026-04-27 07:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f69ae208-d97b-58c7-a630-ecbe822d6f6e with identifier: CH36349
2026-04-27 07:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f69ae208-d97b-58c7-a630-ecbe822d6f6e with identifier: CH36349
2026-04-27 07:56:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f69ae208-d97b-58c7-a630-ecbe822d6f6e with identifier: CH36349 to the API
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_3e17bb5c7adb5329ba009f6d9d381bb0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Esquivias',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 220,
'expiration_date': '2026-04-27T15:29:53Z',
'fuel_type': 'diesel',
'id': 'f69ae208-d97b-58c7-a630-ecbe822d6f6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH36349',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 43488,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37108,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_6c52be630efd5e227d8085e4d4c2b6f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37108,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_965bfcfd63329c7cc0be26c16098a7fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35410,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_699fe83616e9f72291c3fc16e2b82c77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33113,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_3e17bb5c7adb5329ba009f6d9d381bb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28915,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_b2eebe9992e2c524ce7880f09a103e96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35838,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_4b16dcf5ea354a342d21e76b00c3cb32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32828,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_5cb8f1687cb545576c10a98782ac8a54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37521,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_2a9a93401107bfab17bcf06541366bd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31595,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_587403c931f4c542938c857a6437c04c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f69ae208-d97b-58c7-a630-ecbe822d6f6e/f69ae208-d97b-58c7-a630-ecbe822d6f6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29438,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5c/eb/5ceb72da3ccfb785d9716fdab72ef2b8/pa/CH36349_0d7502a810ea49d63b23f45429b840a9.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2022-04-03',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-04-27 07:56:23 [auto1.es] INFO: Saving data for CH36349: {'created_time': 1777276583.581419, 'last_price_update_time': 1777276583.58143, 'has_photos': True, 'auction_closing_time': 1777303793.0}
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_d6e25b41a12e5194e2c3823e216af6e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_a352e4ddd244d3c4e6b59dec724fc601.jpg not downloaded yet
2026-04-27 07:56:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_87a31b54145c8a1f9b1914ae896d1830.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_fcbedf8d486a3153887c8d523112e44e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_42dc0ff8ba91713373f5c0d0f8f2a2e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_a295fc9c38476a131bb6184dff28d757.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB52077> (referer: https://www.auto1.com/v1/car-details-view/KB52077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_9b4a5c443d0f4eb931722cc0bf2c3d23.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_fae5ade7b5387b87df1ad5e088306c1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_dbba7dac41c3339cf9efc0fdb3f41fce.jpg not downloaded yet
2026-04-27 07:56:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048aa6750>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e5a86ef2c21f719b572947afe1eb8593.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048930f90>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_98ee16e89f8326ccc4df2f758c997673.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876ae10>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4806f4a7406195a0722d059e5309c0be.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048998d50>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_9a055bae8328ecb478c766d451c6e925.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b68d0d72-2e80-5547-b98b-dcf7052359a7
2026-04-27 07:56:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b68d0d72-2e80-5547-b98b-dcf7052359a7, skipping ID generation
2026-04-27 07:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68d0d72-2e80-5547-b98b-dcf7052359a7 with scrape type 1
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b68d0d72-2e80-5547-b98b-dcf7052359a7 sending to next pipeline
2026-04-27 07:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b68d0d72-2e80-5547-b98b-dcf7052359a7, identifier: EZ94996
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04849ec90>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_443d013ab52065da0697f72dbb2d272c.jpg saved to cache
2026-04-27 07:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485efe10>
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e8b92fb31e3b469fea37cc1b3ad2bf5b.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b68d0d72-2e80-5547-b98b-dcf7052359a7 with identifier: EZ94996
2026-04-27 07:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b68d0d72-2e80-5547-b98b-dcf7052359a7 with identifier: EZ94996
2026-04-27 07:56:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b68d0d72-2e80-5547-b98b-dcf7052359a7 with identifier: EZ94996 to the API
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_9a055bae8328ecb478c766d451c6e925.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'city': 'Esquivias',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:53:32Z',
'fuel_type': 'diesel',
'id': 'b68d0d72-2e80-5547-b98b-dcf7052359a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ94996',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'MINI',
'model': 'Countryman',
'odometer': 79515,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_b5aa4cbf16c77e573b4463a9f1e919eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_cdd00a599422387124c8714df1b5e405.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_95abd7dff33034e1d41eabe1c9aa372a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_d130c28701d1316c614b2d211a362d9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_43ed5f4a844972988590c6827fde2a61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_5f835be6950b54cbb8d860e2aa22b31f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_6ec76325673c62cbc4e270403c48b86f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4528bc6f11e7d4b70f998689cef3ef56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_9a055bae8328ecb478c766d451c6e925.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b68d0d72-2e80-5547-b98b-dcf7052359a7/b68d0d72-2e80-5547-b98b-dcf7052359a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/cd/afcd17ab9db69f0a92d103c18fa9bf2b/pa/EZ94996_4806f4a7406195a0722d059e5309c0be.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2016-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper D ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2016}
2026-04-27 07:56:24 [auto1.es] INFO: Saving data for EZ94996: {'created_time': 1777276584.399022, 'last_price_update_time': 1777276584.399035, 'has_photos': True, 'auction_closing_time': 1777305212.0}
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_1df522eedf8e6263bfa74d16a1ae9845.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_048c58e5aed0ff81898a1470ccfac620.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_130c2329a72fc14e5282663a2be169a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_03ef14a773ecf7fccdbc7aca8bd2f3c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_648cdc77e381871770463cec29c50904.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256690>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_d6e25b41a12e5194e2c3823e216af6e0.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048419590>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_87a31b54145c8a1f9b1914ae896d1830.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488842d0>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_fcbedf8d486a3153887c8d523112e44e.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 706500bd-2429-5763-90c0-21485bd4af38
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 706500bd-2429-5763-90c0-21485bd4af38, skipping ID generation
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706500bd-2429-5763-90c0-21485bd4af38 with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 706500bd-2429-5763-90c0-21485bd4af38 sending to next pipeline
2026-04-27 07:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 706500bd-2429-5763-90c0-21485bd4af38, identifier: JR39532
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833bd10>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_42dc0ff8ba91713373f5c0d0f8f2a2e9.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256690>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_a295fc9c38476a131bb6184dff28d757.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 423e501a-28ee-5602-859b-ce18172ab882
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 423e501a-28ee-5602-859b-ce18172ab882, skipping ID generation
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423e501a-28ee-5602-859b-ce18172ab882 with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 423e501a-28ee-5602-859b-ce18172ab882 sending to next pipeline
2026-04-27 07:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 423e501a-28ee-5602-859b-ce18172ab882, identifier: HB55085
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c51b524-47de-5145-bc7b-b7005d13ec4b with identifier: KB52077
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c51b524-47de-5145-bc7b-b7005d13ec4b with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_1010c0b7bbb4be494d80b2563d5fc218.jpg not downloaded yet
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482536d0>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_9b4a5c443d0f4eb931722cc0bf2c3d23.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f2650>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_fae5ade7b5387b87df1ad5e088306c1e.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_cee76bfaf2e6166a0a76f6d117bedcba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_e0ee7fe915d0cab7c64fa73a51c7711d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_d5e1a62234e1f3fc1dc3abf6d37a0aa7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 706500bd-2429-5763-90c0-21485bd4af38 with identifier: JR39532
2026-04-27 07:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 706500bd-2429-5763-90c0-21485bd4af38 with identifier: JR39532
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 706500bd-2429-5763-90c0-21485bd4af38 with identifier: JR39532 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_fcbedf8d486a3153887c8d523112e44e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 247,
'category': None,
'city': 'Cordoba',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.3L',
'engine_horse_power': 366,
'expiration_date': '2026-04-27T15:24:55Z',
'fuel_type': 'petrol',
'id': '706500bd-2429-5763-90c0-21485bd4af38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.8916,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR39532',
'listing': 'auction',
'location': 'ES, Córdoba',
'location_confidence': 'geocoded',
'longitude': -4.7727,
'make': 'Kia',
'model': 'Stinger',
'odometer': 205009,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f10bf018ce8b4aced80456782d509be0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_a08f5fd6a36816c229bd9d7468858ad3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_e2b56398e2224ef2bdb78e67425a329a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_c2b60ef38420daaaa556e1962a94fcae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_f5de0eb13e04167c1c5abf6a8bb23a49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_349f7050118d532eaac7b4197bf692f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_b411fa0573d203c24ff2f83ceebde483.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_98ee16e89f8326ccc4df2f758c997673.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_d6e25b41a12e5194e2c3823e216af6e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_706500bd-2429-5763-90c0-21485bd4af38/706500bd-2429-5763-90c0-21485bd4af38_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/5b/235b4ede72d22a45f075f36007aba886/pa/JR39532_fcbedf8d486a3153887c8d523112e44e.jpg',
'Width': 800}],
'postal_code': '14001',
'price': 0,
'price_includes_vat': True,
'province': 'Córdoba',
'province_code': 'ES-CO',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2019-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stinger 3.3 TGDI GT 4WD',
'transmission': 'automatic',
'trim': 'GT 4WD',
'year': 2019}
2026-04-27 07:56:25 [auto1.es] INFO: Saving data for JR39532: {'created_time': 1777276585.413832, 'last_price_update_time': 1777276585.413843, 'has_photos': True, 'auction_closing_time': 1777303495.0}
2026-04-27 07:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085
2026-04-27 07:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_a295fc9c38476a131bb6184dff28d757.jpg>
{'auction_title': '',
'c_o_2_emission_value': 207,
'category': 'Rental',
'city': 'La Roda De Andalucia',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 340,
'expiration_date': '2026-04-28T15:34:57Z',
'fuel_type': 'petrol',
'id': '423e501a-28ee-5602-859b-ce18172ab882',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB55085',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Porsche',
'model': 'Macan',
'odometer': 167331,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_052ba51807c05069b9552bc858b993a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_ffb77122e8af35003aacecbb411bfa44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_11db0a7bdcde7df4db791f527bfb87b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_9c1863d051b6b94d6608d9cfb512eda4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_38b04c80828080ff49a8d7378351793b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_a295fc9c38476a131bb6184dff28d757.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_7fe717a3dbc78b0420b323300b00e3e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_230931953892f43950ced7ecee8ae4b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_09857f90d17aee89907f45ca928e869e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_423e501a-28ee-5602-859b-ce18172ab882/423e501a-28ee-5602-859b-ce18172ab882_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/96/ca96d13a4a573dcdef79a994fd9acb64/pa/HB55085_0c57625131511e7889e891987d91b5ea.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2016-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 07:56:25 [auto1.es] INFO: Saving data for HB55085: {'created_time': 1777276585.849664, 'last_price_update_time': 1777276585.849675, 'has_photos': True, 'auction_closing_time': 1777390497.0}
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_604707472c6569a0c0a9e7336d77ceb5.jpg not downloaded yet
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_a352e4ddd244d3c4e6b59dec724fc601.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH74673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048249210>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_1df522eedf8e6263bfa74d16a1ae9845.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561
2026-04-27 07:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eec026b-58ea-5c45-ab2d-065ecf6b1561, skipping ID generation
2026-04-27 07:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561 with scrape type 1
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eec026b-58ea-5c45-ab2d-065ecf6b1561 sending to next pipeline
2026-04-27 07:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2eec026b-58ea-5c45-ab2d-065ecf6b1561, identifier: GJ86172
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486f0050>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_048c58e5aed0ff81898a1470ccfac620.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482514d0>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_130c2329a72fc14e5282663a2be169a6.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048366a90>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_03ef14a773ecf7fccdbc7aca8bd2f3c9.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b4ed0>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_648cdc77e381871770463cec29c50904.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_dbba7dac41c3339cf9efc0fdb3f41fce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_e9a0cef7eb66e08015852bf7a3770ac8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4b89081c180819e31492022775c8be0b.jpg not downloaded yet
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2eec026b-58ea-5c45-ab2d-065ecf6b1561 with identifier: GJ86172
2026-04-27 07:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2eec026b-58ea-5c45-ab2d-065ecf6b1561 with identifier: GJ86172
2026-04-27 07:56:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2eec026b-58ea-5c45-ab2d-065ecf6b1561 with identifier: GJ86172 to the API
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_1df522eedf8e6263bfa74d16a1ae9845.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:37:58Z',
'fuel_type': 'diesel',
'id': '2eec026b-58ea-5c45-ab2d-065ecf6b1561',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ86172',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 204861,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_539a2660046488958725cd47f0e6a41b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_9b51e206300f6c69e78b9d3f2e318146.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_5cb39cce14c963de5396c4db77c3a2c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c4c24170be3a2b06ed8b7e46d5c76aff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_1df522eedf8e6263bfa74d16a1ae9845.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_143bfa23d37e5bf3c48f67b9ed0bf720.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_8ab721d11d30f7f951218983fd71f863.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_87a31b54145c8a1f9b1914ae896d1830.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_c6b064aa55313767f351a3dfd9690330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eec026b-58ea-5c45-ab2d-065ecf6b1561/2eec026b-58ea-5c45-ab2d-065ecf6b1561_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/c3/6ac338f73159b02b3b26d3e382d3ee69/pa/GJ86172_cd4ad280e496310c3d2c7461c4424f18.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2020-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
'transmission': 'manual',
'trim': 'GT L1',
'year': 2020}
2026-04-27 07:56:26 [auto1.es] INFO: Saving data for GJ86172: {'created_time': 1777276586.834688, 'last_price_update_time': 1777276586.8347, 'has_photos': True, 'auction_closing_time': 1777390678.0}
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483623d0>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_cee76bfaf2e6166a0a76f6d117bedcba.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ddaae84-6c58-5e10-942c-bda08df5ef49
2026-04-27 07:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ddaae84-6c58-5e10-942c-bda08df5ef49, skipping ID generation
2026-04-27 07:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ddaae84-6c58-5e10-942c-bda08df5ef49 with scrape type 1
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ddaae84-6c58-5e10-942c-bda08df5ef49 sending to next pipeline
2026-04-27 07:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ddaae84-6c58-5e10-942c-bda08df5ef49, identifier: GF69614
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048872a50>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_e0ee7fe915d0cab7c64fa73a51c7711d.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e30c6087-daa6-5211-868a-cf365847f9f1
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e30c6087-daa6-5211-868a-cf365847f9f1, skipping ID generation
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e30c6087-daa6-5211-868a-cf365847f9f1 with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e30c6087-daa6-5211-868a-cf365847f9f1 sending to next pipeline
2026-04-27 07:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e30c6087-daa6-5211-868a-cf365847f9f1, identifier: EU45486
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484eb350>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_d5e1a62234e1f3fc1dc3abf6d37a0aa7.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b0d8428c26f52e757f61b716bd9f7b6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_489343237d885bba170f2572cc408b8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ddaae84-6c58-5e10-942c-bda08df5ef49 with identifier: GF69614
2026-04-27 07:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ddaae84-6c58-5e10-942c-bda08df5ef49 with identifier: GF69614
2026-04-27 07:56:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ddaae84-6c58-5e10-942c-bda08df5ef49 with identifier: GF69614 to the API
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_cee76bfaf2e6166a0a76f6d117bedcba.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Campo Real',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:46:45Z',
'fuel_type': 'diesel',
'id': '6ddaae84-6c58-5e10-942c-bda08df5ef49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF69614',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 188551,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_c46ff08d57284ac411e20c448d9fce2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_cee76bfaf2e6166a0a76f6d117bedcba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_27b20783a19908efedddb34195da73db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_07e10450fe9a662896c4d15b823a6c2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_130c2329a72fc14e5282663a2be169a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_4e0f3829646ecc702f99ab696a783775.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_b1da75182072c061a566b6bc0f363793.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_fae5ade7b5387b87df1ad5e088306c1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_d4ff83639d75aee4b0be95873325d4e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ddaae84-6c58-5e10-942c-bda08df5ef49/6ddaae84-6c58-5e10-942c-bda08df5ef49_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2d/e92d67c5c3d34a916abf4d3ecfcb7947/pa/GF69614_f66ca9ffe5ef5ee13eb147ff47168ee8.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2017-11-23',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2017}
2026-04-27 07:56:27 [auto1.es] INFO: Saving data for GF69614: {'created_time': 1777276587.603834, 'last_price_update_time': 1777276587.603845, 'has_photos': True, 'auction_closing_time': 1777391205.0}
2026-04-27 07:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e30c6087-daa6-5211-868a-cf365847f9f1 with identifier: EU45486
2026-04-27 07:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e30c6087-daa6-5211-868a-cf365847f9f1 with identifier: EU45486
2026-04-27 07:56:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e30c6087-daa6-5211-868a-cf365847f9f1 with identifier: EU45486 to the API
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_e0ee7fe915d0cab7c64fa73a51c7711d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'city': 'Oiartzun',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-04-28T15:08:39Z',
'fuel_type': 'hybrid',
'id': 'e30c6087-daa6-5211-868a-cf365847f9f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 43.2983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU45486',
'listing': 'auction',
'location': 'ES, Oiartzun',
'location_confidence': 'geocoded',
'longitude': -1.8613,
'make': 'Hyundai',
'model': 'Kona',
'odometer': 36812,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_41515405bc70e76dba5fbfe58e9cf01b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_242d9ce6184d2d06e3045f850fcf1b3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_31d1d7b28f5edfa9aea8fa42d4f70e3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_f7b72b6bfd021e2070afe6eed167486a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_cef3e97c2e85335e08561f688cf6f8ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_421942afddd0d2b445a9f4dd5cd7f0f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_a3337ae058178aae63a3a327e9246cb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_64de8489ad727518be5b8540ffe5119f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_e0ee7fe915d0cab7c64fa73a51c7711d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e30c6087-daa6-5211-868a-cf365847f9f1/e30c6087-daa6-5211-868a-cf365847f9f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/32/39321e50e391866bf31727f022fd99a2/pa/EU45486_88c2b1bf9f5005675bfcff818d49aced.jpg',
'Width': 800}],
'postal_code': '20180',
'price': 0,
'price_includes_vat': True,
'province': 'Guipúzcoa',
'province_code': 'ES-SS',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2023-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 1.6 Hybrid N Line 2WD',
'transmission': 'automatic',
'trim': 'N Line 2WD',
'year': 2023}
2026-04-27 07:56:27 [auto1.es] INFO: Saving data for EU45486: {'created_time': 1777276587.986294, 'last_price_update_time': 1777276587.986304, 'has_photos': True, 'auction_closing_time': 1777388919.0}
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_7f24b0f8f8c83fbfaa0502e1ffea0fcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_020386717a78606eaee6852b378a5082.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_34e91cbaf84c00c25701d01489570993.jpg not downloaded yet
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC66247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5490>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_a352e4ddd244d3c4e6b59dec724fc601.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW09945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM87418> (referer: https://www.auto1.com/v1/car-details-view/FM87418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES62151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ff010>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_dbba7dac41c3339cf9efc0fdb3f41fce.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e53957cb-51e1-5292-af92-853180c1329a
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53957cb-51e1-5292-af92-853180c1329a, skipping ID generation
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53957cb-51e1-5292-af92-853180c1329a with scrape type 1
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53957cb-51e1-5292-af92-853180c1329a sending to next pipeline
2026-04-27 07:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e53957cb-51e1-5292-af92-853180c1329a, identifier: EU88532
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838c9d0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_e9a0cef7eb66e08015852bf7a3770ac8.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_1010c0b7bbb4be494d80b2563d5fc218.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_359413ecdc790c217fa3b8b4bed31673.jpg not downloaded yet
2026-04-27 07:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e53957cb-51e1-5292-af92-853180c1329a with identifier: EU88532
2026-04-27 07:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e53957cb-51e1-5292-af92-853180c1329a with identifier: EU88532
2026-04-27 07:56:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e53957cb-51e1-5292-af92-853180c1329a with identifier: EU88532 to the API
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_dbba7dac41c3339cf9efc0fdb3f41fce.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'city': 'Esquivias',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:37:34Z',
'fuel_type': 'diesel',
'id': 'e53957cb-51e1-5292-af92-853180c1329a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU88532',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 51136,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_8c39f3034b89595e794b01cb00995da3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_443d013ab52065da0697f72dbb2d272c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e5a86ef2c21f719b572947afe1eb8593.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_e8b92fb31e3b469fea37cc1b3ad2bf5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_42dc0ff8ba91713373f5c0d0f8f2a2e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_9b4a5c443d0f4eb931722cc0bf2c3d23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_048c58e5aed0ff81898a1470ccfac620.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_648cdc77e381871770463cec29c50904.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_a352e4ddd244d3c4e6b59dec724fc601.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e53957cb-51e1-5292-af92-853180c1329a/e53957cb-51e1-5292-af92-853180c1329a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bfc868c5e72ab6493ee8bfa7dd60a3/pa/EU88532_dbba7dac41c3339cf9efc0fdb3f41fce.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2024-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2024}
2026-04-27 07:56:28 [auto1.es] INFO: Saving data for EU88532: {'created_time': 1777276588.789998, 'last_price_update_time': 1777276588.790011, 'has_photos': True, 'auction_closing_time': 1777304254.0}
2026-04-27 07:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff063687390>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b0d8428c26f52e757f61b716bd9f7b6a.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a84df90>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_489343237d885bba170f2572cc408b8b.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_331d44fc0828a2db672e2138bef5af53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_03cb231d40516667cbc857a9d0f5dfbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_604707472c6569a0c0a9e7336d77ceb5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_da647ae85def70e6f06a4660d8f9b064.jpg not downloaded yet
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a84e4d0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_7f24b0f8f8c83fbfaa0502e1ffea0fcc.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048360fd0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_020386717a78606eaee6852b378a5082.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1ad6640-4516-5ae8-9908-03213a5c0fd5 with identifier: FM87418
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ad6640-4516-5ae8-9908-03213a5c0fd5 with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_b835830f5fe711cf383cbc1ba10aee5f.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4b89081c180819e31492022775c8be0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_10c6cc0c9aa9b081a7d59cf809d72e6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB92602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483df350>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_1010c0b7bbb4be494d80b2563d5fc218.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_f6148838c38e7d8e61ff9323bfdca6c6.jpg not downloaded yet
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_cbf84df5a32ea9684f3dc2b2e46e20e4.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_34e91cbaf84c00c25701d01489570993.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN89621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048590a10>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_331d44fc0828a2db672e2138bef5af53.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048897010>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_03cb231d40516667cbc857a9d0f5dfbf.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f4c90>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_604707472c6569a0c0a9e7336d77ceb5.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_3b5db0ea5a1089b3d22d2dc3c0c11f3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_055abd7e40abeb1691321e96c92d9598.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_a80dc9cd61fa339debd22616a88f72c2.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_caa516b42efa0432cb2e40d39d4aa5b1.jpg not downloaded yet
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_359413ecdc790c217fa3b8b4bed31673.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7e24402e2e49463909c650b4cba17fca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_eefd23eef59db8372aa6260f6b680eb1.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_f2b39fa740bc88c4d1e83287d443d3cc.jpg not downloaded yet
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e88d0>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4b89081c180819e31492022775c8be0b.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048385bd0>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_10c6cc0c9aa9b081a7d59cf809d72e6e.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048731050>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_34e91cbaf84c00c25701d01489570993.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_b835830f5fe711cf383cbc1ba10aee5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_cbf84df5a32ea9684f3dc2b2e46e20e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4a7378fb44d71526e050644bfecc8d69.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bb2262767c6e7ea70fd762e65e670885.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_f6148838c38e7d8e61ff9323bfdca6c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048376ad0>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_3b5db0ea5a1089b3d22d2dc3c0c11f3c.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8cb2c75-d89f-5c25-9dd0-e9a0539273ba, skipping ID generation
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8cb2c75-d89f-5c25-9dd0-e9a0539273ba sending to next pipeline
2026-04-27 07:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b8cb2c75-d89f-5c25-9dd0-e9a0539273ba, identifier: CL48879
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a85fe50>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_055abd7e40abeb1691321e96c92d9598.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 330f8dfe-88c7-567d-9971-fbaffbaba0c2, skipping ID generation
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2 sending to next pipeline
2026-04-27 07:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 330f8dfe-88c7-567d-9971-fbaffbaba0c2, identifier: EB93661
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048998690>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_359413ecdc790c217fa3b8b4bed31673.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485eeb90>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7e24402e2e49463909c650b4cba17fca.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_2dc8c8536b41aec73af2df5a3f64f754.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b8cb2c75-d89f-5c25-9dd0-e9a0539273ba with identifier: CL48879
2026-04-27 07:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b8cb2c75-d89f-5c25-9dd0-e9a0539273ba with identifier: CL48879
2026-04-27 07:56:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b8cb2c75-d89f-5c25-9dd0-e9a0539273ba with identifier: CL48879 to the API
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_3b5db0ea5a1089b3d22d2dc3c0c11f3c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 91,
'category': None,
'city': 'Granyanella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:24:06Z',
'fuel_type': 'hybrid',
'id': 'b8cb2c75-d89f-5c25-9dd0-e9a0539273ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL48879',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Toyota',
'model': 'Auris',
'odometer': 230796,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_81251d5268c79b4eaf87609801029db6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_c8cebc6f7e489fa585cc5ee06fb490a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_65f359f07000f9383f88d6fa2b159ab9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_ce69555252397d0637e53273d032d249.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_3b5db0ea5a1089b3d22d2dc3c0c11f3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_9881589ae3328cec8cdee9fd556b15e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_331d44fc0828a2db672e2138bef5af53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_52c6b16d3e85dc475047dab3294e582c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_03cb231d40516667cbc857a9d0f5dfbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8cb2c75-d89f-5c25-9dd0-e9a0539273ba/b8cb2c75-d89f-5c25-9dd0-e9a0539273ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/cd/a2cd6e06d8795dd164c8d02530e55b46/pa/CL48879_7f24b0f8f8c83fbfaa0502e1ffea0fcc.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2013-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.8 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2013}
2026-04-27 07:56:30 [auto1.es] INFO: Saving data for CL48879: {'created_time': 1777276590.360713, 'last_price_update_time': 1777276590.360729, 'has_photos': True, 'auction_closing_time': 1777389846.0}
2026-04-27 07:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661
2026-04-27 07:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661
2026-04-27 07:56:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661 to the API
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_055abd7e40abeb1691321e96c92d9598.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:35:09Z',
'fuel_type': 'diesel',
'id': '330f8dfe-88c7-567d-9971-fbaffbaba0c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB93661',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'BMW',
'model': '1er',
'odometer': 187105,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_055abd7e40abeb1691321e96c92d9598.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_396e732f8cfc29ef544864cbb858443f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_35dba6ed8f69f75add0b746f3986a0d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_6491a0fb29dbeab603e6495123e25829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_caa7295d1e6fe59139113f010fd5cfda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_489343237d885bba170f2572cc408b8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_e251d31b5ec5a0e5993ffd256749cdba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_d5e1a62234e1f3fc1dc3abf6d37a0aa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_844cca037120dab0dd0d9652421f1972.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_330f8dfe-88c7-567d-9971-fbaffbaba0c2/330f8dfe-88c7-567d-9971-fbaffbaba0c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8c/2e8ce87b785a3db5db3a0e1fbf35bc5c/pa/EB93661_1543fa5c80c4784748aae045bf8eec19.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2008-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 07:56:30 [auto1.es] INFO: Saving data for EB93661: {'created_time': 1777276590.748174, 'last_price_update_time': 1777276590.748185, 'has_photos': True, 'auction_closing_time': 1777390509.0}
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_caa516b42efa0432cb2e40d39d4aa5b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_68ce2c21fee9db5b3f298b46edf8decf.jpg not downloaded yet
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM69944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT83895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB60699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486f2890>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_b835830f5fe711cf383cbc1ba10aee5f.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048375dd0>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_cbf84df5a32ea9684f3dc2b2e46e20e4.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04829da90>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_f6148838c38e7d8e61ff9323bfdca6c6.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS89718/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU74019/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH74673> (referer: https://www.auto1.com/v1/car-details-view/SH74673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_f2b39fa740bc88c4d1e83287d443d3cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bc2383dab6da81f0f59f660bb3118aeb.jpg not downloaded yet
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ec390>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_caa516b42efa0432cb2e40d39d4aa5b1.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_1e11a92fe7d98115c4e969a7b058d63a.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_04ed03926302f906d1ddec24b130c2a0.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673
2026-04-27 07:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with scrape type 1
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_bc98fb35e989ffc463f80f6c930d30a1.jpg not downloaded yet
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c8110>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_f2b39fa740bc88c4d1e83287d443d3cc.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_a80dc9cd61fa339debd22616a88f72c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bb2262767c6e7ea70fd762e65e670885.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_17ecdee82679315c639bdeb25317ccd8.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4a7378fb44d71526e050644bfecc8d69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_2dc8c8536b41aec73af2df5a3f64f754.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_eefd23eef59db8372aa6260f6b680eb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_a4f2ab348b9b886645becbc44711e4ab.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_476f0c852d100ac2731923a08f3fef09.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_da647ae85def70e6f06a4660d8f9b064.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00bb171166c4180c2a6bbeb0a8b761e5.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_68ce2c21fee9db5b3f298b46edf8decf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_209522466e510422a6b9234455cafe2d.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_89b2784e18c1b9e2e08999b844f23bb4.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_2dd70ec51480cf5905429f7aa0648303.jpg not downloaded yet
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048425050>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_a80dc9cd61fa339debd22616a88f72c2.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851c310>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bb2262767c6e7ea70fd762e65e670885.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_26945318aed680aa127a2a84e6101608.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_04ed03926302f906d1ddec24b130c2a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_17ecdee82679315c639bdeb25317ccd8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048427450>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4a7378fb44d71526e050644bfecc8d69.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048716c90>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_2dc8c8536b41aec73af2df5a3f64f754.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3ed0>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_eefd23eef59db8372aa6260f6b680eb1.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_bc98fb35e989ffc463f80f6c930d30a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00061683c97bd8b15705b19964b89734.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00bb171166c4180c2a6bbeb0a8b761e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_476f0c852d100ac2731923a08f3fef09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048524350>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_da647ae85def70e6f06a4660d8f9b064.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c51b524-47de-5145-bc7b-b7005d13ec4b
2026-04-27 07:56:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c51b524-47de-5145-bc7b-b7005d13ec4b, skipping ID generation
2026-04-27 07:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c51b524-47de-5145-bc7b-b7005d13ec4b with scrape type 1
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c51b524-47de-5145-bc7b-b7005d13ec4b sending to next pipeline
2026-04-27 07:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c51b524-47de-5145-bc7b-b7005d13ec4b, identifier: KB52077
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057010fd0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_68ce2c21fee9db5b3f298b46edf8decf.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX85324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c51b524-47de-5145-bc7b-b7005d13ec4b with identifier: KB52077
2026-04-27 07:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c51b524-47de-5145-bc7b-b7005d13ec4b with identifier: KB52077
2026-04-27 07:56:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c51b524-47de-5145-bc7b-b7005d13ec4b with identifier: KB52077 to the API
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_da647ae85def70e6f06a4660d8f9b064.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Esquivias',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:34:34Z',
'fuel_type': 'petrol',
'id': '8c51b524-47de-5145-bc7b-b7005d13ec4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB52077',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 95836,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_1010c0b7bbb4be494d80b2563d5fc218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_604707472c6569a0c0a9e7336d77ceb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4b89081c180819e31492022775c8be0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_34e91cbaf84c00c25701d01489570993.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_359413ecdc790c217fa3b8b4bed31673.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_da647ae85def70e6f06a4660d8f9b064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_f6148838c38e7d8e61ff9323bfdca6c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_a80dc9cd61fa339debd22616a88f72c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_eefd23eef59db8372aa6260f6b680eb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8c51b524-47de-5145-bc7b-b7005d13ec4b/8c51b524-47de-5145-bc7b-b7005d13ec4b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/e9/b9e962c66f1cd8b83fe92f257e33995a/pa/KB52077_4a7378fb44d71526e050644bfecc8d69.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2017}
2026-04-27 07:56:32 [auto1.es] INFO: Saving data for KB52077: {'created_time': 1777276592.441445, 'last_price_update_time': 1777276592.441462, 'has_photos': True, 'auction_closing_time': 1777304074.0}
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487402d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_04ed03926302f906d1ddec24b130c2a0.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048717010>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_17ecdee82679315c639bdeb25317ccd8.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_89b2784e18c1b9e2e08999b844f23bb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_2dd70ec51480cf5905429f7aa0648303.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN42055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF04433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048828110>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_bc98fb35e989ffc463f80f6c930d30a1.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256450>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00bb171166c4180c2a6bbeb0a8b761e5.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a0710>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_476f0c852d100ac2731923a08f3fef09.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_26945318aed680aa127a2a84e6101608.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES62151> (referer: https://www.auto1.com/v1/car-details-view/ES62151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN89621> (referer: https://www.auto1.com/v1/car-details-view/UN89621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW09945> (referer: https://www.auto1.com/v1/car-details-view/TW09945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB92602> (referer: https://www.auto1.com/v1/car-details-view/DB92602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256210>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_89b2784e18c1b9e2e08999b844f23bb4.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048540690>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_2dd70ec51480cf5905429f7aa0648303.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_209522466e510422a6b9234455cafe2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824d1d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_26945318aed680aa127a2a84e6101608.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_a4f2ab348b9b886645becbc44711e4ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_1e11a92fe7d98115c4e969a7b058d63a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bc2383dab6da81f0f59f660bb3118aeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b07256-b3ba-5df4-845c-9d8e2427e26e with identifier: ES62151
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b07256-b3ba-5df4-845c-9d8e2427e26e with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_dc3f6e449e09343818a6746044fc97e0.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8a388f-19a6-53e2-86ce-6219832dc464 with identifier: UN89621
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8a388f-19a6-53e2-86ce-6219832dc464 with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4a0e9080c570617ef7708817fc53d06d.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c with identifier: TW09945
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_123fe886e736ad1744f786b65bc645e9.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_f85cae5d44b34561171bd5bede034ae7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_c5dbc0a77eecadc4f4f3b4e3c847a901.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78bf8a1-ca65-58b3-900e-035028ec03b3 with identifier: DB92602
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78bf8a1-ca65-58b3-900e-035028ec03b3 with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_700bd3c2d7e9c38180d49f2f95795db6.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_3109bb28895ce8feb882d4f97240c1f5.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4f7bed5e1b4786eb170be1d3d5c1c484.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_093b35e0da013fdd2202c31cde07303a.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00061683c97bd8b15705b19964b89734.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_4daad1151d95df705d336da676c3c6ce.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_64747c8ba1cf70a3afb4e867b1187936.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_3085fa190f1a1c32f52bf45787b654c1.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_483567427b8d401216dc93df65d0ddd3.jpg not downloaded yet
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048253b10>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_209522466e510422a6b9234455cafe2d.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048225350>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_a4f2ab348b9b886645becbc44711e4ab.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048485190>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_1e11a92fe7d98115c4e969a7b058d63a.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048891910>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bc2383dab6da81f0f59f660bb3118aeb.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1ad6640-4516-5ae8-9908-03213a5c0fd5
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1ad6640-4516-5ae8-9908-03213a5c0fd5, skipping ID generation
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ad6640-4516-5ae8-9908-03213a5c0fd5 with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1ad6640-4516-5ae8-9908-03213a5c0fd5 sending to next pipeline
2026-04-27 07:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1ad6640-4516-5ae8-9908-03213a5c0fd5, identifier: FM87418
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_af9f95036327aac7536270c3a059b28d.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1ad6640-4516-5ae8-9908-03213a5c0fd5 with identifier: FM87418
2026-04-27 07:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1ad6640-4516-5ae8-9908-03213a5c0fd5 with identifier: FM87418
2026-04-27 07:56:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1ad6640-4516-5ae8-9908-03213a5c0fd5 with identifier: FM87418 to the API
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bc2383dab6da81f0f59f660bb3118aeb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'city': 'Esquivias',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-04-27T15:54:33Z',
'fuel_type': 'petrol',
'id': 'd1ad6640-4516-5ae8-9908-03213a5c0fd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM87418',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Volvo',
'model': 'S60',
'odometer': 51497,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36260,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_b835830f5fe711cf383cbc1ba10aee5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36260,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_cbf84df5a32ea9684f3dc2b2e46e20e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35157,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_caa516b42efa0432cb2e40d39d4aa5b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33853,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_f2b39fa740bc88c4d1e83287d443d3cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28318,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bb2262767c6e7ea70fd762e65e670885.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35751,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_2dc8c8536b41aec73af2df5a3f64f754.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32910,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_68ce2c21fee9db5b3f298b46edf8decf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36471,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_bc2383dab6da81f0f59f660bb3118aeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30389,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_1e11a92fe7d98115c4e969a7b058d63a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1ad6640-4516-5ae8-9908-03213a5c0fd5/d1ad6640-4516-5ae8-9908-03213a5c0fd5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57880,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img7a/04/7a04bbe1cd3f2483e4b64f64bfa7eabe/pa/FM87418_04ed03926302f906d1ddec24b130c2a0.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2023-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo S60 2.0 B4 Mild-Hybrid Core',
'transmission': 'automatic',
'trim': 'Core',
'year': 2023}
2026-04-27 07:56:33 [auto1.es] INFO: Saving data for FM87418: {'created_time': 1777276593.867596, 'last_price_update_time': 1777276593.867608, 'has_photos': True, 'auction_closing_time': 1777305273.0}
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_b66e05eb6288de8f7205f3cc7c73bf35.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bd19c4baaba5665602cd5dc7620373e1.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_feda75a31774c4a4d2f74c6c8d0b8a58.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_a897a75d64f6e8b1c3bd68e7e3b7f8f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_98be3f40f1f64af7940d8601275e162c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.extensions.logstats] INFO: Crawled 169 pages (at 91 pages/min), scraped 234 items (at 58 items/min)
2026-04-27 07:56:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 378MiB
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b71ae8aa97bb2260da12f94fbc0d8b5f.jpg not downloaded yet
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823cd10>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_f85cae5d44b34561171bd5bede034ae7.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd3a5a72-1560-571f-b80b-a36f343dc2bd
2026-04-27 07:56:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd3a5a72-1560-571f-b80b-a36f343dc2bd, skipping ID generation
2026-04-27 07:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3a5a72-1560-571f-b80b-a36f343dc2bd with scrape type 1
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd3a5a72-1560-571f-b80b-a36f343dc2bd sending to next pipeline
2026-04-27 07:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd3a5a72-1560-571f-b80b-a36f343dc2bd, identifier: GH03628
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048658290>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_c5dbc0a77eecadc4f4f3b4e3c847a901.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048376190>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00061683c97bd8b15705b19964b89734.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a
2026-04-27 07:56:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a, skipping ID generation
2026-04-27 07:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with scrape type 1
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a sending to next pipeline
2026-04-27 07:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a, identifier: SH74673
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_331b683e156b279c4e41c3d54335de99.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_c92b82074978621d3b23d9c2dba544dc.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_b65b4ac5a834fd154f2aef24b5603292.jpg not downloaded yet
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY82802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC66247> (referer: https://www.auto1.com/v1/car-details-view/SC66247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd3a5a72-1560-571f-b80b-a36f343dc2bd with identifier: GH03628
2026-04-27 07:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd3a5a72-1560-571f-b80b-a36f343dc2bd with identifier: GH03628
2026-04-27 07:56:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd3a5a72-1560-571f-b80b-a36f343dc2bd with identifier: GH03628 to the API
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_f85cae5d44b34561171bd5bede034ae7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'city': 'Aldaya',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:57:39Z',
'fuel_type': 'petrol',
'id': 'dd3a5a72-1560-571f-b80b-a36f343dc2bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH03628',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Mokka X',
'odometer': 190737,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_f85cae5d44b34561171bd5bede034ae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7e24402e2e49463909c650b4cba17fca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_7093d842337e4d72bde6d7869cc2a93e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_10c6cc0c9aa9b081a7d59cf809d72e6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b88106b1cf8a94b744409a2de6febf4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_5b53ca5a2e92a970bd04fb08945e8fd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_020386717a78606eaee6852b378a5082.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_b0d8428c26f52e757f61b716bd9f7b6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_e9a0cef7eb66e08015852bf7a3770ac8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3a5a72-1560-571f-b80b-a36f343dc2bd/dd3a5a72-1560-571f-b80b-a36f343dc2bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/20/1620a8b7bcc5986b7148e15d9005bf1a/pa/GH03628_03ef14a773ecf7fccdbc7aca8bd2f3c9.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-04-27 07:56:34 [auto1.es] INFO: Saving data for GH03628: {'created_time': 1777276594.76986, 'last_price_update_time': 1777276594.769872, 'has_photos': True, 'auction_closing_time': 1777391859.0}
2026-04-27 07:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673
2026-04-27 07:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673
2026-04-27 07:56:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673 to the API
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00061683c97bd8b15705b19964b89734.jpg>
{'auction_title': '',
'c_o_2_emission_value': 161,
'category': None,
'city': 'Barcelona',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:00:26Z',
'fuel_type': 'petrol',
'id': '7d652d0e-e2f7-5f4a-b91b-7eed2d34012a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH74673',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Ssangyong',
'model': 'Tivoli',
'odometer': 12107,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_bc98fb35e989ffc463f80f6c930d30a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_17ecdee82679315c639bdeb25317ccd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_a4f2ab348b9b886645becbc44711e4ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_476f0c852d100ac2731923a08f3fef09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00bb171166c4180c2a6bbeb0a8b761e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_209522466e510422a6b9234455cafe2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_89b2784e18c1b9e2e08999b844f23bb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_2dd70ec51480cf5905429f7aa0648303.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_26945318aed680aa127a2a84e6101608.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d652d0e-e2f7-5f4a-b91b-7eed2d34012a/7d652d0e-e2f7-5f4a-b91b-7eed2d34012a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc7d2a4e0d6eeaf2e74ea0c5e43a11/pa/SH74673_00061683c97bd8b15705b19964b89734.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2021-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'Ssangyong Tivoli 1.5 T-GDI Amber 4x2',
'transmission': 'manual',
'trim': 'Amber 4x2',
'year': 2021}
2026-04-27 07:56:35 [auto1.es] INFO: Saving data for SH74673: {'created_time': 1777276595.112856, 'last_price_update_time': 1777276595.112868, 'has_photos': True, 'auction_closing_time': 1777302026.0}
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_093b35e0da013fdd2202c31cde07303a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_6f4a28597fe6ec06329e78de5fcbd42f.jpg not downloaded yet
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU74019> (referer: https://www.auto1.com/v1/car-details-view/DU74019/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_963900dcb01eaa10e15e022ab02079e4.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bb6852e17143fc023c8739b7d287e29d.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_1247bec0987ecdba064af3b28cb84318.jpg not downloaded yet
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB60699> (referer: https://www.auto1.com/v1/car-details-view/DB60699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM69944> (referer: https://www.auto1.com/v1/car-details-view/ZM69944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ14425> (referer: https://www.auto1.com/v1/car-details-view/MZ14425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT83895> (referer: https://www.auto1.com/v1/car-details-view/MT83895/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a360d0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_a897a75d64f6e8b1c3bd68e7e3b7f8f1.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048457390>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_98be3f40f1f64af7940d8601275e162c.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b9d33b4e15eaa854b63149aba014f3b8.jpg not downloaded yet
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c with identifier: SC66247
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_9e8b5c08cad027198e91a7a2673ba30a.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_8eac1e4ad658ebcf3149a6cdbdaf01d5.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_2fe3db89e8ccd69dffa7e21fb54b1fa0.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_9bcaea26d160a7d0f82838bca687417e.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_af9f95036327aac7536270c3a059b28d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_483567427b8d401216dc93df65d0ddd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7ff788fcb86b964939a6321edafaf254.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_38ebbab0d44d16d826cbc4c65b55fc04.jpg not downloaded yet
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048593250>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_093b35e0da013fdd2202c31cde07303a.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 with identifier: DU74019
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_e20a1b49dbb73455c0c812efae20a20a.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed6ec754-8927-5350-9d54-1eab72a7d950 with identifier: DB60699
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed6ec754-8927-5350-9d54-1eab72a7d950 with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_8993d31eb7fd5dc4876158f12468f068.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_d33fdbffd5d2914d52183718cd5d3e7a.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247c5357-45bd-5399-bf34-086ca608b6ab with identifier: MZ14425
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247c5357-45bd-5399-bf34-086ca608b6ab with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_e902d6e7b1ee07ac4c331a85e4a317a3.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 207f7261-56ce-5cf2-ad87-6a2f383c9324 with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_1f39a688eeb2f505c819fcd39435a376.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bd19c4baaba5665602cd5dc7620373e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_ec02487d5c183e4c2414253d345764f6.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_83129ab46e6b4c094e6744ec31164baa.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_4db1fa9125b9d26cabd327b81526bffe.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_acd985306f77d7ef3cb128a3b96e407c.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_b8067bba429c8ec374ab491e62f97df9.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_25db4710ec7469c0ee6fcd7e544213cf.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9bce24deaafc5785815efffd5148a29e.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_3572c7fd06ededab2298d4c52b7c1747.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_139ffa573139861aec9687b4227bde20.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_47d4573a8abeeed2da68aa4e2ebdb0ce.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_c92b82074978621d3b23d9c2dba544dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b71ae8aa97bb2260da12f94fbc0d8b5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_feda75a31774c4a4d2f74c6c8d0b8a58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_b65b4ac5a834fd154f2aef24b5603292.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_6f4a28597fe6ec06329e78de5fcbd42f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_77a6405cf62ac43d56d428e94115702e.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_07e287e0761b23d5a52818097ed1673a.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_eb4fcd59895ec57004718907ef9652b2.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_331b683e156b279c4e41c3d54335de99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_b66e05eb6288de8f7205f3cc7c73bf35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7de283f6b0e050bda712ff555d8230ab.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_0afea1e6173e730fb11383ac25372673.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_f641befa8a94769acc787f3818f96e35.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_855b08ce527a645703d6c5a07a1b9f0d.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_178386f02b5b9e871bea01428c6bd6d5.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_f9a94f73b9c82dc78dfc62ed597bdbdf.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_4e44ea41c7df0290ad49f3e900e953ec.jpg not downloaded yet
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b71d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_af9f95036327aac7536270c3a059b28d.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7a790>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_483567427b8d401216dc93df65d0ddd3.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_1418085600ec38d2e564ccbd2d58e62b.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_ad5be815da1a3f00fc876e10b36f4fcb.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_0092f765830b7401f8855bbbca2657cd.jpg not downloaded yet
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048507890>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bd19c4baaba5665602cd5dc7620373e1.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_9e8b5c08cad027198e91a7a2673ba30a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_60f6ca77924088a4eda53b219b5d70dd.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_40d82d9f2f6069890b2901a246a98191.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8f16fa70c4d0a990eb7dfed9e2df343f.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_068f5ad638a675fc8dff9775dd0da45f.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_9713da625b36aa69eaef97c4f58c303e.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_4a25fbc38e47db9a18e10b4db703209e.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_ad55a2858df8cef9e8d037344d50a5cd.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_1f39a688eeb2f505c819fcd39435a376.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820af10>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_c92b82074978621d3b23d9c2dba544dc.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896d10>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b71ae8aa97bb2260da12f94fbc0d8b5f.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c29d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_feda75a31774c4a4d2f74c6c8d0b8a58.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896050>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_b65b4ac5a834fd154f2aef24b5603292.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048717450>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_6f4a28597fe6ec06329e78de5fcbd42f.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823a4d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_331b683e156b279c4e41c3d54335de99.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048505250>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_b66e05eb6288de8f7205f3cc7c73bf35.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_ec02487d5c183e4c2414253d345764f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_83129ab46e6b4c094e6744ec31164baa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_d33fdbffd5d2914d52183718cd5d3e7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_e902d6e7b1ee07ac4c331a85e4a317a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_10baa63415ea61315c3f722e8451b75d.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_5600931e3fe67d6f6f30fb8d17db9192.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_f22671a45a343d93a04378d93a8f86ba.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_ff233a54af06faffb47058f1931bc1d8.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_5c697b2e6fb4975e6f4b6255beded8df.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_646df183d0cbae7eb5d9523e591cc82b.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_4db1fa9125b9d26cabd327b81526bffe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_47d4573a8abeeed2da68aa4e2ebdb0ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a41d0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_9e8b5c08cad027198e91a7a2673ba30a.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_d578337d7ca7b2488154e1d139649e67.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_b2e33aaa0b8be084f4dd853489c4da74.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_c6aa092cd9246a14426811692fcd6325.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_beeac7d5bec13f99ba82050c256a47c0.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_5d91d7b4b5717aa4152d2982042fd65d.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB45585> (referer: https://www.auto1.com/v1/car-details-view/NB45585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF04433> (referer: https://www.auto1.com/v1/car-details-view/MF04433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889f890>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_1f39a688eeb2f505c819fcd39435a376.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_068f5ad638a675fc8dff9775dd0da45f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_9713da625b36aa69eaef97c4f58c303e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_ad5be815da1a3f00fc876e10b36f4fcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_b614c03582a00526d5feebcefac1a81c.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_99b6093ec487c4c7501d7b27cd2dec39.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_f3dfff6320498d050ddb711f0ddff2ef.jpg not downloaded yet
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c9310>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_ec02487d5c183e4c2414253d345764f6.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048802010>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_83129ab46e6b4c094e6744ec31164baa.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520c50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_d33fdbffd5d2914d52183718cd5d3e7a.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048656f50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_e902d6e7b1ee07ac4c331a85e4a317a3.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_139ffa573139861aec9687b4227bde20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_ad55a2858df8cef9e8d037344d50a5cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_0092f765830b7401f8855bbbca2657cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_9e12ef2066b304e2ab8b5068329539dc.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_2c4d604d62b8e2715682f32b31d4151b.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_67f8320369f745bd51daf279f094c96e.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_4a25fbc38e47db9a18e10b4db703209e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8f16fa70c4d0a990eb7dfed9e2df343f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04849d5d0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_4db1fa9125b9d26cabd327b81526bffe.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e00d0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_47d4573a8abeeed2da68aa4e2ebdb0ce.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8e26e4-9752-572c-99e3-2e6930f58107 with identifier: NB45585
2026-04-27 07:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8e26e4-9752-572c-99e3-2e6930f58107 with scrape type 1
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_272d72b0da112441acf2e941ebfed9c7.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433
2026-04-27 07:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a5cd2b-0591-5b75-ad14-801ff31ec982 with scrape type 1
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_aafd5337faa9aee2bcfa88ce294c01fa.jpg not downloaded yet
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048479250>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_068f5ad638a675fc8dff9775dd0da45f.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e2e10>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_9713da625b36aa69eaef97c4f58c303e.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04847be10>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_ad5be815da1a3f00fc876e10b36f4fcb.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_c6aa092cd9246a14426811692fcd6325.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8d71c1dbf92a20abc81721a1e055cbca.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9e1f26e0b6627f4f42cbf527acb4c177.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_016e166d1822f3f0ec37a593beb37c58.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_40d82d9f2f6069890b2901a246a98191.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_beeac7d5bec13f99ba82050c256a47c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_5d91d7b4b5717aa4152d2982042fd65d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ec00d5ccc97ee2555ffd916686ccb87f.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_7022af4d759e8cd27abdd3185edee6e4.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX85324> (referer: https://www.auto1.com/v1/car-details-view/LX85324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_3a28f33639ce828a54a4f010e3f54ea9.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_5bd20425a1b8eae8e9b48dd22de5f5b0.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_1d39cbf2ae0e444d97af330c3a71bc80.jpg not downloaded yet
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823c290>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_139ffa573139861aec9687b4227bde20.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6590>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_ad55a2858df8cef9e8d037344d50a5cd.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4390>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_0092f765830b7401f8855bbbca2657cd.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894ff10>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_4a25fbc38e47db9a18e10b4db703209e.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048807350>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8f16fa70c4d0a990eb7dfed9e2df343f.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_99b6093ec487c4c7501d7b27cd2dec39.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_f3dfff6320498d050ddb711f0ddff2ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_b2e33aaa0b8be084f4dd853489c4da74.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_709cc1f60a8da727a1d84a2fd5a1d29a.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_13f0362bd052e8f5b729d7b8794eaaea.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY82802> (referer: https://www.auto1.com/v1/car-details-view/RY82802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS89718> (referer: https://www.auto1.com/v1/car-details-view/AS89718/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_646df183d0cbae7eb5d9523e591cc82b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_d578337d7ca7b2488154e1d139649e67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_9dc57d3d3ee434f58f9419641c28f124.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_eece165d76141bfb2f86bbfea6ef418a.jpg not downloaded yet
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ba750>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_c6aa092cd9246a14426811692fcd6325.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ede50>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_40d82d9f2f6069890b2901a246a98191.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485292d0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_beeac7d5bec13f99ba82050c256a47c0.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048497450>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_5d91d7b4b5717aa4152d2982042fd65d.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f2ca785-230f-5088-a687-5cf147e76044 with identifier: LX85324
2026-04-27 07:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f2ca785-230f-5088-a687-5cf147e76044 with scrape type 1
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_08ee3ee8a9adef62c16bc9aeed36b886.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_b614c03582a00526d5feebcefac1a81c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_5c697b2e6fb4975e6f4b6255beded8df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_67f8320369f745bd51daf279f094c96e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN42055> (referer: https://www.auto1.com/v1/car-details-view/MN42055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_016e166d1822f3f0ec37a593beb37c58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ade30cc50107fbd0e807001b34afbc4c.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_087ee1de2af1b632b1c13d37ab46234b.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_10c09ca6e178a823fc36df3afb213070.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8d71c1dbf92a20abc81721a1e055cbca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9e1f26e0b6627f4f42cbf527acb4c177.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048882050>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_99b6093ec487c4c7501d7b27cd2dec39.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048675510>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_f3dfff6320498d050ddb711f0ddff2ef.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c8050>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_b2e33aaa0b8be084f4dd853489c4da74.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc36f2d5-bf17-58b5-affe-fae68b85a26e with identifier: RY82802
2026-04-27 07:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc36f2d5-bf17-58b5-affe-fae68b85a26e with scrape type 1
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_938df4e0bca8fd6186529987c4cf57a8.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c31831c-b126-57f0-9a00-4106c6eb4586 with identifier: AS89718
2026-04-27 07:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c31831c-b126-57f0-9a00-4106c6eb4586 with scrape type 1
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_26ac3cefb0f9a6c56d11d4f9b18b6187.jpg not downloaded yet
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ecdd0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_646df183d0cbae7eb5d9523e591cc82b.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a82f90>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_d578337d7ca7b2488154e1d139649e67.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_5066d7b9fa6c47cdd6e28c4d7a1b5fc0.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_9d9c777df3611da4e7f482ba10d6028d.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_ab3ab65b787f7c327f68153e4fabba65.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_7022af4d759e8cd27abdd3185edee6e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_aafd5337faa9aee2bcfa88ce294c01fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_272d72b0da112441acf2e941ebfed9c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ec00d5ccc97ee2555ffd916686ccb87f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_13f0362bd052e8f5b729d7b8794eaaea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_5527fdf7c6dce75e3dc7f7e0e82cfb68.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6ee968454d2bd132f68b8e2d623b2c74.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT44883/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_1d39cbf2ae0e444d97af330c3a71bc80.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_5bd20425a1b8eae8e9b48dd22de5f5b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_709cc1f60a8da727a1d84a2fd5a1d29a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_23909a51c63fd8402b45605a20ef648d.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_772fe79e4ebbb0e221f3202072589396.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_4a26bb21e26eef03a6463919996677b9.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_3d79daaf85b3c5790b674fecac57fac5.jpg not downloaded yet
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872d910>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_b614c03582a00526d5feebcefac1a81c.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ee350>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_5c697b2e6fb4975e6f4b6255beded8df.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff056fdde10>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_67f8320369f745bd51daf279f094c96e.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d3abc84-8470-5958-8c41-8a1cdf1e6802 with identifier: MN42055
2026-04-27 07:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802 with scrape type 1
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_386ccc009dad7a1649315691bf0b0fb3.jpg not downloaded yet
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04854a7d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_016e166d1822f3f0ec37a593beb37c58.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048801ad0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8d71c1dbf92a20abc81721a1e055cbca.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a5150>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9e1f26e0b6627f4f42cbf527acb4c177.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_3a28f33639ce828a54a4f010e3f54ea9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_4a8d53ad70a49314a9aa31dd75b8e45a.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_2ddd75481771ba94b03ede4652171687.jpg not downloaded yet
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_26ac3cefb0f9a6c56d11d4f9b18b6187.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_9dc57d3d3ee434f58f9419641c28f124.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_ff233a54af06faffb47058f1931bc1d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_9e12ef2066b304e2ab8b5068329539dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_08ee3ee8a9adef62c16bc9aeed36b886.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_2c4d604d62b8e2715682f32b31d4151b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_eece165d76141bfb2f86bbfea6ef418a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_e185a38863c2c5336f8ed21d276eb84b.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6c748966623c4bfa6ca18e39bc51ba88.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_c2250d67a730338950dd1a0946706ff6.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_dfbe2f0e16bb576bd9be9576d21729b3.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_88212c6af8357e043208e19e5f422d8d.jpg not downloaded yet
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824b10>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_7022af4d759e8cd27abdd3185edee6e4.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c5350>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_aafd5337faa9aee2bcfa88ce294c01fa.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a30d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_272d72b0da112441acf2e941ebfed9c7.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048360910>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ec00d5ccc97ee2555ffd916686ccb87f.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048726e50>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_13f0362bd052e8f5b729d7b8794eaaea.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823a450>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_1d39cbf2ae0e444d97af330c3a71bc80.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1890>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_5bd20425a1b8eae8e9b48dd22de5f5b0.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a8090>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_709cc1f60a8da727a1d84a2fd5a1d29a.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_beb44c93efa8acdd2f2b774176ba57a3.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_995698cff48e7f7c1eb696b708b682ef.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d1dd9232b0ef00008bdac1da5d1ecd25.jpg not downloaded yet
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_938df4e0bca8fd6186529987c4cf57a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_83cd54347f61e023a4dab578880854fe.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_fb851aa340c252efca580af8bda3c043.jpg not downloaded yet
2026-04-27 07:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b0a90>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_3a28f33639ce828a54a4f010e3f54ea9.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_9d9c777df3611da4e7f482ba10d6028d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_087ee1de2af1b632b1c13d37ab46234b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_5066d7b9fa6c47cdd6e28c4d7a1b5fc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_10c09ca6e178a823fc36df3afb213070.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ade30cc50107fbd0e807001b34afbc4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_ab3ab65b787f7c327f68153e4fabba65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_f22671a45a343d93a04378d93a8f86ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_55cb6b9204e065d7dfe80e052b3ff1f8.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_848157808932620920efbe1fd9e5e579.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_4ae87e61a787964cb4c97341e8facf8f.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_b1b7d90bea19ef772a4feabc8a620d12.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_458663d2076dabcc37149baf07ff7efc.jpg not downloaded yet
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8953ee2a45a20e98f39f79189b89c4fd.jpg not downloaded yet
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489949d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_26ac3cefb0f9a6c56d11d4f9b18b6187.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c5e10>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_9dc57d3d3ee434f58f9419641c28f124.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048213750>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_ff233a54af06faffb47058f1931bc1d8.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048815650>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_9e12ef2066b304e2ab8b5068329539dc.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048781190>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_08ee3ee8a9adef62c16bc9aeed36b886.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823ab50>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_2c4d604d62b8e2715682f32b31d4151b.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048210450>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_eece165d76141bfb2f86bbfea6ef418a.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_772fe79e4ebbb0e221f3202072589396.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_9d2d9cf258af359ea22ea9a22d44c5f3.jpg not downloaded yet
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_4a26bb21e26eef03a6463919996677b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_9a17e703c4799d940bc15c24257759ef.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d6b712bf2b3355c7a48d80ea6a20e800.jpg not downloaded yet
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37090>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_938df4e0bca8fd6186529987c4cf57a8.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_3d79daaf85b3c5790b674fecac57fac5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_5527fdf7c6dce75e3dc7f7e0e82cfb68.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_23909a51c63fd8402b45605a20ef648d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6ee968454d2bd132f68b8e2d623b2c74.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_386ccc009dad7a1649315691bf0b0fb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_5600931e3fe67d6f6f30fb8d17db9192.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_4967d62a88b12f8829b017d9d93c3216.jpg not downloaded yet
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848f6d0>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_9d9c777df3611da4e7f482ba10d6028d.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048472b10>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_087ee1de2af1b632b1c13d37ab46234b.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2a5cd2b-0591-5b75-ad14-801ff31ec982
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2a5cd2b-0591-5b75-ad14-801ff31ec982, skipping ID generation
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a5cd2b-0591-5b75-ad14-801ff31ec982 with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2a5cd2b-0591-5b75-ad14-801ff31ec982 sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2a5cd2b-0591-5b75-ad14-801ff31ec982, identifier: MF04433
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048204810>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_5066d7b9fa6c47cdd6e28c4d7a1b5fc0.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ba5d0>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_10c09ca6e178a823fc36df3afb213070.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057789e10>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ade30cc50107fbd0e807001b34afbc4c.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834d310>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_ab3ab65b787f7c327f68153e4fabba65.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d1f90>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_f22671a45a343d93a04378d93a8f86ba.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_a9d0c54a8be24413bc3bfe4549d25c79.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8de1f898b59b10c271237d496d56a9a5.jpg not downloaded yet
2026-04-27 07:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433
2026-04-27 07:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433
2026-04-27 07:56:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433 to the API
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_087ee1de2af1b632b1c13d37ab46234b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'city': 'Calaf',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:32:14Z',
'fuel_type': 'diesel',
'id': 'b2a5cd2b-0591-5b75-ad14-801ff31ec982',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF04433',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Kia',
'model': 'Venga',
'odometer': 210806,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_aafd5337faa9aee2bcfa88ce294c01fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_7022af4d759e8cd27abdd3185edee6e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_13f0362bd052e8f5b729d7b8794eaaea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_eece165d76141bfb2f86bbfea6ef418a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_087ee1de2af1b632b1c13d37ab46234b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b2a5cd2b-0591-5b75-ad14-801ff31ec982/b2a5cd2b-0591-5b75-ad14-801ff31ec982_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/ac/63acd885e07653c8b88c498f69f7cd4b/pa/MF04433_9d9c777df3611da4e7f482ba10d6028d.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2014-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Venga 1.6 CRDi Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2014}
2026-04-27 07:56:42 [auto1.es] INFO: Saving data for MF04433: {'created_time': 1777276602.380262, 'last_price_update_time': 1777276602.380272, 'has_photos': True, 'auction_closing_time': 1777303934.0}
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481b77d0>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_772fe79e4ebbb0e221f3202072589396.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_beb44c93efa8acdd2f2b774176ba57a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_995698cff48e7f7c1eb696b708b682ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d1dd9232b0ef00008bdac1da5d1ecd25.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_fa46b2b1a1697f86232d90ef84a1ed18.jpg not downloaded yet
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d8432609ca920453c5d67fc2b3a4e1b9.jpg not downloaded yet
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6c748966623c4bfa6ca18e39bc51ba88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_dfbe2f0e16bb576bd9be9576d21729b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_c2250d67a730338950dd1a0946706ff6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_88212c6af8357e043208e19e5f422d8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_b1b7d90bea19ef772a4feabc8a620d12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_2ca2ccd2e95322740ddfd869b8edcb13.jpg not downloaded yet
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870f450>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_4a26bb21e26eef03a6463919996677b9.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048655090>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_3d79daaf85b3c5790b674fecac57fac5.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f2550>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_5527fdf7c6dce75e3dc7f7e0e82cfb68.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3910>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_23909a51c63fd8402b45605a20ef648d.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852b850>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6ee968454d2bd132f68b8e2d623b2c74.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ec510>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_386ccc009dad7a1649315691bf0b0fb3.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048726a10>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_5600931e3fe67d6f6f30fb8d17db9192.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_458663d2076dabcc37149baf07ff7efc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_ac04b58284b968acf6a5e265435c4a45.jpg not downloaded yet
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8953ee2a45a20e98f39f79189b89c4fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_9d2d9cf258af359ea22ea9a22d44c5f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c1190>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_beb44c93efa8acdd2f2b774176ba57a3.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6a90>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_995698cff48e7f7c1eb696b708b682ef.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851f990>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d1dd9232b0ef00008bdac1da5d1ecd25.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ed290>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6c748966623c4bfa6ca18e39bc51ba88.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a4ad0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_dfbe2f0e16bb576bd9be9576d21729b3.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048724b50>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_c2250d67a730338950dd1a0946706ff6.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851fd10>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_88212c6af8357e043208e19e5f422d8d.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048696610>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_b1b7d90bea19ef772a4feabc8a620d12.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_4ae87e61a787964cb4c97341e8facf8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_a9d0c54a8be24413bc3bfe4549d25c79.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_4967d62a88b12f8829b017d9d93c3216.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_55cb6b9204e065d7dfe80e052b3ff1f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8de1f898b59b10c271237d496d56a9a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_848157808932620920efbe1fd9e5e579.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_fb851aa340c252efca580af8bda3c043.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d8432609ca920453c5d67fc2b3a4e1b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT44883> (referer: https://www.auto1.com/v1/car-details-view/GT44883/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048746490>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_458663d2076dabcc37149baf07ff7efc.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484af590>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8953ee2a45a20e98f39f79189b89c4fd.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04849ddd0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_9d2d9cf258af359ea22ea9a22d44c5f3.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_9a17e703c4799d940bc15c24257759ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_83cd54347f61e023a4dab578880854fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487440d0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_4ae87e61a787964cb4c97341e8facf8f.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885b850>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_a9d0c54a8be24413bc3bfe4549d25c79.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fef50>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_4967d62a88b12f8829b017d9d93c3216.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481ff890>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_55cb6b9204e065d7dfe80e052b3ff1f8.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bfe50>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8de1f898b59b10c271237d496d56a9a5.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c20d0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_848157808932620920efbe1fd9e5e579.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c31831c-b126-57f0-9a00-4106c6eb4586
2026-04-27 07:56:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c31831c-b126-57f0-9a00-4106c6eb4586, skipping ID generation
2026-04-27 07:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c31831c-b126-57f0-9a00-4106c6eb4586 with scrape type 1
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c31831c-b126-57f0-9a00-4106c6eb4586 sending to next pipeline
2026-04-27 07:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c31831c-b126-57f0-9a00-4106c6eb4586, identifier: AS89718
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837e790>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_fb851aa340c252efca580af8bda3c043.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870e290>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d8432609ca920453c5d67fc2b3a4e1b9.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883
2026-04-27 07:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with scrape type 1
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_4fcf9cd0ae7b154a9f3db7d787b3cc72.jpg not downloaded yet
2026-04-27 07:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c31831c-b126-57f0-9a00-4106c6eb4586 with identifier: AS89718
2026-04-27 07:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c31831c-b126-57f0-9a00-4106c6eb4586 with identifier: AS89718
2026-04-27 07:56:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c31831c-b126-57f0-9a00-4106c6eb4586 with identifier: AS89718 to the API
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_848157808932620920efbe1fd9e5e579.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'La Roda De Andalucia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:55:10Z',
'fuel_type': 'petrol',
'id': '0c31831c-b126-57f0-9a00-4106c6eb4586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS89718',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Opel',
'model': 'Astra',
'odometer': 112483,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_26ac3cefb0f9a6c56d11d4f9b18b6187.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6ee968454d2bd132f68b8e2d623b2c74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_3d79daaf85b3c5790b674fecac57fac5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_6c748966623c4bfa6ca18e39bc51ba88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_995698cff48e7f7c1eb696b708b682ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0c31831c-b126-57f0-9a00-4106c6eb4586/0c31831c-b126-57f0-9a00-4106c6eb4586_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/5d/a75da81f39f94b40d32a9887a4c3ac08/pa/AS89718_848157808932620920efbe1fd9e5e579.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2003-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2003}
2026-04-27 07:56:44 [auto1.es] INFO: Saving data for AS89718: {'created_time': 1777276604.768423, 'last_price_update_time': 1777276604.768437, 'has_photos': True, 'auction_closing_time': 1777305310.0}
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_fa46b2b1a1697f86232d90ef84a1ed18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_e185a38863c2c5336f8ed21d276eb84b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_2ddd75481771ba94b03ede4652171687.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_979ae5c839526de4b642f55635ba7940.jpg not downloaded yet
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d6b712bf2b3355c7a48d80ea6a20e800.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_2ca2ccd2e95322740ddfd869b8edcb13.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_4a8d53ad70a49314a9aa31dd75b8e45a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_10baa63415ea61315c3f722e8451b75d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_ac04b58284b968acf6a5e265435c4a45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_b090de2aedcc8098761311e41a6bf7df.jpg not downloaded yet
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882af50>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_9a17e703c4799d940bc15c24257759ef.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e1410>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_83cd54347f61e023a4dab578880854fe.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_1418085600ec38d2e564ccbd2d58e62b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00caad370792fb79df0bf86425cbf7ec.jpg not downloaded yet
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c3bd0>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_fa46b2b1a1697f86232d90ef84a1ed18.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a2c90>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_e185a38863c2c5336f8ed21d276eb84b.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc36f2d5-bf17-58b5-affe-fae68b85a26e
2026-04-27 07:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc36f2d5-bf17-58b5-affe-fae68b85a26e, skipping ID generation
2026-04-27 07:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc36f2d5-bf17-58b5-affe-fae68b85a26e with scrape type 1
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc36f2d5-bf17-58b5-affe-fae68b85a26e sending to next pipeline
2026-04-27 07:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc36f2d5-bf17-58b5-affe-fae68b85a26e, identifier: RY82802
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048237ad0>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_2ddd75481771ba94b03ede4652171687.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f2ca785-230f-5088-a687-5cf147e76044
2026-04-27 07:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f2ca785-230f-5088-a687-5cf147e76044, skipping ID generation
2026-04-27 07:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f2ca785-230f-5088-a687-5cf147e76044 with scrape type 1
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f2ca785-230f-5088-a687-5cf147e76044 sending to next pipeline
2026-04-27 07:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f2ca785-230f-5088-a687-5cf147e76044, identifier: LX85324
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_477494f87df5fbf4767abeeabe4624c8.jpg not downloaded yet
2026-04-27 07:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc36f2d5-bf17-58b5-affe-fae68b85a26e with identifier: RY82802
2026-04-27 07:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc36f2d5-bf17-58b5-affe-fae68b85a26e with identifier: RY82802
2026-04-27 07:56:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc36f2d5-bf17-58b5-affe-fae68b85a26e with identifier: RY82802 to the API
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_e185a38863c2c5336f8ed21d276eb84b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Madrid',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 83,
'expiration_date': '2026-04-28T15:26:10Z',
'fuel_type': 'petrol',
'id': 'bc36f2d5-bf17-58b5-affe-fae68b85a26e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY82802',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Suzuki',
'model': 'Swift',
'odometer': 64957,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_938df4e0bca8fd6186529987c4cf57a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_5527fdf7c6dce75e3dc7f7e0e82cfb68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_4a26bb21e26eef03a6463919996677b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_e185a38863c2c5336f8ed21d276eb84b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_beb44c93efa8acdd2f2b774176ba57a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_55cb6b9204e065d7dfe80e052b3ff1f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_458663d2076dabcc37149baf07ff7efc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_9a17e703c4799d940bc15c24257759ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_a9d0c54a8be24413bc3bfe4549d25c79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc36f2d5-bf17-58b5-affe-fae68b85a26e/bc36f2d5-bf17-58b5-affe-fae68b85a26e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/20/c820fa01dc4c17fb82b2b73498440dca/pa/RY82802_fa46b2b1a1697f86232d90ef84a1ed18.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2021-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid GLE',
'transmission': 'automatic',
'trim': 'GLE',
'year': 2021}
2026-04-27 07:56:45 [auto1.es] INFO: Saving data for RY82802: {'created_time': 1777276605.682827, 'last_price_update_time': 1777276605.682836, 'has_photos': True, 'auction_closing_time': 1777389970.0}
2026-04-27 07:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f2ca785-230f-5088-a687-5cf147e76044 with identifier: LX85324
2026-04-27 07:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f2ca785-230f-5088-a687-5cf147e76044 with identifier: LX85324
2026-04-27 07:56:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f2ca785-230f-5088-a687-5cf147e76044 with identifier: LX85324 to the API
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_2ddd75481771ba94b03ede4652171687.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Valencia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:03:16Z',
'fuel_type': 'diesel',
'id': '0f2ca785-230f-5088-a687-5cf147e76044',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 39.4698,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX85324',
'listing': 'auction',
'location': 'Xirivella, Valencia.',
'location_confidence': 'geocoded',
'longitude': -0.3774,
'make': 'BMW',
'model': '1er',
'odometer': 155195,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_08ee3ee8a9adef62c16bc9aeed36b886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_10c09ca6e178a823fc36df3afb213070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_ab3ab65b787f7c327f68153e4fabba65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_772fe79e4ebbb0e221f3202072589396.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_2ddd75481771ba94b03ede4652171687.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_88212c6af8357e043208e19e5f422d8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_fb851aa340c252efca580af8bda3c043.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_b1b7d90bea19ef772a4feabc8a620d12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_9d2d9cf258af359ea22ea9a22d44c5f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2ca785-230f-5088-a687-5cf147e76044/0f2ca785-230f-5088-a687-5cf147e76044_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/5c/1c5c8d34c1fce11482a636740534803b/pa/LX85324_4967d62a88b12f8829b017d9d93c3216.jpg',
'Width': 800}],
'postal_code': '46001',
'price': 0,
'price_includes_vat': True,
'province': 'Valencia',
'province_code': 'ES-V',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2008-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 07:56:46 [auto1.es] INFO: Saving data for LX85324: {'created_time': 1777276606.181634, 'last_price_update_time': 1777276606.181648, 'has_photos': True, 'auction_closing_time': 1777388596.0}
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_855b08ce527a645703d6c5a07a1b9f0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_60f6ca77924088a4eda53b219b5d70dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_0afea1e6173e730fb11383ac25372673.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_178386f02b5b9e871bea01428c6bd6d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_4e44ea41c7df0290ad49f3e900e953ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_f9a94f73b9c82dc78dfc62ed597bdbdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_f641befa8a94769acc787f3818f96e35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00283b498e2ef4df26b8af39223682bf.jpg not downloaded yet
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048237450>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d6b712bf2b3355c7a48d80ea6a20e800.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bfb50>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_2ca2ccd2e95322740ddfd869b8edcb13.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048427810>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_4a8d53ad70a49314a9aa31dd75b8e45a.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a8e26e4-9752-572c-99e3-2e6930f58107
2026-04-27 07:56:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a8e26e4-9752-572c-99e3-2e6930f58107, skipping ID generation
2026-04-27 07:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8e26e4-9752-572c-99e3-2e6930f58107 with scrape type 1
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a8e26e4-9752-572c-99e3-2e6930f58107 sending to next pipeline
2026-04-27 07:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a8e26e4-9752-572c-99e3-2e6930f58107, identifier: NB45585
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ec990>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_10baa63415ea61315c3f722e8451b75d.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048523250>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_ac04b58284b968acf6a5e265435c4a45.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802
2026-04-27 07:56:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d3abc84-8470-5958-8c41-8a1cdf1e6802, skipping ID generation
2026-04-27 07:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802 with scrape type 1
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d3abc84-8470-5958-8c41-8a1cdf1e6802 sending to next pipeline
2026-04-27 07:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d3abc84-8470-5958-8c41-8a1cdf1e6802, identifier: MN42055
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882ad90>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_1418085600ec38d2e564ccbd2d58e62b.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_4fcf9cd0ae7b154a9f3db7d787b3cc72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a8e26e4-9752-572c-99e3-2e6930f58107 with identifier: NB45585
2026-04-27 07:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a8e26e4-9752-572c-99e3-2e6930f58107 with identifier: NB45585
2026-04-27 07:56:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a8e26e4-9752-572c-99e3-2e6930f58107 with identifier: NB45585 to the API
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_4a8d53ad70a49314a9aa31dd75b8e45a.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Trasona',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6A',
'engine': '',
'engine_horse_power': 283,
'expiration_date': '2026-04-28T15:11:14Z',
'fuel_type': 'electro',
'id': '1a8e26e4-9752-572c-99e3-2e6930f58107',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 43.55,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB45585',
'listing': 'auction',
'location': 'ES, Trasona',
'location_confidence': 'geocoded',
'longitude': -5.8667,
'make': 'Tesla',
'model': 'Model 3',
'odometer': 95794,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_272d72b0da112441acf2e941ebfed9c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ec00d5ccc97ee2555ffd916686ccb87f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_709cc1f60a8da727a1d84a2fd5a1d29a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_9dc57d3d3ee434f58f9419641c28f124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_ade30cc50107fbd0e807001b34afbc4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_5066d7b9fa6c47cdd6e28c4d7a1b5fc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_23909a51c63fd8402b45605a20ef648d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_4a8d53ad70a49314a9aa31dd75b8e45a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_dfbe2f0e16bb576bd9be9576d21729b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a8e26e4-9752-572c-99e3-2e6930f58107/1a8e26e4-9752-572c-99e3-2e6930f58107_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b5/61b532bbe84a76fc2966ae2937e6db6f/pa/NB45585_83cd54347f61e023a4dab578880854fe.jpg',
'Width': 800}],
'postal_code': '33468',
'price': 0,
'price_includes_vat': True,
'province': 'Asturias',
'province_code': 'ES-O',
'region': 'Asturias',
'region_code': 'ES-AS',
'registration_date': '2023-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla Model 3 Standard Range',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-04-27 07:56:47 [auto1.es] INFO: Saving data for NB45585: {'created_time': 1777276607.19783, 'last_price_update_time': 1777276607.197845, 'has_photos': True, 'auction_closing_time': 1777389074.0}
2026-04-27 07:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d3abc84-8470-5958-8c41-8a1cdf1e6802 with identifier: MN42055
2026-04-27 07:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d3abc84-8470-5958-8c41-8a1cdf1e6802 with identifier: MN42055
2026-04-27 07:56:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d3abc84-8470-5958-8c41-8a1cdf1e6802 with identifier: MN42055 to the API
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_ac04b58284b968acf6a5e265435c4a45.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:30:38Z',
'fuel_type': 'diesel',
'id': '4d3abc84-8470-5958-8c41-8a1cdf1e6802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN42055',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Peugeot',
'model': '3008',
'odometer': 177557,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_386ccc009dad7a1649315691bf0b0fb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_c2250d67a730338950dd1a0946706ff6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d1dd9232b0ef00008bdac1da5d1ecd25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_4ae87e61a787964cb4c97341e8facf8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8953ee2a45a20e98f39f79189b89c4fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d6b712bf2b3355c7a48d80ea6a20e800.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_8de1f898b59b10c271237d496d56a9a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_d8432609ca920453c5d67fc2b3a4e1b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_2ca2ccd2e95322740ddfd869b8edcb13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3abc84-8470-5958-8c41-8a1cdf1e6802/4d3abc84-8470-5958-8c41-8a1cdf1e6802_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/20/d5206a1d08ed6a20468b2d819f1a8f08/pa/MN42055_ac04b58284b968acf6a5e265435c4a45.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2022-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
'transmission': 'manual',
'trim': 'Active Pack',
'year': 2022}
2026-04-27 07:56:47 [auto1.es] INFO: Saving data for MN42055: {'created_time': 1777276607.635557, 'last_price_update_time': 1777276607.635572, 'has_photos': True, 'auction_closing_time': 1777303838.0}
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_cd9a0b5d375ff65ee5659ee31e1ec927.jpg not downloaded yet
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_3572c7fd06ededab2298d4c52b7c1747.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_77a6405cf62ac43d56d428e94115702e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04883cb50>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_855b08ce527a645703d6c5a07a1b9f0d.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048204dd0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_60f6ca77924088a4eda53b219b5d70dd.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bf310>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_0afea1e6173e730fb11383ac25372673.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048205c90>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_178386f02b5b9e871bea01428c6bd6d5.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fef90>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_4e44ea41c7df0290ad49f3e900e953ec.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 207f7261-56ce-5cf2-ad87-6a2f383c9324
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 207f7261-56ce-5cf2-ad87-6a2f383c9324, skipping ID generation
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 207f7261-56ce-5cf2-ad87-6a2f383c9324 with scrape type 1
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 207f7261-56ce-5cf2-ad87-6a2f383c9324 sending to next pipeline
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 207f7261-56ce-5cf2-ad87-6a2f383c9324, identifier: MT83895
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b98d0>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_f9a94f73b9c82dc78dfc62ed597bdbdf.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 247c5357-45bd-5399-bf34-086ca608b6ab
2026-04-27 07:56:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 247c5357-45bd-5399-bf34-086ca608b6ab, skipping ID generation
2026-04-27 07:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247c5357-45bd-5399-bf34-086ca608b6ab with scrape type 1
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 247c5357-45bd-5399-bf34-086ca608b6ab sending to next pipeline
2026-04-27 07:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 247c5357-45bd-5399-bf34-086ca608b6ab, identifier: MZ14425
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481beb10>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_f641befa8a94769acc787f3818f96e35.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7de283f6b0e050bda712ff555d8230ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_979ae5c839526de4b642f55635ba7940.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_07e287e0761b23d5a52818097ed1673a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9bce24deaafc5785815efffd5148a29e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_eb4fcd59895ec57004718907ef9652b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_6011c6d38b4e418319646b51d9226e21.jpg not downloaded yet
2026-04-27 07:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895
2026-04-27 07:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895
2026-04-27 07:56:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895 to the API
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_4e44ea41c7df0290ad49f3e900e953ec.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Granyanella',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 88,
'expiration_date': '2026-04-27T15:20:39Z',
'fuel_type': 'petrol',
'id': '207f7261-56ce-5cf2-ad87-6a2f383c9324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT83895',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Citroen',
'model': 'Xsara',
'odometer': 67210,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_1f39a688eeb2f505c819fcd39435a376.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_47d4573a8abeeed2da68aa4e2ebdb0ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_4e44ea41c7df0290ad49f3e900e953ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_ad55a2858df8cef9e8d037344d50a5cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_646df183d0cbae7eb5d9523e591cc82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_207f7261-56ce-5cf2-ad87-6a2f383c9324/207f7261-56ce-5cf2-ad87-6a2f383c9324_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/34/0434bb31862b5a34dd3b8b2dd1820901/pa/MT83895_5d91d7b4b5717aa4152d2982042fd65d.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '1999-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Xsara 1.6 Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 1999}
2026-04-27 07:56:48 [auto1.es] INFO: Saving data for MT83895: {'created_time': 1777276608.686397, 'last_price_update_time': 1777276608.686406, 'has_photos': True, 'auction_closing_time': 1777303239.0}
2026-04-27 07:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 247c5357-45bd-5399-bf34-086ca608b6ab with identifier: MZ14425
2026-04-27 07:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 247c5357-45bd-5399-bf34-086ca608b6ab with identifier: MZ14425
2026-04-27 07:56:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 247c5357-45bd-5399-bf34-086ca608b6ab with identifier: MZ14425 to the API
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_f9a94f73b9c82dc78dfc62ed597bdbdf.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Aldaya',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:16:08Z',
'fuel_type': 'diesel',
'id': '247c5357-45bd-5399-bf34-086ca608b6ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ14425',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 241942,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_e902d6e7b1ee07ac4c331a85e4a317a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_139ffa573139861aec9687b4227bde20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_f9a94f73b9c82dc78dfc62ed597bdbdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_4a25fbc38e47db9a18e10b4db703209e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_5c697b2e6fb4975e6f4b6255beded8df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_247c5357-45bd-5399-bf34-086ca608b6ab/247c5357-45bd-5399-bf34-086ca608b6ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/aa/64aa7b387dac779ad30ed1d738f3a611/pa/MZ14425_beeac7d5bec13f99ba82050c256a47c0.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi LX',
'transmission': 'manual',
'trim': 'LX',
'year': 2010}
2026-04-27 07:56:49 [auto1.es] INFO: Saving data for MZ14425: {'created_time': 1777276609.16863, 'last_price_update_time': 1777276609.16864, 'has_photos': True, 'auction_closing_time': 1777389368.0}
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057cd4290>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_4fcf9cd0ae7b154a9f3db7d787b3cc72.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_b090de2aedcc8098761311e41a6bf7df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_15cb964c6639b96a75012fc4c1961cdb.jpg not downloaded yet
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bc810>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_3572c7fd06ededab2298d4c52b7c1747.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c
2026-04-27 07:56:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c, skipping ID generation
2026-04-27 07:56:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with scrape type 1
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4581c3e-8a4a-5be0-9f23-6b2390f5f81c sending to next pipeline
2026-04-27 07:56:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c, identifier: ZM69944
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207890>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_77a6405cf62ac43d56d428e94115702e.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00caad370792fb79df0bf86425cbf7ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_477494f87df5fbf4767abeeabe4624c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944
2026-04-27 07:56:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944
2026-04-27 07:56:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4581c3e-8a4a-5be0-9f23-6b2390f5f81c with identifier: ZM69944 to the API
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_3572c7fd06ededab2298d4c52b7c1747.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Hellin',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2026-04-27T15:00:06Z',
'fuel_type': 'hybrid',
'id': 'b4581c3e-8a4a-5be0-9f23-6b2390f5f81c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.5106,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM69944',
'listing': 'auction',
'location': 'ES, Hellin',
'location_confidence': 'geocoded',
'longitude': -1.701,
'make': 'Citroen',
'model': 'DS5',
'odometer': 195715,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_d33fdbffd5d2914d52183718cd5d3e7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_3572c7fd06ededab2298d4c52b7c1747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_178386f02b5b9e871bea01428c6bd6d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_9713da625b36aa69eaef97c4f58c303e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_ff233a54af06faffb47058f1931bc1d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_c6aa092cd9246a14426811692fcd6325.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_f3dfff6320498d050ddb711f0ddff2ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_67f8320369f745bd51daf279f094c96e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_016e166d1822f3f0ec37a593beb37c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4581c3e-8a4a-5be0-9f23-6b2390f5f81c/b4581c3e-8a4a-5be0-9f23-6b2390f5f81c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/1a/f31ae23efc2eb48505e78ed523e83737/pa/ZM69944_1d39cbf2ae0e444d97af330c3a71bc80.jpg',
'Width': 800}],
'postal_code': '02400',
'price': 0,
'price_includes_vat': True,
'province': 'Albacete',
'province_code': 'ES-AB',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2013-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS5 2.0 HDi Hybrid4 Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2013}
2026-04-27 07:56:49 [auto1.es] INFO: Saving data for ZM69944: {'created_time': 1777276609.876194, 'last_price_update_time': 1777276609.876206, 'has_photos': True, 'auction_closing_time': 1777302006.0}
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_e20a1b49dbb73455c0c812efae20a20a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_25db4710ec7469c0ee6fcd7e544213cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_8993d31eb7fd5dc4876158f12468f068.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_b8067bba429c8ec374ab491e62f97df9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_acd985306f77d7ef3cb128a3b96e407c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_2449ab5c46bdde8aea6f5dd15799916e.jpg not downloaded yet
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048677450>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7de283f6b0e050bda712ff555d8230ab.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3a490>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_979ae5c839526de4b642f55635ba7940.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487e2950>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_07e287e0761b23d5a52818097ed1673a.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488817d0>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9bce24deaafc5785815efffd5148a29e.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048617fd0>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_eb4fcd59895ec57004718907ef9652b2.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_38ebbab0d44d16d826cbc4c65b55fc04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a38690>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_b090de2aedcc8098761311e41a6bf7df.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048472010>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00caad370792fb79df0bf86425cbf7ec.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048882110>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_477494f87df5fbf4767abeeabe4624c8.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048919e90>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_e20a1b49dbb73455c0c812efae20a20a.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048274c50>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_25db4710ec7469c0ee6fcd7e544213cf.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f9f9380-f73b-5ef0-ae93-d3162465cfa6, skipping ID generation
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 sending to next pipeline
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f9f9380-f73b-5ef0-ae93-d3162465cfa6, identifier: DU74019
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048617590>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_8993d31eb7fd5dc4876158f12468f068.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed6ec754-8927-5350-9d54-1eab72a7d950
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed6ec754-8927-5350-9d54-1eab72a7d950, skipping ID generation
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed6ec754-8927-5350-9d54-1eab72a7d950 with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed6ec754-8927-5350-9d54-1eab72a7d950 sending to next pipeline
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ed6ec754-8927-5350-9d54-1eab72a7d950, identifier: DB60699
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256490>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_b8067bba429c8ec374ab491e62f97df9.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869af90>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_acd985306f77d7ef3cb128a3b96e407c.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_8eac1e4ad658ebcf3149a6cdbdaf01d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 with identifier: DU74019
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 with identifier: DU74019
2026-04-27 07:56:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f9f9380-f73b-5ef0-ae93-d3162465cfa6 with identifier: DU74019 to the API
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_25db4710ec7469c0ee6fcd7e544213cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'A Coruña',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:04:59Z',
'fuel_type': 'petrol',
'id': '7f9f9380-f73b-5ef0-ae93-d3162465cfa6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 43.3718,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU74019',
'listing': 'auction',
'location': 'ES, A Coruña',
'location_confidence': 'geocoded',
'longitude': -8.3958,
'make': 'Volkswagen',
'model': 'New Beetle',
'odometer': 115511,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_e20a1b49dbb73455c0c812efae20a20a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_25db4710ec7469c0ee6fcd7e544213cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_f641befa8a94769acc787f3818f96e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8f16fa70c4d0a990eb7dfed9e2df343f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_5600931e3fe67d6f6f30fb8d17db9192.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_d578337d7ca7b2488154e1d139649e67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_b614c03582a00526d5feebcefac1a81c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_9e12ef2066b304e2ab8b5068329539dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_8d71c1dbf92a20abc81721a1e055cbca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f9f9380-f73b-5ef0-ae93-d3162465cfa6/7f9f9380-f73b-5ef0-ae93-d3162465cfa6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/11/2411681ac50ea969ce1c97105175e094/pa/DU74019_3a28f33639ce828a54a4f010e3f54ea9.jpg',
'Width': 800}],
'postal_code': '15001',
'price': 0,
'price_includes_vat': True,
'province': 'A Coruña',
'province_code': 'ES-C',
'region': 'Galicia',
'region_code': 'ES-GA',
'registration_date': '2006-05-04',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen New Beetle 1.6',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-04-27 07:56:51 [auto1.es] INFO: Saving data for DU74019: {'created_time': 1777276611.349587, 'last_price_update_time': 1777276611.349597, 'has_photos': True, 'auction_closing_time': 1777302299.0}
2026-04-27 07:56:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ed6ec754-8927-5350-9d54-1eab72a7d950 with identifier: DB60699
2026-04-27 07:56:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ed6ec754-8927-5350-9d54-1eab72a7d950 with identifier: DB60699
2026-04-27 07:56:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ed6ec754-8927-5350-9d54-1eab72a7d950 with identifier: DB60699 to the API
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_8993d31eb7fd5dc4876158f12468f068.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'city': 'Araia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:46:37Z',
'fuel_type': 'diesel',
'id': 'ed6ec754-8927-5350-9d54-1eab72a7d950',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB60699',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 202823,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_8993d31eb7fd5dc4876158f12468f068.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9bce24deaafc5785815efffd5148a29e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_855b08ce527a645703d6c5a07a1b9f0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_068f5ad638a675fc8dff9775dd0da45f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_f22671a45a343d93a04378d93a8f86ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_b2e33aaa0b8be084f4dd853489c4da74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_99b6093ec487c4c7501d7b27cd2dec39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_2c4d604d62b8e2715682f32b31d4151b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_9e1f26e0b6627f4f42cbf527acb4c177.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed6ec754-8927-5350-9d54-1eab72a7d950/ed6ec754-8927-5350-9d54-1eab72a7d950_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/68/eb68162ddbe2aaa2ae3e29c5b28c3e03/pa/DB60699_5bd20425a1b8eae8e9b48dd22de5f5b0.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2020-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-04-27 07:56:51 [auto1.es] INFO: Saving data for DB60699: {'created_time': 1777276611.848241, 'last_price_update_time': 1777276611.848253, 'has_photos': True, 'auction_closing_time': 1777304797.0}
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00283b498e2ef4df26b8af39223682bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_2fe3db89e8ccd69dffa7e21fb54b1fa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b9d33b4e15eaa854b63149aba014f3b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_cd9a0b5d375ff65ee5659ee31e1ec927.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_9bcaea26d160a7d0f82838bca687417e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7ff788fcb86b964939a6321edafaf254.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488513d0>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_38ebbab0d44d16d826cbc4c65b55fc04.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c
2026-04-27 07:56:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c, skipping ID generation
2026-04-27 07:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c with scrape type 1
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c sending to next pipeline
2026-04-27 07:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c, identifier: SC66247
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_6011c6d38b4e418319646b51d9226e21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c with identifier: SC66247
2026-04-27 07:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c with identifier: SC66247
2026-04-27 07:56:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c with identifier: SC66247 to the API
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_38ebbab0d44d16d826cbc4c65b55fc04.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Rebolledo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 2',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:15:42Z',
'fuel_type': 'petrol',
'id': '0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC66247',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Seat',
'model': 'Leon',
'odometer': 194907,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_9e8b5c08cad027198e91a7a2673ba30a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_38ebbab0d44d16d826cbc4c65b55fc04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_b8067bba429c8ec374ab491e62f97df9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_0afea1e6173e730fb11383ac25372673.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_40d82d9f2f6069890b2901a246a98191.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c/0f2b7c9c-bcce-54e8-8944-8c5c8d1e336c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/4e/624e6017e272b7b318dc074c19f18c6a/pa/SC66247_10baa63415ea61315c3f722e8451b75d.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '1999-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.6 Signo',
'transmission': 'manual',
'trim': 'Signo',
'year': 1999}
2026-04-27 07:56:52 [auto1.es] INFO: Saving data for SC66247: {'created_time': 1777276612.447218, 'last_price_update_time': 1777276612.447229, 'has_photos': True, 'auction_closing_time': 1777302942.0}
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_64747c8ba1cf70a3afb4e867b1187936.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_963900dcb01eaa10e15e022ab02079e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b2a10>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_8eac1e4ad658ebcf3149a6cdbdaf01d5.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_15cb964c6639b96a75012fc4c1961cdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_3085fa190f1a1c32f52bf45787b654c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bb6852e17143fc023c8739b7d287e29d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_4daad1151d95df705d336da676c3c6ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_1247bec0987ecdba064af3b28cb84318.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852fd10>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00283b498e2ef4df26b8af39223682bf.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ba1d0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_2fe3db89e8ccd69dffa7e21fb54b1fa0.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a55450>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b9d33b4e15eaa854b63149aba014f3b8.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b3a90>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_cd9a0b5d375ff65ee5659ee31e1ec927.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481db150>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_9bcaea26d160a7d0f82838bca687417e.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872f910>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7ff788fcb86b964939a6321edafaf254.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04883e450>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_6011c6d38b4e418319646b51d9226e21.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_3109bb28895ce8feb882d4f97240c1f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4f7bed5e1b4786eb170be1d3d5c1c484.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_2449ab5c46bdde8aea6f5dd15799916e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487583d0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_64747c8ba1cf70a3afb4e867b1187936.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851e190>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_963900dcb01eaa10e15e022ab02079e4.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04847b910>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_15cb964c6639b96a75012fc4c1961cdb.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ee5d0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_3085fa190f1a1c32f52bf45787b654c1.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048983390>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bb6852e17143fc023c8739b7d287e29d.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04875b950>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_4daad1151d95df705d336da676c3c6ce.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04849fad0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_1247bec0987ecdba064af3b28cb84318.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_dc3f6e449e09343818a6746044fc97e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_123fe886e736ad1744f786b65bc645e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_3aa64b2042a38a352e3c453647771655.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4a0e9080c570617ef7708817fc53d06d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_700bd3c2d7e9c38180d49f2f95795db6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bce10>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_3109bb28895ce8feb882d4f97240c1f5.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048576a90>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4f7bed5e1b4786eb170be1d3d5c1c484.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885a2d0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_2449ab5c46bdde8aea6f5dd15799916e.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3, skipping ID generation
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with scrape type 1
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 sending to next pipeline
2026-04-27 07:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3, identifier: GT44883
2026-04-27 07:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883
2026-04-27 07:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883
2026-04-27 07:56:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883 to the API
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_2449ab5c46bdde8aea6f5dd15799916e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Sevilla',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:34:55Z',
'fuel_type': 'diesel',
'id': '6b344bbe-c22f-549c-a5cd-5e0e723c38f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT44883',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Audi',
'model': 'A4',
'odometer': 253454,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_4fcf9cd0ae7b154a9f3db7d787b3cc72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_979ae5c839526de4b642f55635ba7940.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_b090de2aedcc8098761311e41a6bf7df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00caad370792fb79df0bf86425cbf7ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_477494f87df5fbf4767abeeabe4624c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_00283b498e2ef4df26b8af39223682bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_cd9a0b5d375ff65ee5659ee31e1ec927.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_6011c6d38b4e418319646b51d9226e21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_15cb964c6639b96a75012fc4c1961cdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b344bbe-c22f-549c-a5cd-5e0e723c38f3/6b344bbe-c22f-549c-a5cd-5e0e723c38f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/69/cc6927fa3324ca635d72c4fd08b3a409/pa/GT44883_2449ab5c46bdde8aea6f5dd15799916e.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2018-08-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-04-27 07:56:53 [auto1.es] INFO: Saving data for GT44883: {'created_time': 1777276613.905483, 'last_price_update_time': 1777276613.905495, 'has_photos': True, 'auction_closing_time': 1777304095.0}
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_524eb31f5f9beed60ac73fd5eeff72a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_f4865cb7937b6273370abb0f2cbae9b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_64427c69006bed43442c3d26a0fd0d73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dc31801eb9382fbd4776f3fb26ba443d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_b3e75d7bf1e7a8ee0ab1538d0c559d91.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_0a2db49d8b7b96a3f4a934c5649e9faf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a8a50>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_dc3f6e449e09343818a6746044fc97e0.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53b07256-b3ba-5df4-845c-9d8e2427e26e
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53b07256-b3ba-5df4-845c-9d8e2427e26e, skipping ID generation
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b07256-b3ba-5df4-845c-9d8e2427e26e with scrape type 1
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53b07256-b3ba-5df4-845c-9d8e2427e26e sending to next pipeline
2026-04-27 07:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53b07256-b3ba-5df4-845c-9d8e2427e26e, identifier: ES62151
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048932c90>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_123fe886e736ad1744f786b65bc645e9.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c
2026-04-27 07:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c, skipping ID generation
2026-04-27 07:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c with scrape type 1
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c sending to next pipeline
2026-04-27 07:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c, identifier: TW09945
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a2f150>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_3aa64b2042a38a352e3c453647771655.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862ba90>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4a0e9080c570617ef7708817fc53d06d.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d8a388f-19a6-53e2-86ce-6219832dc464
2026-04-27 07:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d8a388f-19a6-53e2-86ce-6219832dc464, skipping ID generation
2026-04-27 07:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8a388f-19a6-53e2-86ce-6219832dc464 with scrape type 1
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d8a388f-19a6-53e2-86ce-6219832dc464 sending to next pipeline
2026-04-27 07:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d8a388f-19a6-53e2-86ce-6219832dc464, identifier: UN89621
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486f2d50>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_700bd3c2d7e9c38180d49f2f95795db6.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e78bf8a1-ca65-58b3-900e-035028ec03b3
2026-04-27 07:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e78bf8a1-ca65-58b3-900e-035028ec03b3, skipping ID generation
2026-04-27 07:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78bf8a1-ca65-58b3-900e-035028ec03b3 with scrape type 1
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e78bf8a1-ca65-58b3-900e-035028ec03b3 sending to next pipeline
2026-04-27 07:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e78bf8a1-ca65-58b3-900e-035028ec03b3, identifier: DB92602
2026-04-27 07:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53b07256-b3ba-5df4-845c-9d8e2427e26e with identifier: ES62151
2026-04-27 07:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53b07256-b3ba-5df4-845c-9d8e2427e26e with identifier: ES62151
2026-04-27 07:56:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53b07256-b3ba-5df4-845c-9d8e2427e26e with identifier: ES62151 to the API
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_dc3f6e449e09343818a6746044fc97e0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'city': 'Esquivias',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:08:26Z',
'fuel_type': 'diesel',
'id': '53b07256-b3ba-5df4-845c-9d8e2427e26e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES62151',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 98964,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38865,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_dc3f6e449e09343818a6746044fc97e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38865,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_3109bb28895ce8feb882d4f97240c1f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38817,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_64747c8ba1cf70a3afb4e867b1187936.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35553,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_b66e05eb6288de8f7205f3cc7c73bf35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31640,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_331b683e156b279c4e41c3d54335de99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38598,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_963900dcb01eaa10e15e022ab02079e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35272,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_8eac1e4ad658ebcf3149a6cdbdaf01d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38513,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_ec02487d5c183e4c2414253d345764f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33255,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_77a6405cf62ac43d56d428e94115702e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53b07256-b3ba-5df4-845c-9d8e2427e26e/53b07256-b3ba-5df4-845c-9d8e2427e26e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30966,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img8b/59/8b59297c2410d09949b9c6749bdcd232/pa/ES62151_1418085600ec38d2e564ccbd2d58e62b.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2020-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-04-27 07:56:54 [auto1.es] INFO: Saving data for ES62151: {'created_time': 1777276614.98253, 'last_price_update_time': 1777276614.982541, 'has_photos': True, 'auction_closing_time': 1777302506.0}
2026-04-27 07:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c with identifier: TW09945
2026-04-27 07:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c with identifier: TW09945
2026-04-27 07:56:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c with identifier: TW09945 to the API
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_123fe886e736ad1744f786b65bc645e9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'city': 'Torrejon De Ardoz',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:46:23Z',
'fuel_type': 'petrol',
'id': 'bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.4554,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW09945',
'listing': 'auction',
'location': 'ES, Torrejon de Ardoz',
'location_confidence': 'geocoded',
'longitude': -3.4697,
'make': 'Seat',
'model': 'Tarraco',
'odometer': 71020,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_123fe886e736ad1744f786b65bc645e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_093b35e0da013fdd2202c31cde07303a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_483567427b8d401216dc93df65d0ddd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_feda75a31774c4a4d2f74c6c8d0b8a58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_b65b4ac5a834fd154f2aef24b5603292.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_1247bec0987ecdba064af3b28cb84318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_9bcaea26d160a7d0f82838bca687417e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_4db1fa9125b9d26cabd327b81526bffe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_eb4fcd59895ec57004718907ef9652b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c/bf21eb60-59f5-57ae-8eb1-1e3d88b69d8c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/69/f469643a46ce64d4efbbcad08c156ec8/pa/TW09945_0092f765830b7401f8855bbbca2657cd.jpg',
'Width': 800}],
'postal_code': '28850',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2022-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2022}
2026-04-27 07:56:55 [auto1.es] INFO: Saving data for TW09945: {'created_time': 1777276615.391379, 'last_price_update_time': 1777276615.39139, 'has_photos': True, 'auction_closing_time': 1777304783.0}
2026-04-27 07:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d8a388f-19a6-53e2-86ce-6219832dc464 with identifier: UN89621
2026-04-27 07:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d8a388f-19a6-53e2-86ce-6219832dc464 with identifier: UN89621
2026-04-27 07:56:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d8a388f-19a6-53e2-86ce-6219832dc464 with identifier: UN89621 to the API
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4a0e9080c570617ef7708817fc53d06d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': 'Rental',
'city': 'El Rebolledo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:24:15Z',
'fuel_type': 'diesel',
'id': '7d8a388f-19a6-53e2-86ce-6219832dc464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN89621',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'BMW',
'model': '3er',
'odometer': 76542,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4a0e9080c570617ef7708817fc53d06d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_4f7bed5e1b4786eb170be1d3d5c1c484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_3085fa190f1a1c32f52bf45787b654c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bd19c4baaba5665602cd5dc7620373e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_c92b82074978621d3b23d9c2dba544dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_bb6852e17143fc023c8739b7d287e29d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_2fe3db89e8ccd69dffa7e21fb54b1fa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_83129ab46e6b4c094e6744ec31164baa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_07e287e0761b23d5a52818097ed1673a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d8a388f-19a6-53e2-86ce-6219832dc464/7d8a388f-19a6-53e2-86ce-6219832dc464_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/3c/163c7b959a37933a2011fdbb0ee26292/pa/UN89621_ad5be815da1a3f00fc876e10b36f4fcb.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2022-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2022}
2026-04-27 07:56:55 [auto1.es] INFO: Saving data for UN89621: {'created_time': 1777276615.857043, 'last_price_update_time': 1777276615.857056, 'has_photos': True, 'auction_closing_time': 1777303455.0}
2026-04-27 07:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e78bf8a1-ca65-58b3-900e-035028ec03b3 with identifier: DB92602
2026-04-27 07:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e78bf8a1-ca65-58b3-900e-035028ec03b3 with identifier: DB92602
2026-04-27 07:56:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e78bf8a1-ca65-58b3-900e-035028ec03b3 with identifier: DB92602 to the API
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_700bd3c2d7e9c38180d49f2f95795db6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Campo Real',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:27:58Z',
'fuel_type': 'diesel',
'id': 'e78bf8a1-ca65-58b3-900e-035028ec03b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB92602',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'BMW',
'model': 'X1',
'odometer': 281269,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_700bd3c2d7e9c38180d49f2f95795db6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_4daad1151d95df705d336da676c3c6ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_af9f95036327aac7536270c3a059b28d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b71ae8aa97bb2260da12f94fbc0d8b5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_6f4a28597fe6ec06329e78de5fcbd42f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_b9d33b4e15eaa854b63149aba014f3b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7ff788fcb86b964939a6321edafaf254.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_acd985306f77d7ef3cb128a3b96e407c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_7de283f6b0e050bda712ff555d8230ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e78bf8a1-ca65-58b3-900e-035028ec03b3/e78bf8a1-ca65-58b3-900e-035028ec03b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/aa/c6aa476552b5bb04535da4780ac4c9eb/pa/DB92602_60f6ca77924088a4eda53b219b5d70dd.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2016-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2016}
2026-04-27 07:56:56 [auto1.es] INFO: Saving data for DB92602: {'created_time': 1777276616.296048, 'last_price_update_time': 1777276616.296059, 'has_photos': True, 'auction_closing_time': 1777303678.0}
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_2acf4bc51a1c17a0c577de448388e9c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_789d3520656e4896ae75957eb6173b5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8fc05083bc3b7edfa86af74adc39dbbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_3f701bd8432e6472ee46118f03b7df99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ79262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER14870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489ab950>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_524eb31f5f9beed60ac73fd5eeff72a2.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fd090>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_f4865cb7937b6273370abb0f2cbae9b1.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb92b0fc-748c-5159-9890-a8e4b420eba8
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb92b0fc-748c-5159-9890-a8e4b420eba8, skipping ID generation
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb92b0fc-748c-5159-9890-a8e4b420eba8 with scrape type 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb92b0fc-748c-5159-9890-a8e4b420eba8 sending to next pipeline
2026-04-27 07:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb92b0fc-748c-5159-9890-a8e4b420eba8, identifier: PM42549
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851eb90>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_64427c69006bed43442c3d26a0fd0d73.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891ae10>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dc31801eb9382fbd4776f3fb26ba443d.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048614ed0>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_b3e75d7bf1e7a8ee0ab1538d0c559d91.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048471910>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_0a2db49d8b7b96a3f4a934c5649e9faf.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549
2026-04-27 07:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549
2026-04-27 07:56:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549 to the API
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_f4865cb7937b6273370abb0f2cbae9b1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Granyanella',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:09:12Z',
'fuel_type': 'petrol',
'id': 'fb92b0fc-748c-5159-9890-a8e4b420eba8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM42549',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 188494,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_f4865cb7937b6273370abb0f2cbae9b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_ead1909903b002fbb6ab32eece0e57f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_7d676b9dc9f871626a9f9021ff61d0f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_98be3f40f1f64af7940d8601275e162c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_66c7a3072f7aca29e1f170d12fc7da61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb92b0fc-748c-5159-9890-a8e4b420eba8/fb92b0fc-748c-5159-9890-a8e4b420eba8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/99/9999e7bcf3334f0702b7604f25e05d0b/pa/PM42549_c5dbc0a77eecadc4f4f3b4e3c847a901.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2010-10-28',
'seats_number': 4,
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
'transmission': 'manual',
'trim': 'Quadrifoglio Verde',
'year': 2010}
2026-04-27 07:56:57 [auto1.es] INFO: Saving data for PM42549: {'created_time': 1777276617.009227, 'last_price_update_time': 1777276617.009238, 'has_photos': True, 'auction_closing_time': 1777388952.0}
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT34418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK85653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207bd0>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_2acf4bc51a1c17a0c577de448388e9c6.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afc81e69-f6a8-5895-aa39-13828b38365d
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afc81e69-f6a8-5895-aa39-13828b38365d, skipping ID generation
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc81e69-f6a8-5895-aa39-13828b38365d with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afc81e69-f6a8-5895-aa39-13828b38365d sending to next pipeline
2026-04-27 07:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: afc81e69-f6a8-5895-aa39-13828b38365d, identifier: VC68158
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048204750>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_789d3520656e4896ae75957eb6173b5a.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fff0ddf3-a7b5-5f98-b91e-8400527eb5a5, skipping ID generation
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 sending to next pipeline
2026-04-27 07:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fff0ddf3-a7b5-5f98-b91e-8400527eb5a5, identifier: KE93313
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487b82d0>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8fc05083bc3b7edfa86af74adc39dbbf.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3c0f5a6-79bf-5192-9c3d-330bc67fa5be, skipping ID generation
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3c0f5a6-79bf-5192-9c3d-330bc67fa5be sending to next pipeline
2026-04-27 07:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c3c0f5a6-79bf-5192-9c3d-330bc67fa5be, identifier: SN89364
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768e90>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_3f701bd8432e6472ee46118f03b7df99.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158
2026-04-27 07:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158
2026-04-27 07:56:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: afc81e69-f6a8-5895-aa39-13828b38365d with identifier: VC68158 to the API
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_2acf4bc51a1c17a0c577de448388e9c6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Granyanella',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:45:58Z',
'fuel_type': 'diesel',
'id': 'afc81e69-f6a8-5895-aa39-13828b38365d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC68158',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Seat',
'model': 'Exeo',
'odometer': 244476,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_45a45662ad1accbadfe6297d35a3f83a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_2acf4bc51a1c17a0c577de448388e9c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dacfe94b6c19c928309438decfc96930.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_29a38446f6cdbfb9e87dbc0a90d3c114.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_64427c69006bed43442c3d26a0fd0d73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_ea7490c45cbb2714fb317b9676a7e88d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_dc31801eb9382fbd4776f3fb26ba443d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_b3e75d7bf1e7a8ee0ab1538d0c559d91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_20eeecde86b5ec50fe31aed8eee12831.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_afc81e69-f6a8-5895-aa39-13828b38365d/afc81e69-f6a8-5895-aa39-13828b38365d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/be/fabe0e582c895b08b88d5fc370862bb4/pa/VC68158_3aa64b2042a38a352e3c453647771655.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2011-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Exeo 2.0 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2011}
2026-04-27 07:56:57 [auto1.es] INFO: Saving data for VC68158: {'created_time': 1777276617.932939, 'last_price_update_time': 1777276617.932962, 'has_photos': True, 'auction_closing_time': 1777391158.0}
2026-04-27 07:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 with identifier: KE93313
2026-04-27 07:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 with identifier: KE93313
2026-04-27 07:56:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fff0ddf3-a7b5-5f98-b91e-8400527eb5a5 with identifier: KE93313 to the API
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_789d3520656e4896ae75957eb6173b5a.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Sevilla',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:14:26Z',
'fuel_type': 'petrol',
'id': 'fff0ddf3-a7b5-5f98-b91e-8400527eb5a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE93313',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Citroen',
'model': 'C4',
'odometer': 253499,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_63309f2ca9974a0ea1409d97d8aab506.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_30ce7daf3b89264aceb75e05114d4e9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_d6f6c01c99ddb78407406f9087058679.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_973695c44432e9b1f67fe763bca47482.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_789d3520656e4896ae75957eb6173b5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fff0ddf3-a7b5-5f98-b91e-8400527eb5a5/fff0ddf3-a7b5-5f98-b91e-8400527eb5a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/39/6f3992685f8865c699882a1591df1243/pa/KE93313_0b2226fd062810a84504100e3ad4cc67.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2009-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2009}
2026-04-27 07:56:58 [auto1.es] INFO: Saving data for KE93313: {'created_time': 1777276618.350448, 'last_price_update_time': 1777276618.350463, 'has_photos': True, 'auction_closing_time': 1777389266.0}
2026-04-27 07:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c3c0f5a6-79bf-5192-9c3d-330bc67fa5be with identifier: SN89364
2026-04-27 07:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c3c0f5a6-79bf-5192-9c3d-330bc67fa5be with identifier: SN89364
2026-04-27 07:56:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c3c0f5a6-79bf-5192-9c3d-330bc67fa5be with identifier: SN89364 to the API
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8fc05083bc3b7edfa86af74adc39dbbf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Araia',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:30:49Z',
'fuel_type': 'diesel',
'id': 'c3c0f5a6-79bf-5192-9c3d-330bc67fa5be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN89364',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Skoda',
'model': 'Octavia',
'odometer': 209816,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8fc05083bc3b7edfa86af74adc39dbbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_13f6af1a90b914782af2bde73e1d40d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_0a2db49d8b7b96a3f4a934c5649e9faf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_84839ac77bacbbd04ed314f9578604ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_2bab905bbce38f0195fcc5ad3e99be69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_524eb31f5f9beed60ac73fd5eeff72a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_d0373d95d044201604d578381c0959aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8a5a4f2f9a6a0718fdc3835d059e9070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_a897a75d64f6e8b1c3bd68e7e3b7f8f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3c0f5a6-79bf-5192-9c3d-330bc67fa5be/c3c0f5a6-79bf-5192-9c3d-330bc67fa5be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/3c/f93cb638023e06a087f40fcfdcd54876/pa/SN89364_8d728beed0161b0bbfc3a23ce969845a.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2014-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2014}
2026-04-27 07:56:58 [auto1.es] INFO: Saving data for SN89364: {'created_time': 1777276618.879579, 'last_price_update_time': 1777276618.87959, 'has_photos': True, 'auction_closing_time': 1777390249.0}
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_75119e7ec425e3fde3315c1adb37a5bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF40380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT84996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW60608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX28722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_f3d5f98a52e91804c1ead1858faf5057.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048606790>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_75119e7ec425e3fde3315c1adb37a5bd.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_b06567f3ef487d98367fe2fa3aa653a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_8cb6bb38f2f1313d1e34c10214efb51c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_99e6b76c09b88ef549e4bd45eec38878.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482bb410>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f84e4d-a125-5c76-a1c7-c7d13a33a488/c1f84e4d-a125-5c76-a1c7-c7d13a33a488_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_f3d5f98a52e91804c1ead1858faf5057.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877e10>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f84e4d-a125-5c76-a1c7-c7d13a33a488/c1f84e4d-a125-5c76-a1c7-c7d13a33a488_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_b06567f3ef487d98367fe2fa3aa653a4.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889dc10>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_8cb6bb38f2f1313d1e34c10214efb51c.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a81890>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fe6c6-0f4e-540b-baea-262e9311d715/799fe6c6-0f4e-540b-baea-262e9311d715_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0b/d50bdd9413b7c7fb25314919108b6212/pa/FU46355_99e6b76c09b88ef549e4bd45eec38878.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799fe6c6-0f4e-540b-baea-262e9311d715
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS58896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV95856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR91881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG21633> (referer: https://www.auto1.com/v1/car-details-view/DG21633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_fb406531e5336ce2286ba22695a42663.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335 with identifier: DG21633
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335 with scrape type 1
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_d651f0e374c1482925477178d5154c7f.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_aa112447ddc4b12bffd01dcae0b423c0.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_0c7acad5cb6a54e658369add867fad2a.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_41413c073b8dd00bb764ffcae7ba01fb.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_752ec16ccc0233810618013a552377dd.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK75464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884c0d0>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f84e4d-a125-5c76-a1c7-c7d13a33a488/c1f84e4d-a125-5c76-a1c7-c7d13a33a488_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/80/a680fcfd1508eebca54418aa88f2d249/pa/GB16607_fb406531e5336ce2286ba22695a42663.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1f84e4d-a125-5c76-a1c7-c7d13a33a488
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_2dc69aed9436746b25e5dd17329d9272.jpg not downloaded yet
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_b1b8ad4c62f8b9e0a1250cfb1a132897.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT06803/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB05133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_2759a46c2402448af6eb2e8f96a4bfab.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_91098ec133b00d8d03b3fd5d143fdc49.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_d00c9b60ad8d62e0b658ae0d8107f75a.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_41413c073b8dd00bb764ffcae7ba01fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2018 | hits on page: 40
2026-04-27 07:57:00 [auto1.es] INFO: Found listing with ID: JR39532
2026-04-27 07:57:00 [auto1.es] INFO: Scrape type for JR39532: 0
2026-04-27 07:57:00 [auto1.es] INFO: Found listing with ID: AK94783
2026-04-27 07:57:00 [auto1.es] INFO: Scrape type for AK94783: 0
2026-04-27 07:57:00 [auto1.es] INFO: Found listing with ID: VG63599
2026-04-27 07:57:00 [auto1.es] INFO: Scrape type for VG63599: 0
2026-04-27 07:57:00 [auto1.es] INFO: Found listing with ID: KK62636
2026-04-27 07:57:00 [auto1.es] INFO: Scrape type for KK62636: 0
2026-04-27 07:57:00 [auto1.es] INFO: Found listing with ID: RC86632
2026-04-27 07:57:00 [auto1.es] INFO: Scrape type for RC86632: 1
2026-04-27 07:57:00 [auto1.es] INFO: Found listing with ID: JX49148
2026-04-27 07:57:00 [auto1.es] INFO: Scrape type for JX49148: 2
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13916c85-47fb-58fb-a66a-a254973f8a3d with identifier: JX49148
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13916c85-47fb-58fb-a66a-a254973f8a3d with scrape type 2
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13916c85-47fb-58fb-a66a-a254973f8a3d with scrape type 2
2026-04-27 07:57:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13916c85-47fb-58fb-a66a-a254973f8a3d, identifier: JX49148
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_2dc69aed9436746b25e5dd17329d9272.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_752ec16ccc0233810618013a552377dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_b1b8ad4c62f8b9e0a1250cfb1a132897.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_d00c9b60ad8d62e0b658ae0d8107f75a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13916c85-47fb-58fb-a66a-a254973f8a3d with identifier: JX49148
2026-04-27 07:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13916c85-47fb-58fb-a66a-a254973f8a3d with identifier: JX49148
2026-04-27 07:57:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13916c85-47fb-58fb-a66a-a254973f8a3d with identifier: JX49148 to the API
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:22:09Z',
'fuel_type': 'diesel',
'id': '13916c85-47fb-58fb-a66a-a254973f8a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX49148',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A2',
'odometer': 100340,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-11-27',
'seller_name': None,
'title': 'Audi A2 1.4 TDI',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-04-27 07:57:01 [auto1.es] INFO: Saving data for JX49148: {'auction_closing_time': 1777303329.0, 'created_time': 1777021279.849651, 'has_photos': True, 'last_price_update_time': 1777276621.044021}
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048391fd0>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335/fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_41413c073b8dd00bb764ffcae7ba01fb.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335
2026-04-27 07:57:01 [auto1.es] INFO: Found listing with ID: ER40714
2026-04-27 07:57:01 [auto1.es] INFO: Scrape type for ER40714: 1
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY57218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:01 [auto1.es] INFO: Found listing with ID: JJ75829
2026-04-27 07:57:01 [auto1.es] INFO: Scrape type for JJ75829: 1
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK85653> (referer: https://www.auto1.com/v1/car-details-view/SK85653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT34418> (referer: https://www.auto1.com/v1/car-details-view/AT34418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e42d0>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335/fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_2dc69aed9436746b25e5dd17329d9272.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048570910>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335/fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_752ec16ccc0233810618013a552377dd.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048573610>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335/fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_b1b8ad4c62f8b9e0a1250cfb1a132897.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048211f90>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335/fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d3/cbd3f280b5b2cc65b29c3c7992c14493/pa/DG21633_d00c9b60ad8d62e0b658ae0d8107f75a.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbd983bc-a1d3-5c9b-bfbe-8d43dfa29335
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [auto1.es] INFO: Found listing with ID: EJ74969
2026-04-27 07:57:01 [auto1.es] INFO: Scrape type for EJ74969: 1
2026-04-27 07:57:01 [auto1.es] INFO: Found listing with ID: BK80752
2026-04-27 07:57:01 [auto1.es] INFO: Scrape type for BK80752: 1
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b1b83fb-901f-5566-b3d1-8b407e6e50bd with identifier: SK85653
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_955ed2cd7fc9c1e3ae007bdffe9ea92d.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcb7d46-17b3-5132-9967-57de711375b1 with identifier: AT34418
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcb7d46-17b3-5132-9967-57de711375b1 with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_c4a4acb42b13dce346ab9971b81d9f8b.jpg not downloaded yet
2026-04-27 07:57:01 [auto1.es] INFO: Found listing with ID: KX99272
2026-04-27 07:57:01 [auto1.es] INFO: Scrape type for KX99272: 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_d583d235ba9304fcfc9ff0fab24659a3.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_96d85a4604102042e2e1e97eb68d05b2.jpg not downloaded yet
2026-04-27 07:57:01 [auto1.es] INFO: Found listing with ID: VU76143
2026-04-27 07:57:01 [auto1.es] INFO: Scrape type for VU76143: 2
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466 with identifier: VU76143
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466 with scrape type 2
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466 with scrape type 2
2026-04-27 07:57:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466, identifier: VU76143
2026-04-27 07:57:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466 with identifier: VU76143
2026-04-27 07:57:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466 with identifier: VU76143
2026-04-27 07:57:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 85c8a7ad-ed40-5fd3-a196-ff8fc29ae466 with identifier: VU76143 to the API
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:27:58Z',
'fuel_type': 'diesel',
'id': '85c8a7ad-ed40-5fd3-a196-ff8fc29ae466',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU76143',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'R-Klasse',
'odometer': 339851,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-06-24',
'seller_name': None,
'title': 'Mercedes-Benz R-Klasse R 280 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 07:57:02 [auto1.es] INFO: Saving data for VU76143: {'auction_closing_time': 1777303678.0, 'created_time': 1777020896.26491, 'has_photos': True, 'last_price_update_time': 1777276622.121961}
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_277265dd1e8d3842eb47bff2da1d3ff0.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_ac2dfea885ac13a040eedcd493dc1114.jpg not downloaded yet
2026-04-27 07:57:02 [auto1.es] INFO: Found listing with ID: ZP54763
2026-04-27 07:57:02 [auto1.es] INFO: Scrape type for ZP54763: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_b578b474ebc8d3f6d175a5e362864058.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_453ff1966c734b762ce8a733ec692268.jpg not downloaded yet
2026-04-27 07:57:02 [auto1.es] INFO: Found listing with ID: YZ89757
2026-04-27 07:57:02 [auto1.es] INFO: Scrape type for YZ89757: 2
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605d1e7e-aa66-5f60-ade3-4043deccebd8 with identifier: YZ89757
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605d1e7e-aa66-5f60-ade3-4043deccebd8 with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605d1e7e-aa66-5f60-ade3-4043deccebd8 with scrape type 2
2026-04-27 07:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 605d1e7e-aa66-5f60-ade3-4043deccebd8, identifier: YZ89757
2026-04-27 07:57:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 605d1e7e-aa66-5f60-ade3-4043deccebd8 with identifier: YZ89757
2026-04-27 07:57:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 605d1e7e-aa66-5f60-ade3-4043deccebd8 with identifier: YZ89757
2026-04-27 07:57:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 605d1e7e-aa66-5f60-ade3-4043deccebd8 with identifier: YZ89757 to the API
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:54:38Z',
'fuel_type': 'diesel',
'id': '605d1e7e-aa66-5f60-ade3-4043deccebd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ89757',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 200944,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-05',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2011}
2026-04-27 07:57:02 [auto1.es] INFO: Saving data for YZ89757: {'auction_closing_time': 1777305278.0, 'created_time': 1777020781.923915, 'has_photos': True, 'last_price_update_time': 1777276622.75043}
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_fd97b1bb493910958f5738da973b5ba2.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_8a054bfad3250d3f97f3cc728f16a2ff.jpg not downloaded yet
2026-04-27 07:57:02 [auto1.es] INFO: Found listing with ID: HK88265
2026-04-27 07:57:02 [auto1.es] INFO: Scrape type for HK88265: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_990ce2a80cbd8eddd3441dfdc382b090.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_dea3c50c65fc65c5350992046292a6e7.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT84996> (referer: https://www.auto1.com/v1/car-details-view/JT84996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX28722> (referer: https://www.auto1.com/v1/car-details-view/YX28722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ79262> (referer: https://www.auto1.com/v1/car-details-view/VZ79262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:02 [auto1.es] INFO: Found listing with ID: KC20815
2026-04-27 07:57:02 [auto1.es] INFO: Scrape type for KC20815: 1
2026-04-27 07:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF40380> (referer: https://www.auto1.com/v1/car-details-view/RF40380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_b7655c88cffff915f6c556218f583d52.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_01d91db875b89ca325864cb3b14c2c78.jpg not downloaded yet
2026-04-27 07:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:02 [auto1.es] INFO: Found listing with ID: VE50785
2026-04-27 07:57:02 [auto1.es] INFO: Scrape type for VE50785: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_f92d164f9cf1ba647b4770e5ed2023f5.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_00097001e447f2fa43dd80a7825a1397.jpg not downloaded yet
2026-04-27 07:57:02 [auto1.es] INFO: Found listing with ID: MB16167
2026-04-27 07:57:03 [auto1.es] INFO: Scrape type for MB16167: 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_24842c09c60e24fdb1ce1175025f3b3f.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_a59d35e04629b4fcc34d8d8048470eee.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_fd97b1bb493910958f5738da973b5ba2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [auto1.es] INFO: Found listing with ID: NT25099
2026-04-27 07:57:03 [auto1.es] INFO: Scrape type for NT25099: 2
2026-04-27 07:57:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374cd73e-dd4e-5570-8226-41c657491ba8 with identifier: NT25099
2026-04-27 07:57:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374cd73e-dd4e-5570-8226-41c657491ba8 with scrape type 2
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 374cd73e-dd4e-5570-8226-41c657491ba8 with scrape type 2
2026-04-27 07:57:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 374cd73e-dd4e-5570-8226-41c657491ba8, identifier: NT25099
2026-04-27 07:57:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05504285-24e6-5586-b288-13bc3c60da63 with identifier: JT84996
2026-04-27 07:57:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05504285-24e6-5586-b288-13bc3c60da63 with scrape type 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_974ffc4d531f664b3e57559580b4df17.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4c72d8-eb33-5141-ad2c-fd53043480a6 with identifier: YX28722
2026-04-27 07:57:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6 with scrape type 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_091791fe0eb3ea493b3d491847a0b8b2.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262
2026-04-27 07:57:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6261e719-0f4c-5239-998d-aa4ad793fe8e with scrape type 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_3b2822c98ad6f8a7e245dfeea10c2f26.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 374cd73e-dd4e-5570-8226-41c657491ba8 with identifier: NT25099
2026-04-27 07:57:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 374cd73e-dd4e-5570-8226-41c657491ba8 with identifier: NT25099
2026-04-27 07:57:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 374cd73e-dd4e-5570-8226-41c657491ba8 with identifier: NT25099 to the API
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:53:12Z',
'fuel_type': 'diesel',
'id': '374cd73e-dd4e-5570-8226-41c657491ba8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT25099',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC70',
'odometer': 289158,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-12-25',
'seller_name': None,
'title': 'Volvo XC70 2.4 D4 Kinetic AWD',
'transmission': 'automatic',
'trim': 'Kinetic AWD',
'year': 2011}
2026-04-27 07:57:03 [auto1.es] INFO: Saving data for NT25099: {'auction_closing_time': 1777305192.0, 'created_time': 1777020897.124772, 'has_photos': True, 'last_price_update_time': 1777276623.585851}
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_a3ac9e37649d15e235dee9d677fde38f.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_463b301e0dcfcbd6e11a59631de5ab25.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_8a054bfad3250d3f97f3cc728f16a2ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [auto1.es] INFO: Found listing with ID: XW11917
2026-04-27 07:57:03 [auto1.es] INFO: Scrape type for XW11917: 2
2026-04-27 07:57:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a803c2d-2b5c-5288-bd44-c5a425c15556 with identifier: XW11917
2026-04-27 07:57:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a803c2d-2b5c-5288-bd44-c5a425c15556 with scrape type 2
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a803c2d-2b5c-5288-bd44-c5a425c15556 with scrape type 2
2026-04-27 07:57:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a803c2d-2b5c-5288-bd44-c5a425c15556, identifier: XW11917
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_d34291e6a7e7c7a86c23c79df6062d2c.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_6cdc97d6594077d4a207d28ad43e341e.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_7cdf47086c406ab5fe91411c982af37f.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee85d4b-5606-580f-ba0d-dd9e7c993c5d with identifier: RF40380
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_5fffc1d6b297cc09ee20e5196763c803.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_dea3c50c65fc65c5350992046292a6e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a803c2d-2b5c-5288-bd44-c5a425c15556 with identifier: XW11917
2026-04-27 07:57:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a803c2d-2b5c-5288-bd44-c5a425c15556 with identifier: XW11917
2026-04-27 07:57:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a803c2d-2b5c-5288-bd44-c5a425c15556 with identifier: XW11917 to the API
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:59:35Z',
'fuel_type': 'diesel',
'id': '9a803c2d-2b5c-5288-bd44-c5a425c15556',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW11917',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Verso',
'odometer': 309646,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-02-04',
'seller_name': None,
'title': 'Toyota Verso 2.0 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-04-27 07:57:04 [auto1.es] INFO: Saving data for XW11917: {'auction_closing_time': 1777305575.0, 'created_time': 1777020855.578141, 'has_photos': True, 'last_price_update_time': 1777276624.366973}
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS58896> (referer: https://www.auto1.com/v1/car-details-view/DS58896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV95856> (referer: https://www.auto1.com/v1/car-details-view/JV95856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [auto1.es] INFO: Found listing with ID: ME50829
2026-04-27 07:57:04 [auto1.es] INFO: Scrape type for ME50829: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_bd54510e506b8cfd5c3be5b5ee381172.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_e25b08573c8c0f79d2aba45fca1d4b0e.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_be9f30f3fe317c3668d2dac479ba4c90.jpg not downloaded yet
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_7fe934924b447af838431bfd5fc7d6fb.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW60608> (referer: https://www.auto1.com/v1/car-details-view/DW60608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bd550>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_fd97b1bb493910958f5738da973b5ba2.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851e510>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_8a054bfad3250d3f97f3cc728f16a2ff.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 07:57:04 [auto1.es] INFO: Found listing with ID: HD33844
2026-04-27 07:57:04 [auto1.es] INFO: Scrape type for HD33844: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_3f630637c5e356a7721cb941b8dd2037.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_99c17298bf482e710a59cf91c96ac0e2.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_54eb3aa285813ec666a9b903f44b3d25.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_312078f5246952be9cfe4b2c89e38f6e.jpg not downloaded yet
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0290>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_dea3c50c65fc65c5350992046292a6e7.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_3b2822c98ad6f8a7e245dfeea10c2f26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 with identifier: DS58896
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_dfb9c104bde14e417431b42661aeb5f6.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c33856-0f7c-5dda-95e9-3e4231d9233d with identifier: JV95856
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c33856-0f7c-5dda-95e9-3e4231d9233d with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ddd16577113b2df1f698d49bdd4a7620.jpg not downloaded yet
2026-04-27 07:57:04 [auto1.es] INFO: Found listing with ID: KJ50966
2026-04-27 07:57:04 [auto1.es] INFO: Scrape type for KJ50966: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_fa54c77d335094140ac0ca4661ad9200.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_9063eef14d36135f7626b25271a5a117.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_8939539ab865e9f4d2abc57438077783.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a3ce6bdc629857f8195a95ef726389f0.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65177319-09c4-55f6-8f96-337d949bf581 with identifier: DW60608
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65177319-09c4-55f6-8f96-337d949bf581 with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_4101d80e4283aedcb7d4a4b81c015c50.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_7cdf47086c406ab5fe91411c982af37f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_5fffc1d6b297cc09ee20e5196763c803.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_39deea7ec21ccbbfebe8201b15a5aa20.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ccfecd56443ace9ba77a315479173507.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_463b301e0dcfcbd6e11a59631de5ab25.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_6cdc97d6594077d4a207d28ad43e341e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [auto1.es] INFO: Found listing with ID: FG51952
2026-04-27 07:57:04 [auto1.es] INFO: Scrape type for FG51952: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_08c92f4bb5a56dd3406a2257f021ac4c.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_ed2180a4b8829bdc7b11550dc67b50fa.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_98e43fa7b68994e90f76cb3fdb799e2c.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_644eb33f697a00722ae1230c49a2f6be.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_56eab744679461e900f956f875dbca75.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_b304a6e0d4974bf484708f2149147586.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_c04f536756f1ff907ceb1b0a8ead353c.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fc450>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_3b2822c98ad6f8a7e245dfeea10c2f26.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 07:57:05 [auto1.es] INFO: Found listing with ID: EA09417
2026-04-27 07:57:05 [auto1.es] INFO: Scrape type for EA09417: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_f0ad8cbeee64ebe308b9229d30ba692d.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_bb2fb094bc0438cb433cf8ad08429576.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_9f5171bd6c777964f197a1d5e11910e1.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_430686107fb3dcd62eb7fb33736c0c59.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_7fe934924b447af838431bfd5fc7d6fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_dfb9c104bde14e417431b42661aeb5f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_fbcf0323900398b31e8306141885e55a.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_fb21118ebb38c91e18d3b0fd2453155b.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a35550>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_7cdf47086c406ab5fe91411c982af37f.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487e3a10>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_5fffc1d6b297cc09ee20e5196763c803.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c0990>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_463b301e0dcfcbd6e11a59631de5ab25.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853b50>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_6cdc97d6594077d4a207d28ad43e341e.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ddd16577113b2df1f698d49bdd4a7620.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [auto1.es] INFO: Found listing with ID: XN80363
2026-04-27 07:57:05 [auto1.es] INFO: Scrape type for XN80363: 2
2026-04-27 07:57:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d694451d-4f50-5ea8-a5f8-3197467ee0ad with identifier: XN80363
2026-04-27 07:57:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d694451d-4f50-5ea8-a5f8-3197467ee0ad with scrape type 2
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d694451d-4f50-5ea8-a5f8-3197467ee0ad with scrape type 2
2026-04-27 07:57:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d694451d-4f50-5ea8-a5f8-3197467ee0ad, identifier: XN80363
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_1e1c520bbddc1c811fd3e5da967e3ced.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1165528fdfef5e8a3dea4173610c6bf6.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_2d78b5a6b37f28cbecdbcf272e647219.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_132920465c28f95f9b60c1b5865f2ea9.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_4101d80e4283aedcb7d4a4b81c015c50.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d694451d-4f50-5ea8-a5f8-3197467ee0ad with identifier: XN80363
2026-04-27 07:57:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d694451d-4f50-5ea8-a5f8-3197467ee0ad with identifier: XN80363
2026-04-27 07:57:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d694451d-4f50-5ea8-a5f8-3197467ee0ad with identifier: XN80363 to the API
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:10:48Z',
'fuel_type': 'diesel',
'id': 'd694451d-4f50-5ea8-a5f8-3197467ee0ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN80363',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 141100,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-12-14',
'seller_name': None,
'title': 'Opel Astra GTC 1.9 CDTI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2006}
2026-04-27 07:57:06 [auto1.es] INFO: Saving data for XN80363: {'auction_closing_time': 1777302648.0, 'created_time': 1777020773.070623, 'has_photos': True, 'last_price_update_time': 1777276626.025907}
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e5b8d7601d0b704b34a51f4ba0e5b91f.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_97758c376dd6209513d8bda169a84087.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a3ce6bdc629857f8195a95ef726389f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [auto1.es] INFO: Found listing with ID: XY97125
2026-04-27 07:57:06 [auto1.es] INFO: Scrape type for XY97125: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_824488681e47b9707e8b861cac0d2a07.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1f196f8ac92df315e56eff024929af68.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_acb19a8ec2dbbc08f8134808d289d04b.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_0aa70b15039362bba5e4a9e15db84933.jpg not downloaded yet
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048343390>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_7fe934924b447af838431bfd5fc7d6fb.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a4250>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_dfb9c104bde14e417431b42661aeb5f6.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_051e53886d3b6f27011a7225d0565204.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8da74ed92db2191fc62dd74ac1f61145.jpg not downloaded yet
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7b410>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ddd16577113b2df1f698d49bdd4a7620.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_b304a6e0d4974bf484708f2149147586.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_c04f536756f1ff907ceb1b0a8ead353c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [auto1.es] INFO: Found listing with ID: RM79142
2026-04-27 07:57:06 [auto1.es] INFO: Scrape type for RM79142: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_a8efc15c50fcf103e2cb1c138cb8612f.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_149df617713fcc6d43042df8337f0772.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_f9c8c6813195bbfc4a97f135d12c4275.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7c085988bb6db65149ceea1a8b2a5cdd.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT06803> (referer: https://www.auto1.com/v1/car-details-view/WT06803/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC86632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB05133> (referer: https://www.auto1.com/v1/car-details-view/LB05133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR91881> (referer: https://www.auto1.com/v1/car-details-view/BR91881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER40714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_430686107fb3dcd62eb7fb33736c0c59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_6f09b4b5e35eafb04788b88e738933df.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8895d32ed5a1e794be4a44b86b4a9767.jpg not downloaded yet
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ75829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048565890>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_4101d80e4283aedcb7d4a4b81c015c50.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ae7d0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a3ce6bdc629857f8195a95ef726389f0.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:57:06 [auto1.es] INFO: Found listing with ID: BD94338
2026-04-27 07:57:06 [auto1.es] INFO: Scrape type for BD94338: 2
2026-04-27 07:57:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a10a276-5a45-5c52-a9c3-becd438e572b with identifier: BD94338
2026-04-27 07:57:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a10a276-5a45-5c52-a9c3-becd438e572b with scrape type 2
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a10a276-5a45-5c52-a9c3-becd438e572b with scrape type 2
2026-04-27 07:57:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a10a276-5a45-5c52-a9c3-becd438e572b, identifier: BD94338
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a9410a1db52b03f7adbbe9aa21b376b2.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d518666fd4d044b346b8f88892d19fa9.jpg not downloaded yet
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_fb21118ebb38c91e18d3b0fd2453155b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a10a276-5a45-5c52-a9c3-becd438e572b with identifier: BD94338
2026-04-27 07:57:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a10a276-5a45-5c52-a9c3-becd438e572b with identifier: BD94338
2026-04-27 07:57:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a10a276-5a45-5c52-a9c3-becd438e572b with identifier: BD94338 to the API
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:57:57Z',
'fuel_type': 'petrol',
'id': '5a10a276-5a45-5c52-a9c3-becd438e572b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD94338',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 170711,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-05-27',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 FSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2007}
2026-04-27 07:57:07 [auto1.es] INFO: Saving data for BD94338: {'auction_closing_time': 1777305477.0, 'created_time': 1777020664.518392, 'has_photos': True, 'last_price_update_time': 1777276627.353239}
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e79aadf269799c2db0a0bb23428bee7c.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_e593a8a29f1c6af4d4a8b2c2419b523b.jpg not downloaded yet
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_132920465c28f95f9b60c1b5865f2ea9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [auto1.es] INFO: Found listing with ID: XY79472
2026-04-27 07:57:07 [auto1.es] INFO: Scrape type for XY79472: 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7f90f8bf390f46bacced8ea98304fa96.jpg not downloaded yet
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572317d0>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_b304a6e0d4974bf484708f2149147586.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b0410>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_c04f536756f1ff907ceb1b0a8ead353c.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:07 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2018 | hits on page: 40
2026-04-27 07:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 with identifier: WT06803
2026-04-27 07:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 with scrape type 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_550a76856e4f95ef0766cfc398bb7189.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f98444a-0c41-5996-8c43-6e1931bc28dc with identifier: LB05133
2026-04-27 07:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f98444a-0c41-5996-8c43-6e1931bc28dc with scrape type 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_d9b8cbf18ddfec98dec79d2b3a019b69.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c22632-c72a-51a4-9494-bdc63e96499e with identifier: BR91881
2026-04-27 07:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c22632-c72a-51a4-9494-bdc63e96499e with scrape type 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_567ccad6bd98ca98c743772347d36c3f.jpg not downloaded yet
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bd510>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_430686107fb3dcd62eb7fb33736c0c59.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_aad3f77be4a9a6f1cb60edeac846a1d4.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_9c163c0e974e439fa818b7bf4704123b.jpg not downloaded yet
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_824488681e47b9707e8b861cac0d2a07.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1f196f8ac92df315e56eff024929af68.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_acb19a8ec2dbbc08f8134808d289d04b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8da74ed92db2191fc62dd74ac1f61145.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_051e53886d3b6f27011a7225d0565204.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_0aa70b15039362bba5e4a9e15db84933.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [auto1.es] INFO: Found listing with ID: VE17467
2026-04-27 07:57:07 [auto1.es] INFO: Scrape type for VE17467: 2
2026-04-27 07:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 500172b2-1fa5-5fbb-a9c6-56c52d915ebe with identifier: VE17467
2026-04-27 07:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 500172b2-1fa5-5fbb-a9c6-56c52d915ebe with scrape type 2
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 500172b2-1fa5-5fbb-a9c6-56c52d915ebe with scrape type 2
2026-04-27 07:57:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 500172b2-1fa5-5fbb-a9c6-56c52d915ebe, identifier: VE17467
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_c4838fa7218c0e735b1be49017494781.jpg not downloaded yet
2026-04-27 07:57:07 [auto1.es] INFO: Found listing with ID: FM10376
2026-04-27 07:57:07 [auto1.es] INFO: Scrape type for FM10376: 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_e2ab8682e43710b34c363b5e3483e06d.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4eb213226e4cdbeecdc8d38888f09145.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_d80e1888bf745258b1592fb9f59859e7.jpg not downloaded yet
2026-04-27 07:57:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 500172b2-1fa5-5fbb-a9c6-56c52d915ebe with identifier: VE17467
2026-04-27 07:57:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 500172b2-1fa5-5fbb-a9c6-56c52d915ebe with identifier: VE17467
2026-04-27 07:57:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 500172b2-1fa5-5fbb-a9c6-56c52d915ebe with identifier: VE17467 to the API
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:31:41Z',
'fuel_type': 'petrol',
'id': '500172b2-1fa5-5fbb-a9c6-56c52d915ebe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE17467',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Honda',
'model': 'FR-V',
'odometer': 245948,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-08-31',
'seller_name': None,
'title': 'Honda FR-V 2.0 VTEC Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2005}
2026-04-27 07:57:08 [auto1.es] INFO: Saving data for VE17467: {'auction_closing_time': 1777303901.0, 'created_time': 1777020701.910023, 'has_photos': True, 'last_price_update_time': 1777276628.304031}
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_9fc8511dff1e710cf08e40d456f1483b.jpg not downloaded yet
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_754cf82e859c826be19e7a7173638b67.jpg not downloaded yet
2026-04-27 07:57:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486f94d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_fb21118ebb38c91e18d3b0fd2453155b.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822de50>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_132920465c28f95f9b60c1b5865f2ea9.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e5b8d7601d0b704b34a51f4ba0e5b91f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_97758c376dd6209513d8bda169a84087.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [auto1.es] INFO: Found listing with ID: BF84239
2026-04-27 07:57:08 [auto1.es] INFO: Scrape type for BF84239: 1
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d2cd871e3016c1a0db0cbdda7762d9d4.jpg not downloaded yet
2026-04-27 07:57:08 [auto1.es] INFO: Found listing with ID: XS13258
2026-04-27 07:57:08 [auto1.es] INFO: Scrape type for XS13258: 1
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_30e0a887872c5474f7cb75ac7148546d.jpg not downloaded yet
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1b7b04a5148d36e86357928eb06836f.jpg not downloaded yet
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_fae88e7f958a20604d14d8f2c23daefb.jpg not downloaded yet
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04893ab50>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_824488681e47b9707e8b861cac0d2a07.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048500d90>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1f196f8ac92df315e56eff024929af68.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048688310>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_acb19a8ec2dbbc08f8134808d289d04b.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048502a50>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8da74ed92db2191fc62dd74ac1f61145.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482577d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_051e53886d3b6f27011a7225d0565204.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ffcd0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_0aa70b15039362bba5e4a9e15db84933.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:08 [auto1.es] INFO: Found listing with ID: XU70286
2026-04-27 07:57:09 [auto1.es] INFO: Scrape type for XU70286: 1
2026-04-27 07:57:09 [auto1.es] INFO: Found listing with ID: HV86151
2026-04-27 07:57:09 [auto1.es] INFO: Scrape type for HV86151: 1
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_03c489c2face48cb95201d2b118a3a12.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_267ac3807a351dc2d851812c3f71ca22.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_f6473bd87fd7bed38f3593725c96663b.jpg not downloaded yet
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_aad3f77be4a9a6f1cb60edeac846a1d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_9c163c0e974e439fa818b7bf4704123b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a9410a1db52b03f7adbbe9aa21b376b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d518666fd4d044b346b8f88892d19fa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fce50>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e5b8d7601d0b704b34a51f4ba0e5b91f.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048648690>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_97758c376dd6209513d8bda169a84087.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_567ccad6bd98ca98c743772347d36c3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_d9b8cbf18ddfec98dec79d2b3a019b69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7c085988bb6db65149ceea1a8b2a5cdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [auto1.es] INFO: Found listing with ID: XA75818
2026-04-27 07:57:09 [auto1.es] INFO: Scrape type for XA75818: 1
2026-04-27 07:57:09 [auto1.es] INFO: Found listing with ID: WM31555
2026-04-27 07:57:09 [auto1.es] INFO: Scrape type for WM31555: 1
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_7f89811b7ceae37e4fccd560096584ad.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_8edf218e297367ba1cc9af70d0577312.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_c3216ae9b4aee39d51fc2810e7d7a031.jpg not downloaded yet
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_d80e1888bf745258b1592fb9f59859e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [auto1.es] INFO: Found listing with ID: CS90007
2026-04-27 07:57:09 [auto1.es] INFO: Scrape type for CS90007: 1
2026-04-27 07:57:09 [auto1.es] INFO: Found listing with ID: WA17428
2026-04-27 07:57:09 [auto1.es] INFO: Scrape type for WA17428: 2
2026-04-27 07:57:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc1b7c2-6495-59c6-9d35-a3d36cc7da88 with identifier: WA17428
2026-04-27 07:57:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc1b7c2-6495-59c6-9d35-a3d36cc7da88 with scrape type 2
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc1b7c2-6495-59c6-9d35-a3d36cc7da88 with scrape type 2
2026-04-27 07:57:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecc1b7c2-6495-59c6-9d35-a3d36cc7da88, identifier: WA17428
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_80e828a996449172ac256edd5829b419.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_ad3caafb30a9b42303a05c9e6ae4f3ed.jpg not downloaded yet
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_9842453aebf6d2dff1ef1d1b52cea51c.jpg not downloaded yet
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK88265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY97125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4eb213226e4cdbeecdc8d38888f09145.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecc1b7c2-6495-59c6-9d35-a3d36cc7da88 with identifier: WA17428
2026-04-27 07:57:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecc1b7c2-6495-59c6-9d35-a3d36cc7da88 with identifier: WA17428
2026-04-27 07:57:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecc1b7c2-6495-59c6-9d35-a3d36cc7da88 with identifier: WA17428 to the API
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:22:09Z',
'fuel_type': 'diesel',
'id': 'ecc1b7c2-6495-59c6-9d35-a3d36cc7da88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA17428',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 178000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-04-01',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-04-27 07:57:09 [auto1.es] INFO: Saving data for WA17428: {'auction_closing_time': 1777303329.0, 'created_time': 1777021308.22503, 'has_photos': True, 'last_price_update_time': 1777276629.983063}
2026-04-27 07:57:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b72d0>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_aad3f77be4a9a6f1cb60edeac846a1d4.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b6c10>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_9c163c0e974e439fa818b7bf4704123b.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048880650>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a9410a1db52b03f7adbbe9aa21b376b2.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04893bc90>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d518666fd4d044b346b8f88892d19fa9.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_03c489c2face48cb95201d2b118a3a12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [auto1.es] INFO: Found listing with ID: TS82866
2026-04-27 07:57:10 [auto1.es] INFO: Scrape type for TS82866: 2
2026-04-27 07:57:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676e8b7c-cefd-5066-a52b-581041bce3d3 with identifier: TS82866
2026-04-27 07:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676e8b7c-cefd-5066-a52b-581041bce3d3 with scrape type 2
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 676e8b7c-cefd-5066-a52b-581041bce3d3 with scrape type 2
2026-04-27 07:57:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 676e8b7c-cefd-5066-a52b-581041bce3d3, identifier: TS82866
2026-04-27 07:57:10 [auto1.es] INFO: Found listing with ID: YW84322
2026-04-27 07:57:10 [auto1.es] INFO: Scrape type for YW84322: 1
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_fdb95f7e55b7de60f5d5d5ff8dd86ba2.jpg not downloaded yet
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1d5edd8d2ec264474edf57420b0bedb.jpg not downloaded yet
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_4fef61f510d6e574a153cb0c2df9f113.jpg not downloaded yet
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1b7b04a5148d36e86357928eb06836f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_fae88e7f958a20604d14d8f2c23daefb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_30e0a887872c5474f7cb75ac7148546d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_267ac3807a351dc2d851812c3f71ca22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_f6473bd87fd7bed38f3593725c96663b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 676e8b7c-cefd-5066-a52b-581041bce3d3 with identifier: TS82866
2026-04-27 07:57:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 676e8b7c-cefd-5066-a52b-581041bce3d3 with identifier: TS82866
2026-04-27 07:57:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 676e8b7c-cefd-5066-a52b-581041bce3d3 with identifier: TS82866 to the API
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:35:21Z',
'fuel_type': 'diesel',
'id': '676e8b7c-cefd-5066-a52b-581041bce3d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS82866',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Kangoo',
'odometer': 205632,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-10',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Profesional',
'transmission': 'manual',
'trim': 'Profesional',
'year': 2016}
2026-04-27 07:57:10 [auto1.es] INFO: Saving data for TS82866: {'auction_closing_time': 1777304121.0, 'created_time': 1777021265.111155, 'has_photos': True, 'last_price_update_time': 1777276630.731405}
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB16167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:10 [auto1.es] INFO: Found listing with ID: WX82700
2026-04-27 07:57:10 [auto1.es] INFO: Scrape type for WX82700: 1
2026-04-27 07:57:10 [auto1.es] INFO: Found listing with ID: LX18680
2026-04-27 07:57:10 [auto1.es] INFO: Scrape type for LX18680: 1
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_6a7ae88692f82136664eb557d287fb5f.jpg not downloaded yet
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_5c9c8925a90d53753ab47a4522562f86.jpg not downloaded yet
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_a82961d4d3f482ee947ef58ceec06d6b.jpg not downloaded yet
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK75464> (referer: https://www.auto1.com/v1/car-details-view/ZK75464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048880390>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_567ccad6bd98ca98c743772347d36c3f.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048519a50>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_d9b8cbf18ddfec98dec79d2b3a019b69.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048640dd0>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7c085988bb6db65149ceea1a8b2a5cdd.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e0450>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_d80e1888bf745258b1592fb9f59859e7.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483bdd90>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4eb213226e4cdbeecdc8d38888f09145.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_c3216ae9b4aee39d51fc2810e7d7a031.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_8edf218e297367ba1cc9af70d0577312.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_7f89811b7ceae37e4fccd560096584ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:11 [auto1.es] INFO: Found listing with ID: LU77013
2026-04-27 07:57:11 [auto1.es] INFO: Scrape type for LU77013: 2
2026-04-27 07:57:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5592dd-86ab-5741-b519-5da1a3b1a059 with identifier: LU77013
2026-04-27 07:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5592dd-86ab-5741-b519-5da1a3b1a059 with scrape type 2
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5592dd-86ab-5741-b519-5da1a3b1a059 with scrape type 2
2026-04-27 07:57:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d5592dd-86ab-5741-b519-5da1a3b1a059, identifier: LU77013
2026-04-27 07:57:11 [auto1.es] INFO: Found listing with ID: HK75942
2026-04-27 07:57:11 [auto1.es] INFO: Scrape type for HK75942: 1
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_85227ced9ea3f5b3e0b316baffc1a134.jpg not downloaded yet
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4028d1a2a47cc02b918f698de006c1a6.jpg not downloaded yet
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_8dcb33a100b88cc98e6dc8c41d751359.jpg not downloaded yet
2026-04-27 07:57:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d5592dd-86ab-5741-b519-5da1a3b1a059 with identifier: LU77013
2026-04-27 07:57:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d5592dd-86ab-5741-b519-5da1a3b1a059 with identifier: LU77013
2026-04-27 07:57:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d5592dd-86ab-5741-b519-5da1a3b1a059 with identifier: LU77013 to the API
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-04-27T15:40:20Z',
'fuel_type': 'diesel',
'id': '5d5592dd-86ab-5741-b519-5da1a3b1a059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU77013',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 137711,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-04-06',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2010}
2026-04-27 07:57:11 [auto1.es] INFO: Saving data for LU77013: {'auction_closing_time': 1777304420.0, 'created_time': 1777020760.231677, 'has_photos': True, 'last_price_update_time': 1777276631.686648}
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836f3d0>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_03c489c2face48cb95201d2b118a3a12.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bc650>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1b7b04a5148d36e86357928eb06836f.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489758d0>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_fae88e7f958a20604d14d8f2c23daefb.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fd950>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_30e0a887872c5474f7cb75ac7148546d.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f9ad0>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_267ac3807a351dc2d851812c3f71ca22.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ddc50>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_f6473bd87fd7bed38f3593725c96663b.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with scrape type 1
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg not downloaded yet
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_fdb95f7e55b7de60f5d5d5ff8dd86ba2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [auto1.es] INFO: Found listing with ID: AB03508
2026-04-27 07:57:12 [auto1.es] INFO: Scrape type for AB03508: 1
2026-04-27 07:57:12 [auto1.es] INFO: Found listing with ID: XC60196
2026-04-27 07:57:12 [auto1.es] INFO: Scrape type for XC60196: 2
2026-04-27 07:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fb9184f-2a3f-55d4-8314-f1e4efb0c339 with identifier: XC60196
2026-04-27 07:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fb9184f-2a3f-55d4-8314-f1e4efb0c339 with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fb9184f-2a3f-55d4-8314-f1e4efb0c339 with scrape type 2
2026-04-27 07:57:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6fb9184f-2a3f-55d4-8314-f1e4efb0c339, identifier: XC60196
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_278a93dc422a1d7211028f19f9d165f3.jpg not downloaded yet
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_9835e0683931e3de7a71d0e17c9c7bc3.jpg not downloaded yet
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_3eb19e3d5881f54f6484a15d562a03ff.jpg not downloaded yet
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_ad3caafb30a9b42303a05c9e6ae4f3ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_4fef61f510d6e574a153cb0c2df9f113.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1d5edd8d2ec264474edf57420b0bedb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_9842453aebf6d2dff1ef1d1b52cea51c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_80e828a996449172ac256edd5829b419.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6fb9184f-2a3f-55d4-8314-f1e4efb0c339 with identifier: XC60196
2026-04-27 07:57:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6fb9184f-2a3f-55d4-8314-f1e4efb0c339 with identifier: XC60196
2026-04-27 07:57:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6fb9184f-2a3f-55d4-8314-f1e4efb0c339 with identifier: XC60196 to the API
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:25:10Z',
'fuel_type': 'diesel',
'id': '6fb9184f-2a3f-55d4-8314-f1e4efb0c339',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC60196',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Kuga',
'odometer': 372253,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-06-28',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-04-27 07:57:12 [auto1.es] INFO: Saving data for XC60196: {'auction_closing_time': 1777303510.0, 'created_time': 1777020636.203366, 'has_photos': True, 'last_price_update_time': 1777276632.937316}
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg not downloaded yet
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fc210>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_c3216ae9b4aee39d51fc2810e7d7a031.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f0b90>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_8edf218e297367ba1cc9af70d0577312.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d1e50>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_7f89811b7ceae37e4fccd560096584ad.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:13 [auto1.es] INFO: Found listing with ID: HS86207
2026-04-27 07:57:13 [auto1.es] INFO: Scrape type for HS86207: 1
2026-04-27 07:57:13 [auto1.es] INFO: Found listing with ID: LS17151
2026-04-27 07:57:13 [auto1.es] INFO: Scrape type for LS17151: 2
2026-04-27 07:57:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ba37a0-0fe7-5674-bd0e-33927b3e697b with identifier: LS17151
2026-04-27 07:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ba37a0-0fe7-5674-bd0e-33927b3e697b with scrape type 2
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4ba37a0-0fe7-5674-bd0e-33927b3e697b with scrape type 2
2026-04-27 07:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4ba37a0-0fe7-5674-bd0e-33927b3e697b, identifier: LS17151
2026-04-27 07:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4ba37a0-0fe7-5674-bd0e-33927b3e697b with identifier: LS17151
2026-04-27 07:57:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4ba37a0-0fe7-5674-bd0e-33927b3e697b with identifier: LS17151
2026-04-27 07:57:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4ba37a0-0fe7-5674-bd0e-33927b3e697b with identifier: LS17151 to the API
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:56:53Z',
'fuel_type': 'diesel',
'id': 'a4ba37a0-0fe7-5674-bd0e-33927b3e697b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS17151',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 414896,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-08-31',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 07:57:13 [auto1.es] INFO: Saving data for LS17151: {'auction_closing_time': 1777305413.0, 'created_time': 1777020680.308326, 'has_photos': True, 'last_price_update_time': 1777276633.546909}
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg not downloaded yet
2026-04-27 07:57:13 [auto1.es] INFO: Found listing with ID: CC89526
2026-04-27 07:57:13 [auto1.es] INFO: Scrape type for CC89526: 1
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482df210>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_fdb95f7e55b7de60f5d5d5ff8dd86ba2.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486da990>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_ad3caafb30a9b42303a05c9e6ae4f3ed.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048879ed0>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_4fef61f510d6e574a153cb0c2df9f113.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a38050>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1d5edd8d2ec264474edf57420b0bedb.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cbad0>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_9842453aebf6d2dff1ef1d1b52cea51c.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff056e60150>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_80e828a996449172ac256edd5829b419.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg not downloaded yet
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_85227ced9ea3f5b3e0b316baffc1a134.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_8dcb33a100b88cc98e6dc8c41d751359.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4028d1a2a47cc02b918f698de006c1a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [auto1.es] INFO: Found listing with ID: DB27489
2026-04-27 07:57:13 [auto1.es] INFO: Scrape type for DB27489: 1
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg not downloaded yet
2026-04-27 07:57:13 [auto1.es] INFO: Found listing with ID: RS45242
2026-04-27 07:57:13 [auto1.es] INFO: Scrape type for RS45242: 1
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg not downloaded yet
2026-04-27 07:57:13 [auto1.es] INFO: Found listing with ID: XX51310
2026-04-27 07:57:13 [auto1.es] INFO: Scrape type for XX51310: 2
2026-04-27 07:57:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8edfc5-65a0-5b29-b84a-bc66526893c7 with identifier: XX51310
2026-04-27 07:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8edfc5-65a0-5b29-b84a-bc66526893c7 with scrape type 2
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8edfc5-65a0-5b29-b84a-bc66526893c7 with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee8edfc5-65a0-5b29-b84a-bc66526893c7, identifier: XX51310
2026-04-27 07:57:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee8edfc5-65a0-5b29-b84a-bc66526893c7 with identifier: XX51310
2026-04-27 07:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee8edfc5-65a0-5b29-b84a-bc66526893c7 with identifier: XX51310
2026-04-27 07:57:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee8edfc5-65a0-5b29-b84a-bc66526893c7 with identifier: XX51310 to the API
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:05:45Z',
'fuel_type': 'diesel',
'id': 'ee8edfc5-65a0-5b29-b84a-bc66526893c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX51310',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A4',
'odometer': 177868,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-07-15',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2008}
2026-04-27 07:57:14 [auto1.es] INFO: Saving data for XX51310: {'auction_closing_time': 1777302345.0, 'created_time': 1777020775.130085, 'has_photos': True, 'last_price_update_time': 1777276634.441983}
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg not downloaded yet
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872d7d0>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485059d0>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_85227ced9ea3f5b3e0b316baffc1a134.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0590>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_8dcb33a100b88cc98e6dc8c41d751359.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048837290>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4028d1a2a47cc02b918f698de006c1a6.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:57:14 [auto1.es] INFO: Found listing with ID: AY38423
2026-04-27 07:57:14 [auto1.es] INFO: Scrape type for AY38423: 1
2026-04-27 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg not downloaded yet
2026-04-27 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:14 [auto1.es] INFO: Found listing with ID: DE32472
2026-04-27 07:57:14 [auto1.es] INFO: Scrape type for DE32472: 1
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg not downloaded yet
2026-04-27 07:57:14 [auto1.es] INFO: Found listing with ID: DT10330
2026-04-27 07:57:14 [auto1.es] INFO: Scrape type for DT10330: 2
2026-04-27 07:57:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d with identifier: DT10330
2026-04-27 07:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d with scrape type 2
2026-04-27 07:57:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d, identifier: DT10330
2026-04-27 07:57:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d with identifier: DT10330
2026-04-27 07:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d with identifier: DT10330
2026-04-27 07:57:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d with identifier: DT10330 to the API
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:00:54Z',
'fuel_type': 'diesel',
'id': 'b277e8ed-ad2b-55cb-b3aa-ab2d4c4caf6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT10330',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '807',
'odometer': 181129,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-06-25',
'seller_name': None,
'title': 'Peugeot 807 2.0 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2008}
2026-04-27 07:57:15 [auto1.es] INFO: Saving data for DT10330: {'auction_closing_time': 1777302054.0, 'created_time': 1777020647.288259, 'has_photos': True, 'last_price_update_time': 1777276635.177059}
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg not downloaded yet
2026-04-27 07:57:15 [auto1.es] INFO: Found listing with ID: AX40830
2026-04-27 07:57:15 [auto1.es] INFO: Scrape type for AX40830: 1
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [auto1.es] INFO: Found listing with ID: JX54716
2026-04-27 07:57:15 [auto1.es] INFO: Scrape type for JX54716: 2
2026-04-27 07:57:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1f8791a-ece5-545a-bd92-a709d9c97c1c with identifier: JX54716
2026-04-27 07:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1f8791a-ece5-545a-bd92-a709d9c97c1c with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1f8791a-ece5-545a-bd92-a709d9c97c1c with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1f8791a-ece5-545a-bd92-a709d9c97c1c, identifier: JX54716
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877350>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885250>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1f8791a-ece5-545a-bd92-a709d9c97c1c with identifier: JX54716
2026-04-27 07:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1f8791a-ece5-545a-bd92-a709d9c97c1c with identifier: JX54716
2026-04-27 07:57:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a1f8791a-ece5-545a-bd92-a709d9c97c1c with identifier: JX54716 to the API
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-04-27T15:36:17Z',
'fuel_type': 'petrol',
'id': 'a1f8791a-ece5-545a-bd92-a709d9c97c1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX54716',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 190499,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-11-15',
'seller_name': None,
'title': 'Volkswagen Sharan 2.8 V6 Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2004}
2026-04-27 07:57:15 [auto1.es] INFO: Saving data for JX54716: {'auction_closing_time': 1777304177.0, 'created_time': 1776941032.832433, 'has_photos': True, 'last_price_update_time': 1777276635.835576}
2026-04-27 07:57:15 [auto1.es] INFO: Found listing with ID: NN86067
2026-04-27 07:57:15 [auto1.es] INFO: Scrape type for NN86067: 2
2026-04-27 07:57:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135975c5-957b-5fd0-9c88-eba9fa4f537c with identifier: NN86067
2026-04-27 07:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135975c5-957b-5fd0-9c88-eba9fa4f537c with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135975c5-957b-5fd0-9c88-eba9fa4f537c with scrape type 2
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 135975c5-957b-5fd0-9c88-eba9fa4f537c, identifier: NN86067
2026-04-27 07:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 135975c5-957b-5fd0-9c88-eba9fa4f537c with identifier: NN86067
2026-04-27 07:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 135975c5-957b-5fd0-9c88-eba9fa4f537c with identifier: NN86067
2026-04-27 07:57:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 135975c5-957b-5fd0-9c88-eba9fa4f537c with identifier: NN86067 to the API
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:00:38Z',
'fuel_type': 'petrol',
'id': '135975c5-957b-5fd0-9c88-eba9fa4f537c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN86067',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A1',
'odometer': 121609,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-10-05',
'seller_name': None,
'title': 'Audi A1 1.4 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2017}
2026-04-27 07:57:16 [auto1.es] INFO: Saving data for NN86067: {'auction_closing_time': 1777302038.0, 'created_time': 1776941035.631751, 'has_photos': True, 'last_price_update_time': 1777276636.313892}
2026-04-27 07:57:16 [auto1.es] INFO: Found listing with ID: FY33661
2026-04-27 07:57:16 [auto1.es] INFO: Scrape type for FY33661: 1
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ee590>
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:57:16 [auto1.es] INFO: Found listing with ID: FU29422
2026-04-27 07:57:16 [auto1.es] INFO: Scrape type for FU29422: 2
2026-04-27 07:57:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422
2026-04-27 07:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65368c80-465c-562d-8dd9-8caeddd91714 with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65368c80-465c-562d-8dd9-8caeddd91714 with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65368c80-465c-562d-8dd9-8caeddd91714, identifier: FU29422
2026-04-27 07:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422
2026-04-27 07:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422
2026-04-27 07:57:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65368c80-465c-562d-8dd9-8caeddd91714 with identifier: FU29422 to the API
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-04-27T15:52:50Z',
'fuel_type': 'petrol',
'id': '65368c80-465c-562d-8dd9-8caeddd91714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU29422',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '208',
'odometer': 56087,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-09-13',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-04-27 07:57:16 [auto1.es] INFO: Saving data for FU29422: {'auction_closing_time': 1777305170.0, 'created_time': 1777020740.25849, 'has_photos': True, 'last_price_update_time': 1777276636.782713}
2026-04-27 07:57:16 [auto1.es] INFO: Found listing with ID: UR77549
2026-04-27 07:57:16 [auto1.es] INFO: Scrape type for UR77549: 1
2026-04-27 07:57:16 [auto1.es] INFO: Found listing with ID: SW56668
2026-04-27 07:57:16 [auto1.es] INFO: Scrape type for SW56668: 1
2026-04-27 07:57:16 [auto1.es] INFO: Found listing with ID: AX57912
2026-04-27 07:57:16 [auto1.es] INFO: Scrape type for AX57912: 2
2026-04-27 07:57:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6812c36c-24e9-5a57-b6e6-ee458bc8c626 with identifier: AX57912
2026-04-27 07:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6812c36c-24e9-5a57-b6e6-ee458bc8c626 with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6812c36c-24e9-5a57-b6e6-ee458bc8c626 with scrape type 2
2026-04-27 07:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6812c36c-24e9-5a57-b6e6-ee458bc8c626, identifier: AX57912
2026-04-27 07:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6812c36c-24e9-5a57-b6e6-ee458bc8c626 with identifier: AX57912
2026-04-27 07:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6812c36c-24e9-5a57-b6e6-ee458bc8c626 with identifier: AX57912
2026-04-27 07:57:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6812c36c-24e9-5a57-b6e6-ee458bc8c626 with identifier: AX57912 to the API
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:32:28Z',
'fuel_type': 'diesel',
'id': '6812c36c-24e9-5a57-b6e6-ee458bc8c626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX57912',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'DS Automobiles',
'model': 'DS4',
'odometer': 128560,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'DS Automobiles DS4 1.6 Blue-HDi Performance Line',
'transmission': 'automatic',
'trim': 'Performance Line',
'year': 2017}
2026-04-27 07:57:17 [auto1.es] INFO: Saving data for AX57912: {'auction_closing_time': 1777303948.0, 'created_time': 1777020758.237395, 'has_photos': True, 'last_price_update_time': 1777276637.294067}
2026-04-27 07:57:17 [auto1.es] INFO: Found listing with ID: XL60553
2026-04-27 07:57:17 [auto1.es] INFO: Scrape type for XL60553: 1
2026-04-27 07:57:17 [auto1.es] INFO: Found listing with ID: EN12908
2026-04-27 07:57:17 [auto1.es] INFO: Scrape type for EN12908: 1
2026-04-27 07:57:17 [auto1.es] INFO: Found listing with ID: BZ95808
2026-04-27 07:57:17 [auto1.es] INFO: Scrape type for BZ95808: 2
2026-04-27 07:57:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22 with identifier: BZ95808
2026-04-27 07:57:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22 with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22 with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22, identifier: BZ95808
2026-04-27 07:57:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22 with identifier: BZ95808
2026-04-27 07:57:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22 with identifier: BZ95808
2026-04-27 07:57:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f8f626c-8e75-5c12-901b-bf8e5b9ecc22 with identifier: BZ95808 to the API
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-04-27T15:15:55Z',
'fuel_type': 'petrol',
'id': '8f8f626c-8e75-5c12-901b-bf8e5b9ecc22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ95808',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Fabia',
'odometer': 105209,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-02-23',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2009}
2026-04-27 07:57:17 [auto1.es] INFO: Saving data for BZ95808: {'auction_closing_time': 1777302955.0, 'created_time': 1777021037.325384, 'has_photos': True, 'last_price_update_time': 1777276637.744706}
2026-04-27 07:57:17 [auto1.es] INFO: Found listing with ID: VB30178
2026-04-27 07:57:17 [auto1.es] INFO: Scrape type for VB30178: 2
2026-04-27 07:57:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178
2026-04-27 07:57:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575455f4-1c35-598c-b45e-c62140c99f42 with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 575455f4-1c35-598c-b45e-c62140c99f42 with scrape type 2
2026-04-27 07:57:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 575455f4-1c35-598c-b45e-c62140c99f42, identifier: VB30178
2026-04-27 07:57:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178
2026-04-27 07:57:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178
2026-04-27 07:57:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 575455f4-1c35-598c-b45e-c62140c99f42 with identifier: VB30178 to the API
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:38:30Z',
'fuel_type': 'petrol',
'id': '575455f4-1c35-598c-b45e-c62140c99f42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB30178',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Dacia',
'model': 'Duster',
'odometer': 163251,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-11-30',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe Essential',
'transmission': 'manual',
'trim': 'Essential',
'year': 2020}
2026-04-27 07:57:18 [auto1.es] INFO: Saving data for VB30178: {'auction_closing_time': 1777304310.0, 'created_time': 1777020638.101886, 'has_photos': True, 'last_price_update_time': 1777276638.283678}
2026-04-27 07:57:18 [auto1.es] INFO: Found listing with ID: NX39314
2026-04-27 07:57:18 [auto1.es] INFO: Scrape type for NX39314: 1
2026-04-27 07:57:18 [auto1.es] INFO: Found listing with ID: JE94628
2026-04-27 07:57:18 [auto1.es] INFO: Scrape type for JE94628: 1
2026-04-27 07:57:18 [auto1.es] INFO: Found listing with ID: ME60171
2026-04-27 07:57:18 [auto1.es] INFO: Scrape type for ME60171: 2
2026-04-27 07:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 304f8c6b-3cc1-5eff-a55e-92369db58fab with identifier: ME60171
2026-04-27 07:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 304f8c6b-3cc1-5eff-a55e-92369db58fab with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 304f8c6b-3cc1-5eff-a55e-92369db58fab with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 304f8c6b-3cc1-5eff-a55e-92369db58fab, identifier: ME60171
2026-04-27 07:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 304f8c6b-3cc1-5eff-a55e-92369db58fab with identifier: ME60171
2026-04-27 07:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 304f8c6b-3cc1-5eff-a55e-92369db58fab with identifier: ME60171
2026-04-27 07:57:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 304f8c6b-3cc1-5eff-a55e-92369db58fab with identifier: ME60171 to the API
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:56:09Z',
'fuel_type': 'petrol',
'id': '304f8c6b-3cc1-5eff-a55e-92369db58fab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME60171',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '207',
'odometer': 120719,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-07-26',
'seller_name': None,
'title': 'Peugeot 207 1.6 THP GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2007}
2026-04-27 07:57:18 [auto1.es] INFO: Saving data for ME60171: {'auction_closing_time': 1777305369.0, 'created_time': 1777018553.66418, 'has_photos': True, 'last_price_update_time': 1777276638.767765}
2026-04-27 07:57:18 [auto1.es] INFO: Found listing with ID: TT09961
2026-04-27 07:57:18 [auto1.es] INFO: Scrape type for TT09961: 2
2026-04-27 07:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b7d6ec-f6c2-5614-bd20-086573ff2c01 with identifier: TT09961
2026-04-27 07:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b7d6ec-f6c2-5614-bd20-086573ff2c01 with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97b7d6ec-f6c2-5614-bd20-086573ff2c01 with scrape type 2
2026-04-27 07:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97b7d6ec-f6c2-5614-bd20-086573ff2c01, identifier: TT09961
2026-04-27 07:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97b7d6ec-f6c2-5614-bd20-086573ff2c01 with identifier: TT09961
2026-04-27 07:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97b7d6ec-f6c2-5614-bd20-086573ff2c01 with identifier: TT09961
2026-04-27 07:57:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97b7d6ec-f6c2-5614-bd20-086573ff2c01 with identifier: TT09961 to the API
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:14:04Z',
'fuel_type': 'diesel',
'id': '97b7d6ec-f6c2-5614-bd20-086573ff2c01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT09961',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Scenic',
'odometer': 267836,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-10-26',
'seller_name': None,
'title': 'Renault Scenic 1.6 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-04-27 07:57:19 [auto1.es] INFO: Saving data for TT09961: {'auction_closing_time': 1777302844.0, 'created_time': 1777018576.412096, 'has_photos': True, 'last_price_update_time': 1777276639.188385}
2026-04-27 07:57:19 [auto1.es] INFO: Found listing with ID: XB53463
2026-04-27 07:57:19 [auto1.es] INFO: Scrape type for XB53463: 1
2026-04-27 07:57:19 [auto1.es] INFO: Found listing with ID: JC37021
2026-04-27 07:57:19 [auto1.es] INFO: Scrape type for JC37021: 2
2026-04-27 07:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426 with identifier: JC37021
2026-04-27 07:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426 with scrape type 2
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426 with scrape type 2
2026-04-27 07:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426, identifier: JC37021
2026-04-27 07:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426 with identifier: JC37021
2026-04-27 07:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426 with identifier: JC37021
2026-04-27 07:57:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ed8f6f7-cbc9-51c5-9360-b0804ba4f426 with identifier: JC37021 to the API
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:54:56Z',
'fuel_type': 'petrol',
'id': '6ed8f6f7-cbc9-51c5-9360-b0804ba4f426',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC37021',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 149964,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-27',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-04-27 07:57:19 [auto1.es] INFO: Saving data for JC37021: {'auction_closing_time': 1777305296.0, 'created_time': 1777020613.74137, 'has_photos': True, 'last_price_update_time': 1777276639.643031}
2026-04-27 07:57:19 [auto1.es] INFO: Found listing with ID: MC79542
2026-04-27 07:57:19 [auto1.es] INFO: Scrape type for MC79542: 2
2026-04-27 07:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c with identifier: MC79542
2026-04-27 07:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c with scrape type 2
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c with scrape type 2
2026-04-27 07:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c, identifier: MC79542
2026-04-27 07:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c with identifier: MC79542
2026-04-27 07:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c with identifier: MC79542
2026-04-27 07:57:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c with identifier: MC79542 to the API
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:43:03Z',
'fuel_type': 'diesel',
'id': '5d2f8943-5c85-5a7d-9cf7-434f1d99aa2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC79542',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Vivaro',
'odometer': 69339,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-09-08',
'seller_name': None,
'title': 'Opel Vivaro 1.5 CDTI L L3',
'transmission': 'manual',
'trim': 'L L3',
'year': 2020}
2026-04-27 07:57:20 [auto1.es] INFO: Saving data for MC79542: {'auction_closing_time': 1777304583.0, 'created_time': 1777018452.680808, 'has_photos': True, 'last_price_update_time': 1777276640.153881}
2026-04-27 07:57:20 [auto1.es] INFO: Found listing with ID: JT11599
2026-04-27 07:57:20 [auto1.es] INFO: Scrape type for JT11599: 2
2026-04-27 07:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18 with identifier: JT11599
2026-04-27 07:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18 with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18 with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18, identifier: JT11599
2026-04-27 07:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18 with identifier: JT11599
2026-04-27 07:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18 with identifier: JT11599
2026-04-27 07:57:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d27bcf1-714d-5ba8-ac4d-f247e21e2f18 with identifier: JT11599 to the API
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:59:11Z',
'fuel_type': 'diesel',
'id': '4d27bcf1-714d-5ba8-ac4d-f247e21e2f18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT11599',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 178464,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-11-04',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2012}
2026-04-27 07:57:20 [auto1.es] INFO: Saving data for JT11599: {'auction_closing_time': 1777305551.0, 'created_time': 1776940872.926256, 'has_photos': True, 'last_price_update_time': 1777276640.645044}
2026-04-27 07:57:20 [auto1.es] INFO: Found listing with ID: NV64390
2026-04-27 07:57:20 [auto1.es] INFO: Scrape type for NV64390: 2
2026-04-27 07:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-04-27 07:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de0fa3-f694-5341-9684-53b2d8cad80c with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49de0fa3-f694-5341-9684-53b2d8cad80c with scrape type 2
2026-04-27 07:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49de0fa3-f694-5341-9684-53b2d8cad80c, identifier: NV64390
2026-04-27 07:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-04-27 07:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-04-27 07:57:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390 to the API
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:20:52Z',
'fuel_type': 'diesel',
'id': '49de0fa3-f694-5341-9684-53b2d8cad80c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV64390',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 190301,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-03-25',
'seller_name': None,
'title': 'BMW X1 sDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-04-27 07:57:21 [auto1.es] INFO: Saving data for NV64390: {'auction_closing_time': 1777303252.0, 'created_time': 1777020384.491407, 'has_photos': True, 'last_price_update_time': 1777276641.064684}
2026-04-27 07:57:21 [auto1.es] INFO: Found listing with ID: MB84722
2026-04-27 07:57:21 [auto1.es] INFO: Scrape type for MB84722: 2
2026-04-27 07:57:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-04-27 07:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d29d70-4752-50ba-bba2-3736a46e3c8c with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d29d70-4752-50ba-bba2-3736a46e3c8c with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95d29d70-4752-50ba-bba2-3736a46e3c8c, identifier: MB84722
2026-04-27 07:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-04-27 07:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-04-27 07:57:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722 to the API
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:49:53Z',
'fuel_type': 'diesel',
'id': '95d29d70-4752-50ba-bba2-3736a46e3c8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB84722',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 125463,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-06-17',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2018}
2026-04-27 07:57:21 [auto1.es] INFO: Saving data for MB84722: {'auction_closing_time': 1777304993.0, 'created_time': 1777019746.379622, 'has_photos': True, 'last_price_update_time': 1777276641.470518}
2026-04-27 07:57:21 [auto1.es] INFO: Found listing with ID: DY61189
2026-04-27 07:57:21 [auto1.es] INFO: Scrape type for DY61189: 2
2026-04-27 07:57:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc with identifier: DY61189
2026-04-27 07:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc with scrape type 2
2026-04-27 07:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc, identifier: DY61189
2026-04-27 07:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc with identifier: DY61189
2026-04-27 07:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc with identifier: DY61189
2026-04-27 07:57:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc with identifier: DY61189 to the API
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:58:04Z',
'fuel_type': 'diesel',
'id': '82cc7f92-dd7e-51fa-9ddf-2d8786ff53bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY61189',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 193484,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-11-01',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 07:57:21 [auto1.es] INFO: Saving data for DY61189: {'auction_closing_time': 1777305484.0, 'created_time': 1777019980.022982, 'has_photos': True, 'last_price_update_time': 1777276641.965169}
2026-04-27 07:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER14870> (referer: https://www.auto1.com/v1/car-details-view/ER14870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 969218db-49ce-5c84-bbdf-ab16f28683c9 with identifier: ER14870
2026-04-27 07:57:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 969218db-49ce-5c84-bbdf-ab16f28683c9 with scrape type 1
2026-04-27 07:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e87239947fc2ff5a30b9d530f97a83db.jpg not downloaded yet
2026-04-27 07:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_6ec6f430d3a1d571f74e1e0dde2d9ed0.jpg not downloaded yet
2026-04-27 07:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_b935efd753118bf7772482e6e65c5e29.jpg not downloaded yet
2026-04-27 07:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e709100862f3bd761d5691443ea9a6b9.jpg not downloaded yet
2026-04-27 07:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_1fd5e84a2599d6890f0e4ae8dc7b9054.jpg not downloaded yet
2026-04-27 07:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_a51b34e1c03bd86a6f77933f397a2d1c.jpg not downloaded yet
2026-04-27 07:57:33 [scrapy.extensions.logstats] INFO: Crawled 217 pages (at 48 pages/min), scraped 286 items (at 52 items/min)
2026-04-27 07:57:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 378MiB
2026-04-27 07:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM31555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_a51b34e1c03bd86a6f77933f397a2d1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ede50>
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_a51b34e1c03bd86a6f77933f397a2d1c.jpg saved to cache
2026-04-27 07:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW84322/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA75818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_1fd5e84a2599d6890f0e4ae8dc7b9054.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048521310>
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_1fd5e84a2599d6890f0e4ae8dc7b9054.jpg saved to cache
2026-04-27 07:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e709100862f3bd761d5691443ea9a6b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a46dd0>
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e709100862f3bd761d5691443ea9a6b9.jpg saved to cache
2026-04-27 07:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK88265> (referer: https://www.auto1.com/v1/car-details-view/HK88265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3833165-cf06-5743-83c1-21dd84f5d6cb with identifier: HK88265
2026-04-27 07:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3833165-cf06-5743-83c1-21dd84f5d6cb with scrape type 1
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_f9b4b57923ac7d0a8e8caa818dfb3cfc.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4a9795e9f30cafae3d6edc0b9963f326.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_0573a263767e8163de510330fdc23448.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_8de36648a2e974069091d745a7b826a2.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_fec6fed515f96583190f6beb51d06971.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4f4f282755f48a0858995418518b31cf.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_b4aee61aad3ac71a20409ee995ee7ca2.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_c5a8bac69ade7a55dad284576019d52e.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_786d2405a955935fab6cfd7f584a566b.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_baf28e63003e426838584432f2ff3f22.jpg not downloaded yet
2026-04-27 07:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_b935efd753118bf7772482e6e65c5e29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_baf28e63003e426838584432f2ff3f22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dd110>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_b935efd753118bf7772482e6e65c5e29.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_786d2405a955935fab6cfd7f584a566b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048521f10>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_baf28e63003e426838584432f2ff3f22.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_c5a8bac69ade7a55dad284576019d52e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485212d0>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_786d2405a955935fab6cfd7f584a566b.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_b4aee61aad3ac71a20409ee995ee7ca2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485077d0>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_c5a8bac69ade7a55dad284576019d52e.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4f4f282755f48a0858995418518b31cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fd5d0>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_b4aee61aad3ac71a20409ee995ee7ca2.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_fec6fed515f96583190f6beb51d06971.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ff910>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4f4f282755f48a0858995418518b31cf.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_8de36648a2e974069091d745a7b826a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048168390>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_fec6fed515f96583190f6beb51d06971.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_0573a263767e8163de510330fdc23448.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a38290>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_8de36648a2e974069091d745a7b826a2.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4a9795e9f30cafae3d6edc0b9963f326.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3c410>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_0573a263767e8163de510330fdc23448.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_f9b4b57923ac7d0a8e8caa818dfb3cfc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048807810>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4a9795e9f30cafae3d6edc0b9963f326.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a39290>
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_f9b4b57923ac7d0a8e8caa818dfb3cfc.jpg saved to cache
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3833165-cf06-5743-83c1-21dd84f5d6cb
2026-04-27 07:58:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3833165-cf06-5743-83c1-21dd84f5d6cb, skipping ID generation
2026-04-27 07:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3833165-cf06-5743-83c1-21dd84f5d6cb with scrape type 1
2026-04-27 07:58:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3833165-cf06-5743-83c1-21dd84f5d6cb sending to next pipeline
2026-04-27 07:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3833165-cf06-5743-83c1-21dd84f5d6cb, identifier: HK88265
2026-04-27 07:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3833165-cf06-5743-83c1-21dd84f5d6cb with identifier: HK88265
2026-04-27 07:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3833165-cf06-5743-83c1-21dd84f5d6cb with identifier: HK88265
2026-04-27 07:58:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3833165-cf06-5743-83c1-21dd84f5d6cb with identifier: HK88265 to the API
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_f9b4b57923ac7d0a8e8caa818dfb3cfc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'city': 'Barcelona',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:03:27Z',
'fuel_type': 'diesel',
'id': 'b3833165-cf06-5743-83c1-21dd84f5d6cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK88265',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Renault',
'model': 'Clio',
'odometer': 130450,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_f9b4b57923ac7d0a8e8caa818dfb3cfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4a9795e9f30cafae3d6edc0b9963f326.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_0573a263767e8163de510330fdc23448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_8de36648a2e974069091d745a7b826a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_fec6fed515f96583190f6beb51d06971.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_4f4f282755f48a0858995418518b31cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_b4aee61aad3ac71a20409ee995ee7ca2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_c5a8bac69ade7a55dad284576019d52e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_786d2405a955935fab6cfd7f584a566b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3833165-cf06-5743-83c1-21dd84f5d6cb/b3833165-cf06-5743-83c1-21dd84f5d6cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/ec/e1ec1d26e915d4bf278cf9b65df04b40/pa/HK88265_baf28e63003e426838584432f2ff3f22.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-04-27 07:58:23 [auto1.es] INFO: Saving data for HK88265: {'created_time': 1777276703.434389, 'last_price_update_time': 1777276703.4344, 'has_photos': True, 'auction_closing_time': 1777302207.0}
2026-04-27 07:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_6ec6f430d3a1d571f74e1e0dde2d9ed0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e87239947fc2ff5a30b9d530f97a83db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048161f10>
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_6ec6f430d3a1d571f74e1e0dde2d9ed0.jpg saved to cache
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04814c690>
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e87239947fc2ff5a30b9d530f97a83db.jpg saved to cache
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 969218db-49ce-5c84-bbdf-ab16f28683c9
2026-04-27 07:58:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 969218db-49ce-5c84-bbdf-ab16f28683c9, skipping ID generation
2026-04-27 07:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 969218db-49ce-5c84-bbdf-ab16f28683c9 with scrape type 1
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 969218db-49ce-5c84-bbdf-ab16f28683c9 sending to next pipeline
2026-04-27 07:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 969218db-49ce-5c84-bbdf-ab16f28683c9, identifier: ER14870
2026-04-27 07:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 969218db-49ce-5c84-bbdf-ab16f28683c9 with identifier: ER14870
2026-04-27 07:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 969218db-49ce-5c84-bbdf-ab16f28683c9 with identifier: ER14870
2026-04-27 07:58:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 969218db-49ce-5c84-bbdf-ab16f28683c9 with identifier: ER14870 to the API
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e87239947fc2ff5a30b9d530f97a83db.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Sevilla',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:25:23Z',
'fuel_type': 'diesel',
'id': '969218db-49ce-5c84-bbdf-ab16f28683c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER14870',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Opel',
'model': 'Insignia',
'odometer': 303520,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e87239947fc2ff5a30b9d530f97a83db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_6ec6f430d3a1d571f74e1e0dde2d9ed0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_b935efd753118bf7772482e6e65c5e29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_e709100862f3bd761d5691443ea9a6b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_1fd5e84a2599d6890f0e4ae8dc7b9054.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_969218db-49ce-5c84-bbdf-ab16f28683c9/969218db-49ce-5c84-bbdf-ab16f28683c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e1/f3e1a332d21b0d06ec1ac6d41fab4d31/pa/ER14870_a51b34e1c03bd86a6f77933f397a2d1c.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2010-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-04-27 07:58:24 [auto1.es] INFO: Saving data for ER14870: {'created_time': 1777276704.070306, 'last_price_update_time': 1777276704.070315, 'has_photos': True, 'auction_closing_time': 1777389923.0}
2026-04-27 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC89526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB16167> (referer: https://www.auto1.com/v1/car-details-view/MB16167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d35d725-6292-5046-a538-693fb8225d27 with identifier: MB16167
2026-04-27 07:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d35d725-6292-5046-a538-693fb8225d27 with scrape type 1
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dc7225bd50bbf3aabfe5839244a32fab.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_094255ac3550ccfbd47240cdd95fea3e.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_a7da430bf55e6c6167bf47324054e655.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_8ae930af7a7a1e5cafb814a1abf9df00.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_07ba8e764fd3fcafb93515fcb498cd2c.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_483807bec987579450793cf55ad95502.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e2554d1223cb89a9ce97bf38d8eb2cf6.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dbedfddbfee41b3aa23e4962e1554823.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e5f1f739bbabec69a783a72c3bb4f7ab.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_902874692b2c461848bdd33d9415c4b1.jpg not downloaded yet
2026-04-27 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS86207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_902874692b2c461848bdd33d9415c4b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048237310>
2026-04-27 07:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_902874692b2c461848bdd33d9415c4b1.jpg saved to cache
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY38423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e5f1f739bbabec69a783a72c3bb4f7ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520290>
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e5f1f739bbabec69a783a72c3bb4f7ab.jpg saved to cache
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK75942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dbedfddbfee41b3aa23e4962e1554823.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d91d0>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dbedfddbfee41b3aa23e4962e1554823.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB53463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e2554d1223cb89a9ce97bf38d8eb2cf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048522450>
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e2554d1223cb89a9ce97bf38d8eb2cf6.jpg saved to cache
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:33 [scrapy.extensions.logstats] INFO: Crawled 227 pages (at 10 pages/min), scraped 288 items (at 2 items/min)
2026-04-27 07:58:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 378MiB
2026-04-27 07:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM31555> (referer: https://www.auto1.com/v1/car-details-view/WM31555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 with identifier: WM31555
2026-04-27 07:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 with scrape type 1
2026-04-27 07:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_171f72b8a71acf58793baa5918214389.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0db377cab2b58ea11b1bbd7ba3135a97.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0fde173f7a1513bdc12952d87101f250.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_233623dbbaba9daf9128f82525f66271.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_258b29550eac977a1d1b1dca3ace2ee2.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_a538fcc805ee5a05334a547461204cd5.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_06d4350e60c3d98ca177319662be3ffd.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_b068a659c771027718a575662be0aa19.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_8aff021788b06249e50645c562a9cd18.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_5284413feb6b967766d26eb12f7d4208.jpg not downloaded yet
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_483807bec987579450793cf55ad95502.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0480e9e50>
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_483807bec987579450793cf55ad95502.jpg saved to cache
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_5284413feb6b967766d26eb12f7d4208.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884090>
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_5284413feb6b967766d26eb12f7d4208.jpg saved to cache
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_8aff021788b06249e50645c562a9cd18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY97125> (referer: https://www.auto1.com/v1/car-details-view/XY97125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04816b0d0>
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_8aff021788b06249e50645c562a9cd18.jpg saved to cache
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f6c591b-616f-5925-9082-2669995ddfb0 with identifier: XY97125
2026-04-27 07:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f6c591b-616f-5925-9082-2669995ddfb0 with scrape type 1
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a57f7e8fcec90e78f7857124d7aef318.jpg not downloaded yet
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_b068a659c771027718a575662be0aa19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_7364c5aecda2f6ef59a146b91d0f5299.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_9ed7a8c725a26616053a3a1446635715.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_ba4f08777008b5f74a8173dc0773f654.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_bd64a59b39993eb96103eb2272886c36.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3167fbc6f77474e86e896f2fdb721880.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3c49623a39f5c521f403bb4162f133d4.jpg not downloaded yet
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a57f7e8fcec90e78f7857124d7aef318.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_06d4350e60c3d98ca177319662be3ffd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a7dfe7cd52d31ddea80331ad049a8d95.jpg not downloaded yet
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_c4f3de14e9db3a0e7cf3ca138a52769a.jpg not downloaded yet
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048155fd0>
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_b068a659c771027718a575662be0aa19.jpg saved to cache
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_5014ea203de6456c32334eef8f898f49.jpg not downloaded yet
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822e610>
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a57f7e8fcec90e78f7857124d7aef318.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872edd0>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_06d4350e60c3d98ca177319662be3ffd.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3167fbc6f77474e86e896f2fdb721880.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3c49623a39f5c521f403bb4162f133d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822ca10>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3167fbc6f77474e86e896f2fdb721880.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_5014ea203de6456c32334eef8f898f49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a448d0>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3c49623a39f5c521f403bb4162f133d4.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048807d90>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_5014ea203de6456c32334eef8f898f49.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_c4f3de14e9db3a0e7cf3ca138a52769a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a7dfe7cd52d31ddea80331ad049a8d95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3f50>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_c4f3de14e9db3a0e7cf3ca138a52769a.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481681d0>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a7dfe7cd52d31ddea80331ad049a8d95.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_ba4f08777008b5f74a8173dc0773f654.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_bd64a59b39993eb96103eb2272886c36.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048434fd0>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_ba4f08777008b5f74a8173dc0773f654.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048229f50>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_bd64a59b39993eb96103eb2272886c36.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX40830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_7364c5aecda2f6ef59a146b91d0f5299.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_9ed7a8c725a26616053a3a1446635715.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ca150>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_7364c5aecda2f6ef59a146b91d0f5299.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235010>
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_9ed7a8c725a26616053a3a1446635715.jpg saved to cache
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f6c591b-616f-5925-9082-2669995ddfb0
2026-04-27 07:58:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f6c591b-616f-5925-9082-2669995ddfb0, skipping ID generation
2026-04-27 07:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f6c591b-616f-5925-9082-2669995ddfb0 with scrape type 1
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f6c591b-616f-5925-9082-2669995ddfb0 sending to next pipeline
2026-04-27 07:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f6c591b-616f-5925-9082-2669995ddfb0, identifier: XY97125
2026-04-27 07:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f6c591b-616f-5925-9082-2669995ddfb0 with identifier: XY97125
2026-04-27 07:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f6c591b-616f-5925-9082-2669995ddfb0 with identifier: XY97125
2026-04-27 07:58:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f6c591b-616f-5925-9082-2669995ddfb0 with identifier: XY97125 to the API
2026-04-27 07:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_9ed7a8c725a26616053a3a1446635715.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:30:04Z',
'fuel_type': 'diesel',
'id': '3f6c591b-616f-5925-9082-2669995ddfb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY97125',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Ford',
'model': 'Kuga',
'odometer': 336810,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a57f7e8fcec90e78f7857124d7aef318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_7364c5aecda2f6ef59a146b91d0f5299.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_9ed7a8c725a26616053a3a1446635715.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_ba4f08777008b5f74a8173dc0773f654.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_bd64a59b39993eb96103eb2272886c36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3167fbc6f77474e86e896f2fdb721880.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_3c49623a39f5c521f403bb4162f133d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_a7dfe7cd52d31ddea80331ad049a8d95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_c4f3de14e9db3a0e7cf3ca138a52769a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f6c591b-616f-5925-9082-2669995ddfb0/3f6c591b-616f-5925-9082-2669995ddfb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dfed9c6445a289debbd5e6f8c2bbf/pa/XY97125_5014ea203de6456c32334eef8f898f49.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2013-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2013}
2026-04-27 07:58:40 [auto1.es] INFO: Saving data for XY97125: {'created_time': 1777276720.123487, 'last_price_update_time': 1777276720.1235, 'has_photos': True, 'auction_closing_time': 1777303804.0}
2026-04-27 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_258b29550eac977a1d1b1dca3ace2ee2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_233623dbbaba9daf9128f82525f66271.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_a538fcc805ee5a05334a547461204cd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482dfd10>
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_258b29550eac977a1d1b1dca3ace2ee2.jpg saved to cache
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a45a50>
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_233623dbbaba9daf9128f82525f66271.jpg saved to cache
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481632d0>
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_a538fcc805ee5a05334a547461204cd5.jpg saved to cache
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0fde173f7a1513bdc12952d87101f250.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0db377cab2b58ea11b1bbd7ba3135a97.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_171f72b8a71acf58793baa5918214389.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852c490>
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0fde173f7a1513bdc12952d87101f250.jpg saved to cache
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b9850>
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0db377cab2b58ea11b1bbd7ba3135a97.jpg saved to cache
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3fad0>
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_171f72b8a71acf58793baa5918214389.jpg saved to cache
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8
2026-04-27 07:58:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c70a918-5bfc-5405-acbe-1541fc0ccdc8, skipping ID generation
2026-04-27 07:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 with scrape type 1
2026-04-27 07:58:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 sending to next pipeline
2026-04-27 07:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c70a918-5bfc-5405-acbe-1541fc0ccdc8, identifier: WM31555
2026-04-27 07:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 with identifier: WM31555
2026-04-27 07:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 with identifier: WM31555
2026-04-27 07:58:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c70a918-5bfc-5405-acbe-1541fc0ccdc8 with identifier: WM31555 to the API
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_171f72b8a71acf58793baa5918214389.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 155,
'expiration_date': '2026-04-27T15:26:49Z',
'fuel_type': 'petrol',
'id': '7c70a918-5bfc-5405-acbe-1541fc0ccdc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM31555',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Ford',
'model': 'Puma',
'odometer': 79267,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_171f72b8a71acf58793baa5918214389.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0db377cab2b58ea11b1bbd7ba3135a97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_0fde173f7a1513bdc12952d87101f250.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_233623dbbaba9daf9128f82525f66271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_258b29550eac977a1d1b1dca3ace2ee2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_a538fcc805ee5a05334a547461204cd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_06d4350e60c3d98ca177319662be3ffd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_b068a659c771027718a575662be0aa19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_8aff021788b06249e50645c562a9cd18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c70a918-5bfc-5405-acbe-1541fc0ccdc8/7c70a918-5bfc-5405-acbe-1541fc0ccdc8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a7/42a78968206ba84351611478bf8dd51a/pa/WM31555_5284413feb6b967766d26eb12f7d4208.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2020-08-19',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2020}
2026-04-27 07:58:40 [auto1.es] INFO: Saving data for WM31555: {'created_time': 1777276720.982307, 'last_price_update_time': 1777276720.982322, 'has_photos': True, 'auction_closing_time': 1777303609.0}
2026-04-27 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_07ba8e764fd3fcafb93515fcb498cd2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_8ae930af7a7a1e5cafb814a1abf9df00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870d950>
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_07ba8e764fd3fcafb93515fcb498cd2c.jpg saved to cache
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048505690>
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_8ae930af7a7a1e5cafb814a1abf9df00.jpg saved to cache
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_094255ac3550ccfbd47240cdd95fea3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_a7da430bf55e6c6167bf47324054e655.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dc7225bd50bbf3aabfe5839244a32fab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA75818> (referer: https://www.auto1.com/v1/car-details-view/XA75818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822bf50>
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_094255ac3550ccfbd47240cdd95fea3e.jpg saved to cache
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877bd0>
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_a7da430bf55e6c6167bf47324054e655.jpg saved to cache
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822e610>
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dc7225bd50bbf3aabfe5839244a32fab.jpg saved to cache
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d35d725-6292-5046-a538-693fb8225d27
2026-04-27 07:58:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d35d725-6292-5046-a538-693fb8225d27, skipping ID generation
2026-04-27 07:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d35d725-6292-5046-a538-693fb8225d27 with scrape type 1
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d35d725-6292-5046-a538-693fb8225d27 sending to next pipeline
2026-04-27 07:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d35d725-6292-5046-a538-693fb8225d27, identifier: MB16167
2026-04-27 07:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d35d725-6292-5046-a538-693fb8225d27 with identifier: MB16167
2026-04-27 07:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d35d725-6292-5046-a538-693fb8225d27 with identifier: MB16167
2026-04-27 07:58:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d35d725-6292-5046-a538-693fb8225d27 with identifier: MB16167 to the API
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dc7225bd50bbf3aabfe5839244a32fab.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'city': 'Calaf',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:02:23Z',
'fuel_type': 'petrol',
'id': '9d35d725-6292-5046-a538-693fb8225d27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB16167',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Ford',
'model': 'EcoSport',
'odometer': 231859,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dc7225bd50bbf3aabfe5839244a32fab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_094255ac3550ccfbd47240cdd95fea3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_a7da430bf55e6c6167bf47324054e655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_8ae930af7a7a1e5cafb814a1abf9df00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_07ba8e764fd3fcafb93515fcb498cd2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_483807bec987579450793cf55ad95502.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e2554d1223cb89a9ce97bf38d8eb2cf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_dbedfddbfee41b3aa23e4962e1554823.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_e5f1f739bbabec69a783a72c3bb4f7ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d35d725-6292-5046-a538-693fb8225d27/9d35d725-6292-5046-a538-693fb8225d27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/e4/bfe408eb389efab64c83d2615c1f34e0/pa/MB16167_902874692b2c461848bdd33d9415c4b1.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2016-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-04-27 07:58:41 [auto1.es] INFO: Saving data for MB16167: {'created_time': 1777276721.845661, 'last_price_update_time': 1777276721.845672, 'has_photos': True, 'auction_closing_time': 1777302143.0}
2026-04-27 07:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 with identifier: XA75818
2026-04-27 07:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 with scrape type 1
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_610ae645a8126620c2e7a2724668c769.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e71413b88a29fd84cc34ba5b5953d7c.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c3f79dd3313117a17c04ba7f564a7bb7.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_fab8ff3050c0597b31aa5c4231a9ba44.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_69ccc6dd9382a469c6493b6349d6ef5e.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e5f66a4bfe24e229a5821902e523bb0.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_bdf8362c13069304b8e8ff883f0163ad.jpg not downloaded yet
2026-04-27 07:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_89c214af438c867fc12ab66c896fe672.jpg not downloaded yet
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_f42ae2093d04e37f609f69f15c821ac7.jpg not downloaded yet
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c9433ebbf1ffef43c96714c896e1f5a5.jpg not downloaded yet
2026-04-27 07:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC89526> (referer: https://www.auto1.com/v1/car-details-view/CC89526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526
2026-04-27 07:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38679723-8fd3-59e1-9e1a-0ece5488ce76 with scrape type 1
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_9fc70f22e2d0ba213de31c0dfef9d055.jpg not downloaded yet
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_155aab1483e4dfd18a0746c3f9bb7251.jpg not downloaded yet
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_e60003840df5f8a299fed256b2801630.jpg not downloaded yet
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_f13faf92d470f77f04b44e5feffa21ed.jpg not downloaded yet
2026-04-27 07:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE94628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_5505832d983029a9f52fc09c952fe679.jpg not downloaded yet
2026-04-27 07:58:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_6f99091e49c4ebbebd39b13c2304a85b.jpg not downloaded yet
2026-04-27 07:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW84322> (referer: https://www.auto1.com/v1/car-details-view/YW84322/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c9433ebbf1ffef43c96714c896e1f5a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 with identifier: YW84322
2026-04-27 07:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 with scrape type 1
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_181f34885155a9b2374fb4cca0e367ea.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_1c1404025e55638f681fa8d35f835d85.jpg not downloaded yet
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_f13faf92d470f77f04b44e5feffa21ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_459507421e2062130c4ff15f0a61d46d.jpg not downloaded yet
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_5505832d983029a9f52fc09c952fe679.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ba150>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c9433ebbf1ffef43c96714c896e1f5a5.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_33b7a9162a9e8a7ab6a6d423775e73fa.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_833fdab1fc7249c3647d7d2bbc8ce24e.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_d8c3a695670e858dc42248d6d6f10137.jpg not downloaded yet
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895dbd0>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_f13faf92d470f77f04b44e5feffa21ed.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_6f99091e49c4ebbebd39b13c2304a85b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a47b10>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_5505832d983029a9f52fc09c952fe679.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_1c1404025e55638f681fa8d35f835d85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048157050>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_6f99091e49c4ebbebd39b13c2304a85b.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837b650>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_1c1404025e55638f681fa8d35f835d85.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_181f34885155a9b2374fb4cca0e367ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_833fdab1fc7249c3647d7d2bbc8ce24e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_d8c3a695670e858dc42248d6d6f10137.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ef250>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_181f34885155a9b2374fb4cca0e367ea.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048156210>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_833fdab1fc7249c3647d7d2bbc8ce24e.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_459507421e2062130c4ff15f0a61d46d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_33b7a9162a9e8a7ab6a6d423775e73fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1b90>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_d8c3a695670e858dc42248d6d6f10137.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_e60003840df5f8a299fed256b2801630.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3fe50>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_459507421e2062130c4ff15f0a61d46d.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235f90>
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_33b7a9162a9e8a7ab6a6d423775e73fa.jpg saved to cache
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9
2026-04-27 07:58:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 056753c2-8b30-57b3-8aa9-5a4d67bad1e9, skipping ID generation
2026-04-27 07:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 with scrape type 1
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 sending to next pipeline
2026-04-27 07:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 056753c2-8b30-57b3-8aa9-5a4d67bad1e9, identifier: YW84322
2026-04-27 07:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 with identifier: YW84322
2026-04-27 07:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 with identifier: YW84322
2026-04-27 07:58:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 056753c2-8b30-57b3-8aa9-5a4d67bad1e9 with identifier: YW84322 to the API
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_33b7a9162a9e8a7ab6a6d423775e73fa.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 88,
'expiration_date': '2026-04-27T15:55:31Z',
'fuel_type': 'petrol',
'id': '056753c2-8b30-57b3-8aa9-5a4d67bad1e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW84322',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Citroen',
'model': 'Xsara',
'odometer': 83590,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_181f34885155a9b2374fb4cca0e367ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_1c1404025e55638f681fa8d35f835d85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_459507421e2062130c4ff15f0a61d46d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_33b7a9162a9e8a7ab6a6d423775e73fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_833fdab1fc7249c3647d7d2bbc8ce24e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_056753c2-8b30-57b3-8aa9-5a4d67bad1e9/056753c2-8b30-57b3-8aa9-5a4d67bad1e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/97/28973b2bb41cb4ae53630cf6b44bf1c4/pa/YW84322_d8c3a695670e858dc42248d6d6f10137.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2000-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Xsara 1.6 SX',
'transmission': 'manual',
'trim': 'SX',
'year': 2000}
2026-04-27 07:58:44 [auto1.es] INFO: Saving data for YW84322: {'created_time': 1777276724.404111, 'last_price_update_time': 1777276724.404123, 'has_photos': True, 'auction_closing_time': 1777305331.0}
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_9fc70f22e2d0ba213de31c0dfef9d055.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_155aab1483e4dfd18a0746c3f9bb7251.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7a6d0>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_e60003840df5f8a299fed256b2801630.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c8210>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_9fc70f22e2d0ba213de31c0dfef9d055.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_f42ae2093d04e37f609f69f15c821ac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d9810>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_155aab1483e4dfd18a0746c3f9bb7251.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38679723-8fd3-59e1-9e1a-0ece5488ce76
2026-04-27 07:58:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38679723-8fd3-59e1-9e1a-0ece5488ce76, skipping ID generation
2026-04-27 07:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38679723-8fd3-59e1-9e1a-0ece5488ce76 with scrape type 1
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38679723-8fd3-59e1-9e1a-0ece5488ce76 sending to next pipeline
2026-04-27 07:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38679723-8fd3-59e1-9e1a-0ece5488ce76, identifier: CC89526
2026-04-27 07:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526
2026-04-27 07:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526
2026-04-27 07:58:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526 to the API
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_155aab1483e4dfd18a0746c3f9bb7251.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:23:47Z',
'fuel_type': 'diesel',
'id': '38679723-8fd3-59e1-9e1a-0ece5488ce76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89526',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'BMW',
'model': '1er',
'odometer': 282016,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_9fc70f22e2d0ba213de31c0dfef9d055.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_155aab1483e4dfd18a0746c3f9bb7251.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_e60003840df5f8a299fed256b2801630.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_f13faf92d470f77f04b44e5feffa21ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_5505832d983029a9f52fc09c952fe679.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38679723-8fd3-59e1-9e1a-0ece5488ce76/38679723-8fd3-59e1-9e1a-0ece5488ce76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914e7c0636de9688c698727be55c97ec/pa/CC89526_6f99091e49c4ebbebd39b13c2304a85b.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2007-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 120d',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-04-27 07:58:45 [auto1.es] INFO: Saving data for CC89526: {'created_time': 1777276725.039215, 'last_price_update_time': 1777276725.039225, 'has_photos': True, 'auction_closing_time': 1777303427.0}
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_89c214af438c867fc12ab66c896fe672.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895d890>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_f42ae2093d04e37f609f69f15c821ac7.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3c890>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_89c214af438c867fc12ab66c896fe672.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_bdf8362c13069304b8e8ff883f0163ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e5f66a4bfe24e229a5821902e523bb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048836510>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_bdf8362c13069304b8e8ff883f0163ad.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS86207> (referer: https://www.auto1.com/v1/car-details-view/HS86207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_69ccc6dd9382a469c6493b6349d6ef5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895c490>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e5f66a4bfe24e229a5821902e523bb0.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e71413b88a29fd84cc34ba5b5953d7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 with identifier: HS86207
2026-04-27 07:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 with scrape type 1
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_9b9dff7b95967fc7bc2410cf85c75973.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_097b77fffdbb4ba4018b4b0d6e37aa42.jpg not downloaded yet
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_fab8ff3050c0597b31aa5c4231a9ba44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_33d884f5cbf82803c5401092dfc5faaf.jpg not downloaded yet
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872c850>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_69ccc6dd9382a469c6493b6349d6ef5e.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_727e9751495f98e04270a02d13527afe.jpg not downloaded yet
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_610ae645a8126620c2e7a2724668c769.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_a195c71b7d6bb5b0fcbf43e31d14c8fa.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_ef3f54ce39be61bd7cd47f134ce40b1b.jpg not downloaded yet
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fd990>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e71413b88a29fd84cc34ba5b5953d7c.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c3f79dd3313117a17c04ba7f564a7bb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885310>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_fab8ff3050c0597b31aa5c4231a9ba44.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a46f90>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_610ae645a8126620c2e7a2724668c769.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895dad0>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c3f79dd3313117a17c04ba7f564a7bb7.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097
2026-04-27 07:58:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c5236d4-b1ef-5c37-9c83-51b1da3b0097, skipping ID generation
2026-04-27 07:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 with scrape type 1
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 sending to next pipeline
2026-04-27 07:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c5236d4-b1ef-5c37-9c83-51b1da3b0097, identifier: XA75818
2026-04-27 07:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 with identifier: XA75818
2026-04-27 07:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 with identifier: XA75818
2026-04-27 07:58:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c5236d4-b1ef-5c37-9c83-51b1da3b0097 with identifier: XA75818 to the API
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c3f79dd3313117a17c04ba7f564a7bb7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'city': 'Alcala De Henares',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:01:20Z',
'fuel_type': 'diesel',
'id': '5c5236d4-b1ef-5c37-9c83-51b1da3b0097',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.482,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA75818',
'listing': 'auction',
'location': 'ES, Alcalá de Henares, Madrid',
'location_confidence': 'geocoded',
'longitude': -3.36,
'make': 'Fiat',
'model': 'Freemont',
'odometer': 221428,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_610ae645a8126620c2e7a2724668c769.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e71413b88a29fd84cc34ba5b5953d7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c3f79dd3313117a17c04ba7f564a7bb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_fab8ff3050c0597b31aa5c4231a9ba44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_69ccc6dd9382a469c6493b6349d6ef5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_5e5f66a4bfe24e229a5821902e523bb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_bdf8362c13069304b8e8ff883f0163ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_89c214af438c867fc12ab66c896fe672.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_f42ae2093d04e37f609f69f15c821ac7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c5236d4-b1ef-5c37-9c83-51b1da3b0097/5c5236d4-b1ef-5c37-9c83-51b1da3b0097_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/ae/84ae37abf80b30c981c92219c7b8f6d3/pa/XA75818_c9433ebbf1ffef43c96714c896e1f5a5.jpg',
'Width': 800}],
'postal_code': '28800',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2012-04-29',
'seats_number': 7,
'seller_name': None,
'title': 'Fiat Freemont 2.0 Multijet Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-04-27 07:58:46 [auto1.es] INFO: Saving data for XA75818: {'created_time': 1777276726.621584, 'last_price_update_time': 1777276726.621598, 'has_photos': True, 'auction_closing_time': 1777302080.0}
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_097b77fffdbb4ba4018b4b0d6e37aa42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_727e9751495f98e04270a02d13527afe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_ef3f54ce39be61bd7cd47f134ce40b1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX39314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_9b9dff7b95967fc7bc2410cf85c75973.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484fa490>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_097b77fffdbb4ba4018b4b0d6e37aa42.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852c890>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_727e9751495f98e04270a02d13527afe.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822fb10>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_ef3f54ce39be61bd7cd47f134ce40b1b.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_33d884f5cbf82803c5401092dfc5faaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_a195c71b7d6bb5b0fcbf43e31d14c8fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0710>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_9b9dff7b95967fc7bc2410cf85c75973.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3d290>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_33d884f5cbf82803c5401092dfc5faaf.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870c110>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_a195c71b7d6bb5b0fcbf43e31d14c8fa.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8
2026-04-27 07:58:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8, skipping ID generation
2026-04-27 07:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 with scrape type 1
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 sending to next pipeline
2026-04-27 07:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8, identifier: HS86207
2026-04-27 07:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 with identifier: HS86207
2026-04-27 07:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 with identifier: HS86207
2026-04-27 07:58:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8 with identifier: HS86207 to the API
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_a195c71b7d6bb5b0fcbf43e31d14c8fa.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Pedrola',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 2',
'engine': '2.0L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:56:47Z',
'fuel_type': 'diesel',
'id': '0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS86207',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Nissan',
'model': 'Primera',
'odometer': 335709,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_9b9dff7b95967fc7bc2410cf85c75973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_097b77fffdbb4ba4018b4b0d6e37aa42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_33d884f5cbf82803c5401092dfc5faaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_727e9751495f98e04270a02d13527afe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_a195c71b7d6bb5b0fcbf43e31d14c8fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8/0629a6fb-1c0a-5c11-a367-9a8ed9f53ba8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/df/a4dfe24d8f8dc0c26d22df10a3010270/pa/HS86207_ef3f54ce39be61bd7cd47f134ce40b1b.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '1997-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Primera 2.0 Turbodiesel Stilo',
'transmission': 'manual',
'trim': 'Stilo',
'year': 1997}
2026-04-27 07:58:47 [auto1.es] INFO: Saving data for HS86207: {'created_time': 1777276727.499352, 'last_price_update_time': 1777276727.499364, 'has_photos': True, 'auction_closing_time': 1777305407.0}
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a39250>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048580e50>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX40830> (referer: https://www.auto1.com/v1/car-details-view/AX40830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ad3cbb-b95f-53b5-95de-73049fb9ee7e with identifier: AX40830
2026-04-27 07:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e with scrape type 1
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_26ad93ff9449f7440eb20f5d4700c66f.jpg not downloaded yet
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_37c62df4ce9b50440c9925461855822a.jpg not downloaded yet
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_480b38bf1ed3f0df344d619d024f2f14.jpg not downloaded yet
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_aca93ea4076c3bc21031bb11c38ba397.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_77b7a2b3df538edac6dba5d5f1f11b78.jpg not downloaded yet
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a791d0>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_9fc5b1171be288a20afcd5df7749bce0.jpg not downloaded yet
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_a94646d4d66a0cd968810b5b90f41681.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_8523afc2762d1d3bd7266e239ab61f3b.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_488079cabb989b196b499b36df384945.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_42cd66b565d6ba26525b90c3ecaab217.jpg not downloaded yet
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482dcc10>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_9fc5b1171be288a20afcd5df7749bce0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048378cd0>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_9fc5b1171be288a20afcd5df7749bce0.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_42cd66b565d6ba26525b90c3ecaab217.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK75942> (referer: https://www.auto1.com/v1/car-details-view/HK75942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a47090>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_42cd66b565d6ba26525b90c3ecaab217.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5503f0a-3a1e-5ec5-994b-6d792e0efc53 with identifier: HK75942
2026-04-27 07:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53 with scrape type 1
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8b329b7c006f36202871bc97b46f842c.jpg not downloaded yet
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_488079cabb989b196b499b36df384945.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8d3ffd22d6df2bfd5310a2cffaa7bfb4.jpg not downloaded yet
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN12908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_e32cb85927cbfcb7c92708953d4902d9.jpg not downloaded yet
2026-04-27 07:58:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_60048fa0b0be472dc367bfcb86882dda.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_182a20f5d6ef4ad749957e57e3120096.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_dfb7e730201dca171b97b6d596437595.jpg not downloaded yet
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048803b10>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_488079cabb989b196b499b36df384945.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8b329b7c006f36202871bc97b46f842c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_8523afc2762d1d3bd7266e239ab61f3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048160710>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8b329b7c006f36202871bc97b46f842c.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ec390>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_8523afc2762d1d3bd7266e239ab61f3b.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8d3ffd22d6df2bfd5310a2cffaa7bfb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY38423> (referer: https://www.auto1.com/v1/car-details-view/AY38423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_182a20f5d6ef4ad749957e57e3120096.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_dfb7e730201dca171b97b6d596437595.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a381d0>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8d3ffd22d6df2bfd5310a2cffaa7bfb4.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7256eab-2277-5594-986c-2edcd53a21ea with identifier: AY38423
2026-04-27 07:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7256eab-2277-5594-986c-2edcd53a21ea with scrape type 1
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_eb463bda95b347d9d02a430cb666b8e9.jpg not downloaded yet
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_e32cb85927cbfcb7c92708953d4902d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_26317c44e53ee118d93830b2ba009f35.jpg not downloaded yet
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04815c090>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_182a20f5d6ef4ad749957e57e3120096.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837cc10>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_dfb7e730201dca171b97b6d596437595.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_60048fa0b0be472dc367bfcb86882dda.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_a94646d4d66a0cd968810b5b90f41681.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ab086cd3d663138580e12f3a34e94965.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_00a7f57294f032790ddc82c205d69ccb.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_c3c7e42f4f58f25486f4f389aab52631.jpg not downloaded yet
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931ed0>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_e32cb85927cbfcb7c92708953d4902d9.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ecc074e20ff891effd0591c303ec5f56.jpg not downloaded yet
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_eb463bda95b347d9d02a430cb666b8e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_b81dd357de6b91eebf1a7365bd3ae0ed.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_bc1c230e4e90bc9aae9e88191c9cbf15.jpg not downloaded yet
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048803510>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_60048fa0b0be472dc367bfcb86882dda.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53
2026-04-27 07:58:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5503f0a-3a1e-5ec5-994b-6d792e0efc53, skipping ID generation
2026-04-27 07:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53 with scrape type 1
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5503f0a-3a1e-5ec5-994b-6d792e0efc53 sending to next pipeline
2026-04-27 07:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5503f0a-3a1e-5ec5-994b-6d792e0efc53, identifier: HK75942
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04868b850>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_a94646d4d66a0cd968810b5b90f41681.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5503f0a-3a1e-5ec5-994b-6d792e0efc53 with identifier: HK75942
2026-04-27 07:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5503f0a-3a1e-5ec5-994b-6d792e0efc53 with identifier: HK75942
2026-04-27 07:58:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5503f0a-3a1e-5ec5-994b-6d792e0efc53 with identifier: HK75942 to the API
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_60048fa0b0be472dc367bfcb86882dda.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Granyanella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO N\\/A',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:40:20Z',
'fuel_type': 'diesel',
'id': 'f5503f0a-3a1e-5ec5-994b-6d792e0efc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK75942',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Toyota',
'model': 'Corolla',
'odometer': 292474,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8b329b7c006f36202871bc97b46f842c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_8d3ffd22d6df2bfd5310a2cffaa7bfb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_e32cb85927cbfcb7c92708953d4902d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_60048fa0b0be472dc367bfcb86882dda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_182a20f5d6ef4ad749957e57e3120096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5503f0a-3a1e-5ec5-994b-6d792e0efc53/f5503f0a-3a1e-5ec5-994b-6d792e0efc53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e20440076a17550f50a6cdd8e09c45a/pa/HK75942_dfb7e730201dca171b97b6d596437595.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2006-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Corolla 1.4 D-4D Compact Luna',
'transmission': 'manual',
'trim': 'Compact Luna',
'year': 2006}
2026-04-27 07:58:51 [auto1.es] INFO: Saving data for HK75942: {'created_time': 1777276731.343614, 'last_price_update_time': 1777276731.343627, 'has_photos': True, 'auction_closing_time': 1777304420.0}
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_179f96385229a3b96f575c4e7f2df8af.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_77b7a2b3df538edac6dba5d5f1f11b78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_26317c44e53ee118d93830b2ba009f35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_c3c7e42f4f58f25486f4f389aab52631.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE94628> (referer: https://www.auto1.com/v1/car-details-view/JE94628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_0af15fe64d6ad83ffc2a5ee64124ad66.jpg not downloaded yet
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW56668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL60553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877250>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_eb463bda95b347d9d02a430cb666b8e9.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB53463> (referer: https://www.auto1.com/v1/car-details-view/XB53463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048229b10>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_77b7a2b3df538edac6dba5d5f1f11b78.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3a290>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_26317c44e53ee118d93830b2ba009f35.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048874150>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_c3c7e42f4f58f25486f4f389aab52631.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628
2026-04-27 07:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with scrape type 1
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_c9e62a30682a768d5ecdcb1e656e9b38.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_e7230a5a15060cad1b35bad4927576b7.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6451aea-a85d-5c3c-853d-7236bb60cb49 with identifier: XB53463
2026-04-27 07:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6451aea-a85d-5c3c-853d-7236bb60cb49 with scrape type 1
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9b23436433041d7ee04274f08b310a69.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d1933a1fbb538b4286e16cf591431cab.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9081ff57173c04f2c773e27d4e250a69.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ecc074e20ff891effd0591c303ec5f56.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_bd4d164410072d22928279f077918c64.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_bc1c230e4e90bc9aae9e88191c9cbf15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_b81dd357de6b91eebf1a7365bd3ae0ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_1453e1c12f9e005cd40fe400de4a52e3.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d8a4a6423815686d746009bcbef1a94b.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_30aab61a4d72a38f170af8101be38709.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_be0c79495372b330cafbbfd4158d37d0.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f3f81c77d383adfd8dab326b377ba27.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_df7ff3610513fcca518ad498c620fc2d.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9081ff57173c04f2c773e27d4e250a69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_00a7f57294f032790ddc82c205d69ccb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9b23436433041d7ee04274f08b310a69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_6ae013f744a4d7c82cdda4f16f57d832.jpg not downloaded yet
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0480ea850>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ecc074e20ff891effd0591c303ec5f56.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484f9590>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_bc1c230e4e90bc9aae9e88191c9cbf15.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048236590>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_b81dd357de6b91eebf1a7365bd3ae0ed.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ab086cd3d663138580e12f3a34e94965.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_131ce91a3ae2281162728ced4ed072cc.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_0af15fe64d6ad83ffc2a5ee64124ad66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f3f81c77d383adfd8dab326b377ba27.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_179f96385229a3b96f575c4e7f2df8af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d1933a1fbb538b4286e16cf591431cab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_330b549673139987e95d2873e57b0702.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484f88d0>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9081ff57173c04f2c773e27d4e250a69.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048932010>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_00a7f57294f032790ddc82c205d69ccb.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486db210>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9b23436433041d7ee04274f08b310a69.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f6768a4aeaa3f8aadb3ee4267a43649.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_df7ff3610513fcca518ad498c620fc2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_30aab61a4d72a38f170af8101be38709.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931f90>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ab086cd3d663138580e12f3a34e94965.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048743c10>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_0af15fe64d6ad83ffc2a5ee64124ad66.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885ee50>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f3f81c77d383adfd8dab326b377ba27.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768550>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_179f96385229a3b96f575c4e7f2df8af.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7256eab-2277-5594-986c-2edcd53a21ea
2026-04-27 07:58:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7256eab-2277-5594-986c-2edcd53a21ea, skipping ID generation
2026-04-27 07:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7256eab-2277-5594-986c-2edcd53a21ea with scrape type 1
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7256eab-2277-5594-986c-2edcd53a21ea sending to next pipeline
2026-04-27 07:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7256eab-2277-5594-986c-2edcd53a21ea, identifier: AY38423
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dc410>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d1933a1fbb538b4286e16cf591431cab.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7256eab-2277-5594-986c-2edcd53a21ea with identifier: AY38423
2026-04-27 07:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7256eab-2277-5594-986c-2edcd53a21ea with identifier: AY38423
2026-04-27 07:58:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7256eab-2277-5594-986c-2edcd53a21ea with identifier: AY38423 to the API
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_179f96385229a3b96f575c4e7f2df8af.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Barcelona',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:04:21Z',
'fuel_type': 'petrol',
'id': 'a7256eab-2277-5594-986c-2edcd53a21ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY38423',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 110349,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_eb463bda95b347d9d02a430cb666b8e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_26317c44e53ee118d93830b2ba009f35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ab086cd3d663138580e12f3a34e94965.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_00a7f57294f032790ddc82c205d69ccb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_c3c7e42f4f58f25486f4f389aab52631.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_ecc074e20ff891effd0591c303ec5f56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_b81dd357de6b91eebf1a7365bd3ae0ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_bc1c230e4e90bc9aae9e88191c9cbf15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_179f96385229a3b96f575c4e7f2df8af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7256eab-2277-5594-986c-2edcd53a21ea/a7256eab-2277-5594-986c-2edcd53a21ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/3a/513a58630c0a3f6bf298b7f456a7f98a/pa/AY38423_0af15fe64d6ad83ffc2a5ee64124ad66.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2011-05-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2011}
2026-04-27 07:58:52 [auto1.es] INFO: Saving data for AY38423: {'created_time': 1777276732.901539, 'last_price_update_time': 1777276732.901551, 'has_photos': True, 'auction_closing_time': 1777302261.0}
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_be0c79495372b330cafbbfd4158d37d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_1453e1c12f9e005cd40fe400de4a52e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_6ae013f744a4d7c82cdda4f16f57d832.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_330b549673139987e95d2873e57b0702.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_131ce91a3ae2281162728ced4ed072cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d8a4a6423815686d746009bcbef1a94b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY33661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX39314> (referer: https://www.auto1.com/v1/car-details-view/NX39314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f6768a4aeaa3f8aadb3ee4267a43649.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882a210>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_df7ff3610513fcca518ad498c620fc2d.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483788d0>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_30aab61a4d72a38f170af8101be38709.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff05721bc50>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_be0c79495372b330cafbbfd4158d37d0.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485e7790>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_1453e1c12f9e005cd40fe400de4a52e3.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04839a9d0>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_6ae013f744a4d7c82cdda4f16f57d832.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049713210>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_330b549673139987e95d2873e57b0702.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04839aa90>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_131ce91a3ae2281162728ced4ed072cc.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048574fd0>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d8a4a6423815686d746009bcbef1a94b.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbece23-2622-5dff-b2b9-6b1ede3e472f with identifier: NX39314
2026-04-27 07:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbece23-2622-5dff-b2b9-6b1ede3e472f with scrape type 1
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_a1b7e0d0fe3ca9bd57ba7bba856b939e.jpg not downloaded yet
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048398850>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f6768a4aeaa3f8aadb3ee4267a43649.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6451aea-a85d-5c3c-853d-7236bb60cb49
2026-04-27 07:58:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6451aea-a85d-5c3c-853d-7236bb60cb49, skipping ID generation
2026-04-27 07:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6451aea-a85d-5c3c-853d-7236bb60cb49 with scrape type 1
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6451aea-a85d-5c3c-853d-7236bb60cb49 sending to next pipeline
2026-04-27 07:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6451aea-a85d-5c3c-853d-7236bb60cb49, identifier: XB53463
2026-04-27 07:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6451aea-a85d-5c3c-853d-7236bb60cb49 with identifier: XB53463
2026-04-27 07:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6451aea-a85d-5c3c-853d-7236bb60cb49 with identifier: XB53463
2026-04-27 07:58:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6451aea-a85d-5c3c-853d-7236bb60cb49 with identifier: XB53463 to the API
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f6768a4aeaa3f8aadb3ee4267a43649.jpg>
{'auction_title': '',
'c_o_2_emission_value': 230,
'category': None,
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.7L',
'engine_horse_power': 205,
'expiration_date': '2026-04-27T15:55:53Z',
'fuel_type': 'diesel',
'id': 'b6451aea-a85d-5c3c-853d-7236bb60cb49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB53463',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C6',
'odometer': 310476,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9b23436433041d7ee04274f08b310a69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_9081ff57173c04f2c773e27d4e250a69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_1453e1c12f9e005cd40fe400de4a52e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_30aab61a4d72a38f170af8101be38709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f3f81c77d383adfd8dab326b377ba27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_df7ff3610513fcca518ad498c620fc2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_6ae013f744a4d7c82cdda4f16f57d832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_131ce91a3ae2281162728ced4ed072cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_330b549673139987e95d2873e57b0702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6451aea-a85d-5c3c-853d-7236bb60cb49/b6451aea-a85d-5c3c-853d-7236bb60cb49_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/c6/f9c606b044a8783c4c41150e9f49d751/pa/XB53463_8f6768a4aeaa3f8aadb3ee4267a43649.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C6 2.7 V6 HDi BiTurbo Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2008}
2026-04-27 07:58:53 [auto1.es] INFO: Saving data for XB53463: {'created_time': 1777276733.812586, 'last_price_update_time': 1777276733.812596, 'has_photos': True, 'auction_closing_time': 1777305353.0}
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_aca93ea4076c3bc21031bb11c38ba397.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_1de8aacfa8a97ad357a5b2637e717c22.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_26ad93ff9449f7440eb20f5d4700c66f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_c9e62a30682a768d5ecdcb1e656e9b38.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_e7230a5a15060cad1b35bad4927576b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_bd4d164410072d22928279f077918c64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_37c62df4ce9b50440c9925461855822a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_480b38bf1ed3f0df344d619d024f2f14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_e1cd1721cf71a79df64702dac190f43c.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_9cfd089fb158377a769549c046bb7100.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_c5911a33765b21a014e64c850c0f4e04.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0d6b3d50275bbf4f616484ec6f5993bf.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_bcf75a1bcd98aa89d413516d9d399710.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_8c7107bedbbf1d349fb71cb654c74db5.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_3eb19e3d5881f54f6484a15d562a03ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR77549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a2bd0>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_aca93ea4076c3bc21031bb11c38ba397.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_a1b7e0d0fe3ca9bd57ba7bba856b939e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_7c83786aabba1c41ff5340db1a22b145.jpg not downloaded yet
2026-04-27 07:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837c190>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_26ad93ff9449f7440eb20f5d4700c66f.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04815b350>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_c9e62a30682a768d5ecdcb1e656e9b38.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048972ed0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_e7230a5a15060cad1b35bad4927576b7.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b2890>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_bd4d164410072d22928279f077918c64.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b, skipping ID generation
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b sending to next pipeline
2026-04-27 07:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b, identifier: JE94628
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c5290>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_37c62df4ce9b50440c9925461855822a.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869ea90>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_480b38bf1ed3f0df344d619d024f2f14.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74ad3cbb-b95f-53b5-95de-73049fb9ee7e, skipping ID generation
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74ad3cbb-b95f-53b5-95de-73049fb9ee7e sending to next pipeline
2026-04-27 07:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 74ad3cbb-b95f-53b5-95de-73049fb9ee7e, identifier: AX40830
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0feec4dd65612f61f49df4739fff93a4.jpg not downloaded yet
2026-04-27 07:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628
2026-04-27 07:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628
2026-04-27 07:58:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628 to the API
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_bd4d164410072d22928279f077918c64.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Colloto, Oviedo',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:10:59Z',
'fuel_type': 'diesel',
'id': '3c5fcab1-65b3-5c9d-8390-f6b44aca290b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE94628',
'listing': 'auction',
'location': 'ES, Colloto, Oviedo',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Corolla',
'odometer': 522091,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_c9e62a30682a768d5ecdcb1e656e9b38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_e7230a5a15060cad1b35bad4927576b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d1933a1fbb538b4286e16cf591431cab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_bd4d164410072d22928279f077918c64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_d8a4a6423815686d746009bcbef1a94b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c5fcab1-65b3-5c9d-8390-f6b44aca290b/3c5fcab1-65b3-5c9d-8390-f6b44aca290b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/d8/fbd8518c83c1f90c235ca58f46dca565/pa/JE94628_be0c79495372b330cafbbfd4158d37d0.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2003-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Corolla 2.0 D-4D Compact Sol',
'transmission': 'manual',
'trim': 'Compact Sol',
'year': 2003}
2026-04-27 07:58:55 [auto1.es] INFO: Saving data for JE94628: {'created_time': 1777276735.133281, 'last_price_update_time': 1777276735.133294, 'has_photos': True, 'auction_closing_time': 1777302659.0}
2026-04-27 07:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 74ad3cbb-b95f-53b5-95de-73049fb9ee7e with identifier: AX40830
2026-04-27 07:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 74ad3cbb-b95f-53b5-95de-73049fb9ee7e with identifier: AX40830
2026-04-27 07:58:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 74ad3cbb-b95f-53b5-95de-73049fb9ee7e with identifier: AX40830 to the API
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_480b38bf1ed3f0df344d619d024f2f14.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'city': 'Araia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-27T15:59:27Z',
'fuel_type': 'diesel',
'id': '74ad3cbb-b95f-53b5-95de-73049fb9ee7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX40830',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Audi',
'model': 'Q5',
'odometer': 116594,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_26ad93ff9449f7440eb20f5d4700c66f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_37c62df4ce9b50440c9925461855822a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_480b38bf1ed3f0df344d619d024f2f14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_aca93ea4076c3bc21031bb11c38ba397.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_77b7a2b3df538edac6dba5d5f1f11b78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_9fc5b1171be288a20afcd5df7749bce0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_a94646d4d66a0cd968810b5b90f41681.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_8523afc2762d1d3bd7266e239ab61f3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_488079cabb989b196b499b36df384945.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74ad3cbb-b95f-53b5-95de-73049fb9ee7e/74ad3cbb-b95f-53b5-95de-73049fb9ee7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/8a/a38a214e300469c69953dc9e38302ea1/pa/AX40830_42cd66b565d6ba26525b90c3ecaab217.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2016-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 3.0 V6 TDI quattro Advanced edition',
'transmission': 'automatic',
'trim': 'quattro Advanced edition',
'year': 2016}
2026-04-27 07:58:55 [auto1.es] INFO: Saving data for AX40830: {'created_time': 1777276735.459084, 'last_price_update_time': 1777276735.459096, 'has_photos': True, 'auction_closing_time': 1777305567.0}
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0d6b3d50275bbf4f616484ec6f5993bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_bcf75a1bcd98aa89d413516d9d399710.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN12908> (referer: https://www.auto1.com/v1/car-details-view/EN12908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048612710>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a87d890>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_3eb19e3d5881f54f6484a15d562a03ff.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486dbe50>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_a1b7e0d0fe3ca9bd57ba7bba856b939e.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048613590>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8
2026-04-27 07:58:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd4dedf2-a8c3-567e-adcc-278005b6f0c8, skipping ID generation
2026-04-27 07:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with scrape type 1
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd4dedf2-a8c3-567e-adcc-278005b6f0c8 sending to next pipeline
2026-04-27 07:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd4dedf2-a8c3-567e-adcc-278005b6f0c8, identifier: ZK75464
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_c5911a33765b21a014e64c850c0f4e04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_8c7107bedbbf1d349fb71cb654c74db5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_9cfd089fb158377a769549c046bb7100.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464
2026-04-27 07:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464
2026-04-27 07:58:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd4dedf2-a8c3-567e-adcc-278005b6f0c8 with identifier: ZK75464 to the API
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-04-28T15:07:03Z',
'fuel_type': 'diesel',
'id': 'fd4dedf2-a8c3-567e-adcc-278005b6f0c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK75464',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 232450,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_0876669f53a6eec950ca192459d0dfd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_02bc96f4c92ee2d9d5b07e6feeaa360d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_3eff75adeddf3f91614e9f0661ead3c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_d0d8cd8cd3fadaf066fa465029f70048.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_c820d74a84816507cd15b5a6720e3eab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_2de7c6c2b7af324d50ace660864035cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_68d3c82a81d7a88a4153dba36dcb52b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_6516848d0d855532e05003c3e764c300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_345033f2cd48f470218c6dcdab582f67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd4dedf2-a8c3-567e-adcc-278005b6f0c8/fd4dedf2-a8c3-567e-adcc-278005b6f0c8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/77/7477bd47cb8743da7de53b0e3b1b624c/pa/ZK75464_30ecf96cfd46e371f64264677a82a28d.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2012-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI 4Matic BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency Avantgarde',
'year': 2012}
2026-04-27 07:58:56 [auto1.es] INFO: Saving data for ZK75464: {'created_time': 1777276736.173757, 'last_price_update_time': 1777276736.173768, 'has_photos': True, 'auction_closing_time': 1777388823.0}
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL60553> (referer: https://www.auto1.com/v1/car-details-view/XL60553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048523cd0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0d6b3d50275bbf4f616484ec6f5993bf.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048610050>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_bcf75a1bcd98aa89d413516d9d399710.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e970613-97d1-5123-90ef-1f1dbdd9862a with identifier: EN12908
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e970613-97d1-5123-90ef-1f1dbdd9862a with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_fc3438d12135bc1c277f6eb0eb292d17.jpg not downloaded yet
2026-04-27 07:58:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_18b85f8b88122f38953c14ed4b9d2a86.jpg not downloaded yet
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e3d90>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_c5911a33765b21a014e64c850c0f4e04.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f0610>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_8c7107bedbbf1d349fb71cb654c74db5.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f17d0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_9cfd089fb158377a769549c046bb7100.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0feec4dd65612f61f49df4739fff93a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_edf5ea48c788547af3b6a8c7c63afda8.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_1de8aacfa8a97ad357a5b2637e717c22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_9835e0683931e3de7a71d0e17c9c7bc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_e1cd1721cf71a79df64702dac190f43c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_7c83786aabba1c41ff5340db1a22b145.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_278a93dc422a1d7211028f19f9d165f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 611d7504-4bed-52f6-b3be-6d9c1a03a282 with identifier: XL60553
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 611d7504-4bed-52f6-b3be-6d9c1a03a282 with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_e478313d9145292c357a1f47cc15b584.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_361a1cf445a65d434e4b55262e051b10.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_47174f8a2f8a97d27b38db11bbe0e530.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_fc3438d12135bc1c277f6eb0eb292d17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_c1930bde53cd81edfea44289cab69c6b.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_8aa3374da75a0bb6d98676333592ab4c.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_88c603348276396a940e30161c63b788.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_3ba1cc015fdec3558e41dd9bb235915c.jpg not downloaded yet
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048164d10>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0feec4dd65612f61f49df4739fff93a4.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_6a7ae88692f82136664eb557d287fb5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_60d0124d860c621fd3108121311d5d84.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5c1e0956e151c7e81da88cb82706eda2.jpg not downloaded yet
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488561d0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_1de8aacfa8a97ad357a5b2637e717c22.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3ae10>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_9835e0683931e3de7a71d0e17c9c7bc3.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04883d1d0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_e1cd1721cf71a79df64702dac190f43c.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fdd0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_7c83786aabba1c41ff5340db1a22b145.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecbece23-2622-5dff-b2b9-6b1ede3e472f
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecbece23-2622-5dff-b2b9-6b1ede3e472f, skipping ID generation
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbece23-2622-5dff-b2b9-6b1ede3e472f with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecbece23-2622-5dff-b2b9-6b1ede3e472f sending to next pipeline
2026-04-27 07:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecbece23-2622-5dff-b2b9-6b1ede3e472f, identifier: NX39314
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6fd0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_278a93dc422a1d7211028f19f9d165f3.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_e5e7789652d15a968b27fe2e55ea74c9.jpg not downloaded yet
2026-04-27 07:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecbece23-2622-5dff-b2b9-6b1ede3e472f with identifier: NX39314
2026-04-27 07:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecbece23-2622-5dff-b2b9-6b1ede3e472f with identifier: NX39314
2026-04-27 07:58:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecbece23-2622-5dff-b2b9-6b1ede3e472f with identifier: NX39314 to the API
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_7c83786aabba1c41ff5340db1a22b145.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Valencia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:05:15Z',
'fuel_type': 'diesel',
'id': 'ecbece23-2622-5dff-b2b9-6b1ede3e472f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 39.4698,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX39314',
'listing': 'auction',
'location': 'Xirivella, Valencia.',
'location_confidence': 'geocoded',
'longitude': -0.3774,
'make': 'Ford',
'model': 'S-Max',
'odometer': 141907,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_a1b7e0d0fe3ca9bd57ba7bba856b939e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_1de8aacfa8a97ad357a5b2637e717c22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_e1cd1721cf71a79df64702dac190f43c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_9cfd089fb158377a769549c046bb7100.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_c5911a33765b21a014e64c850c0f4e04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0d6b3d50275bbf4f616484ec6f5993bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_bcf75a1bcd98aa89d413516d9d399710.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_8c7107bedbbf1d349fb71cb654c74db5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_7c83786aabba1c41ff5340db1a22b145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbece23-2622-5dff-b2b9-6b1ede3e472f/ecbece23-2622-5dff-b2b9-6b1ede3e472f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/6c/5e6c42fbb6497d3ecba4dfef46b7d19f/pa/NX39314_0feec4dd65612f61f49df4739fff93a4.jpg',
'Width': 800}],
'postal_code': '46001',
'price': 0,
'price_includes_vat': True,
'province': 'Valencia',
'province_code': 'ES-V',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2015-08-09',
'seats_number': 7,
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-04-27 07:58:57 [auto1.es] INFO: Saving data for NX39314: {'created_time': 1777276737.456267, 'last_price_update_time': 1777276737.456282, 'has_photos': True, 'auction_closing_time': 1777302315.0}
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_361a1cf445a65d434e4b55262e051b10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5a0ac6a4e0d69461b52bcf7c0ccd2703.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_5c9c8925a90d53753ab47a4522562f86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_18b85f8b88122f38953c14ed4b9d2a86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_a82961d4d3f482ee947ef58ceec06d6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_bd012e98b420d21cc5fe0f6075dec834.jpg not downloaded yet
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048591ed0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_fc3438d12135bc1c277f6eb0eb292d17.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048887790>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_6a7ae88692f82136664eb557d287fb5f.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_10eb844236d81867edd46efcc9c464d6.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY33661> (referer: https://www.auto1.com/v1/car-details-view/FY33661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_da7fabbe4ff0e29834a29643a2c73f0f.jpg not downloaded yet
2026-04-27 07:58:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_007d217e77080d8478a18402f19a5e39.jpg not downloaded yet
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048715610>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_361a1cf445a65d434e4b55262e051b10.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_3ba1cc015fdec3558e41dd9bb235915c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_88c603348276396a940e30161c63b788.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_ce82ba5834a15b129a403e677f23f42c.jpg not downloaded yet
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482dd710>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_5c9c8925a90d53753ab47a4522562f86.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f98444a-0c41-5996-8c43-6e1931bc28dc
2026-04-27 07:58:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f98444a-0c41-5996-8c43-6e1931bc28dc, skipping ID generation
2026-04-27 07:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f98444a-0c41-5996-8c43-6e1931bc28dc with scrape type 1
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f98444a-0c41-5996-8c43-6e1931bc28dc sending to next pipeline
2026-04-27 07:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f98444a-0c41-5996-8c43-6e1931bc28dc, identifier: LB05133
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e1a50>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_18b85f8b88122f38953c14ed4b9d2a86.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820a5d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_a82961d4d3f482ee947ef58ceec06d6b.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2c22632-c72a-51a4-9494-bdc63e96499e
2026-04-27 07:58:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2c22632-c72a-51a4-9494-bdc63e96499e, skipping ID generation
2026-04-27 07:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c22632-c72a-51a4-9494-bdc63e96499e with scrape type 1
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2c22632-c72a-51a4-9494-bdc63e96499e sending to next pipeline
2026-04-27 07:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2c22632-c72a-51a4-9494-bdc63e96499e, identifier: BR91881
2026-04-27 07:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f98444a-0c41-5996-8c43-6e1931bc28dc with identifier: LB05133
2026-04-27 07:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f98444a-0c41-5996-8c43-6e1931bc28dc with identifier: LB05133
2026-04-27 07:58:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f98444a-0c41-5996-8c43-6e1931bc28dc with identifier: LB05133 to the API
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_5c9c8925a90d53753ab47a4522562f86.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'city': 'Caldes De Malavella',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:40:35Z',
'fuel_type': 'diesel',
'id': '5f98444a-0c41-5996-8c43-6e1931bc28dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7743,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB05133',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'location_confidence': 'geocoded',
'longitude': 2.6451,
'make': 'BMW',
'model': 'X3',
'odometer': 93046,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_d9b8cbf18ddfec98dec79d2b3a019b69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4eb213226e4cdbeecdc8d38888f09145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1b7b04a5148d36e86357928eb06836f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_267ac3807a351dc2d851812c3f71ca22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_8edf218e297367ba1cc9af70d0577312.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_ad3caafb30a9b42303a05c9e6ae4f3ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_c1d5edd8d2ec264474edf57420b0bedb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_5c9c8925a90d53753ab47a4522562f86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_4028d1a2a47cc02b918f698de006c1a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5f98444a-0c41-5996-8c43-6e1931bc28dc/5f98444a-0c41-5996-8c43-6e1931bc28dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/67/5467f2bd4b20211dd14b4c3aad3950af/pa/LB05133_9835e0683931e3de7a71d0e17c9c7bc3.jpg',
'Width': 800}],
'postal_code': '17455',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2013-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 sDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-04-27 07:58:58 [auto1.es] INFO: Saving data for LB05133: {'created_time': 1777276738.406308, 'last_price_update_time': 1777276738.406322, 'has_photos': True, 'auction_closing_time': 1777390835.0}
2026-04-27 07:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2c22632-c72a-51a4-9494-bdc63e96499e with identifier: BR91881
2026-04-27 07:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2c22632-c72a-51a4-9494-bdc63e96499e with identifier: BR91881
2026-04-27 07:58:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2c22632-c72a-51a4-9494-bdc63e96499e with identifier: BR91881 to the API
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_a82961d4d3f482ee947ef58ceec06d6b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Calaf',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:27:48Z',
'fuel_type': 'diesel',
'id': 'd2c22632-c72a-51a4-9494-bdc63e96499e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR91881',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Volvo',
'model': 'XC60',
'odometer': 107175,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_567ccad6bd98ca98c743772347d36c3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_d80e1888bf745258b1592fb9f59859e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_fae88e7f958a20604d14d8f2c23daefb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_f6473bd87fd7bed38f3593725c96663b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_c3216ae9b4aee39d51fc2810e7d7a031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_9842453aebf6d2dff1ef1d1b52cea51c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_4fef61f510d6e574a153cb0c2df9f113.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_a82961d4d3f482ee947ef58ceec06d6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_8dcb33a100b88cc98e6dc8c41d751359.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2c22632-c72a-51a4-9494-bdc63e96499e/d2c22632-c72a-51a4-9494-bdc63e96499e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0a/a50a006317699c3e8fa279c7b6637de4/pa/BR91881_3eb19e3d5881f54f6484a15d562a03ff.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2019}
2026-04-27 07:58:58 [auto1.es] INFO: Saving data for BR91881: {'created_time': 1777276738.779723, 'last_price_update_time': 1777276738.779734, 'has_photos': True, 'auction_closing_time': 1777303668.0}
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_60d0124d860c621fd3108121311d5d84.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_2dddb12dca1c85405a652bdeefe022e3.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_e5e7789652d15a968b27fe2e55ea74c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5c1e0956e151c7e81da88cb82706eda2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_bd012e98b420d21cc5fe0f6075dec834.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS45242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 with identifier: FY33661
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_31a3776ee85d15b62e1aa1900ba632c3.jpg not downloaded yet
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048100990>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_3ba1cc015fdec3558e41dd9bb235915c.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894ead0>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_88c603348276396a940e30161c63b788.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_9790b63f25960a718f4ce6c7594942cb.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_007d217e77080d8478a18402f19a5e39.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a3b90>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_60d0124d860c621fd3108121311d5d84.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cce50>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_e5e7789652d15a968b27fe2e55ea74c9.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a66d0>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5c1e0956e151c7e81da88cb82706eda2.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048731190>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_bd012e98b420d21cc5fe0f6075dec834.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_da7fabbe4ff0e29834a29643a2c73f0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_13d0dda903466a5f469d0ae9b196b2d4.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_ce82ba5834a15b129a403e677f23f42c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_2dddb12dca1c85405a652bdeefe022e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_10eb844236d81867edd46efcc9c464d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5a0ac6a4e0d69461b52bcf7c0ccd2703.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_6d161c8e3f3d5e0c423fe057adc4ec0c.jpg not downloaded yet
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c9b90>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_007d217e77080d8478a18402f19a5e39.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_e21beb6d41c278817c0ed5d7302ded34.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW56668> (referer: https://www.auto1.com/v1/car-details-view/SW56668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_8aa3374da75a0bb6d98676333592ab4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_31a3776ee85d15b62e1aa1900ba632c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_9790b63f25960a718f4ce6c7594942cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_47cd17f2fa6f5086a5ee501629defdf3.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_56beed32b61434c3e5377ceef98c1d2d.jpg not downloaded yet
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048398f90>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_da7fabbe4ff0e29834a29643a2c73f0f.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_c1930bde53cd81edfea44289cab69c6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_6d161c8e3f3d5e0c423fe057adc4ec0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_2b33feb92a6d56c7005244bb761483d0.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_13d0dda903466a5f469d0ae9b196b2d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_47174f8a2f8a97d27b38db11bbe0e530.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_e21beb6d41c278817c0ed5d7302ded34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_e478313d9145292c357a1f47cc15b584.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048519b50>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_ce82ba5834a15b129a403e677f23f42c.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048208fd0>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_2dddb12dca1c85405a652bdeefe022e3.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cda90>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_10eb844236d81867edd46efcc9c464d6.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048802810>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5a0ac6a4e0d69461b52bcf7c0ccd2703.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_07ccf3d0cc7164c7c96086599b969ce2.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_edf5ea48c788547af3b6a8c7c63afda8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_b5563bad92560ab035507de26094cdf5.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668
2026-04-27 07:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d423d3aa-89cc-5ab3-b884-a2c71de5086d with scrape type 1
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_c99d370b08b3df2b6098a03ea09f6b08.jpg not downloaded yet
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048829e10>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_8aa3374da75a0bb6d98676333592ab4c.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d5190>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_31a3776ee85d15b62e1aa1900ba632c3.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048518bd0>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_9790b63f25960a718f4ce6c7594942cb.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04839aad0>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_c1930bde53cd81edfea44289cab69c6b.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048581890>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_6d161c8e3f3d5e0c423fe057adc4ec0c.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0190>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_13d0dda903466a5f469d0ae9b196b2d4.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822e410>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_47174f8a2f8a97d27b38db11bbe0e530.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a4310>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_e21beb6d41c278817c0ed5d7302ded34.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04883f250>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_e478313d9145292c357a1f47cc15b584.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 611d7504-4bed-52f6-b3be-6d9c1a03a282
2026-04-27 07:59:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 611d7504-4bed-52f6-b3be-6d9c1a03a282, skipping ID generation
2026-04-27 07:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 611d7504-4bed-52f6-b3be-6d9c1a03a282 with scrape type 1
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 611d7504-4bed-52f6-b3be-6d9c1a03a282 sending to next pipeline
2026-04-27 07:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 611d7504-4bed-52f6-b3be-6d9c1a03a282, identifier: XL60553
2026-04-27 07:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 611d7504-4bed-52f6-b3be-6d9c1a03a282 with identifier: XL60553
2026-04-27 07:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 611d7504-4bed-52f6-b3be-6d9c1a03a282 with identifier: XL60553
2026-04-27 07:59:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 611d7504-4bed-52f6-b3be-6d9c1a03a282 with identifier: XL60553 to the API
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_e478313d9145292c357a1f47cc15b584.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'city': 'Araia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:49:28Z',
'fuel_type': 'diesel',
'id': '611d7504-4bed-52f6-b3be-6d9c1a03a282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL60553',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Audi',
'model': 'Q5',
'odometer': 146712,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_e478313d9145292c357a1f47cc15b584.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_47174f8a2f8a97d27b38db11bbe0e530.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_8aa3374da75a0bb6d98676333592ab4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_3ba1cc015fdec3558e41dd9bb235915c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5c1e0956e151c7e81da88cb82706eda2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_5a0ac6a4e0d69461b52bcf7c0ccd2703.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_10eb844236d81867edd46efcc9c464d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_007d217e77080d8478a18402f19a5e39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_ce82ba5834a15b129a403e677f23f42c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_611d7504-4bed-52f6-b3be-6d9c1a03a282/611d7504-4bed-52f6-b3be-6d9c1a03a282_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f0/39f03f53f0843aad7845779c396532eb/pa/XL60553_2dddb12dca1c85405a652bdeefe022e3.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2015-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Advanced edition',
'transmission': 'automatic',
'trim': 'quattro Advanced edition',
'year': 2015}
2026-04-27 07:59:00 [auto1.es] INFO: Saving data for XL60553: {'created_time': 1777276740.884832, 'last_price_update_time': 1777276740.884842, 'has_photos': True, 'auction_closing_time': 1777304968.0}
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_56beed32b61434c3e5377ceef98c1d2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_41613997e91bd95b544f9a6ef54e6cb4.jpg not downloaded yet
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_47cd17f2fa6f5086a5ee501629defdf3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB27489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR77549> (referer: https://www.auto1.com/v1/car-details-view/UR77549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851f950>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_edf5ea48c788547af3b6a8c7c63afda8.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e970613-97d1-5123-90ef-1f1dbdd9862a
2026-04-27 07:59:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e970613-97d1-5123-90ef-1f1dbdd9862a, skipping ID generation
2026-04-27 07:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e970613-97d1-5123-90ef-1f1dbdd9862a with scrape type 1
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e970613-97d1-5123-90ef-1f1dbdd9862a sending to next pipeline
2026-04-27 07:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e970613-97d1-5123-90ef-1f1dbdd9862a, identifier: EN12908
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_888cd58048d53dbd88d2fc616b69b167.jpg not downloaded yet
2026-04-27 07:59:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e970613-97d1-5123-90ef-1f1dbdd9862a with identifier: EN12908
2026-04-27 07:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e970613-97d1-5123-90ef-1f1dbdd9862a with identifier: EN12908
2026-04-27 07:59:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e970613-97d1-5123-90ef-1f1dbdd9862a with identifier: EN12908 to the API
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_edf5ea48c788547af3b6a8c7c63afda8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Esquivias',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:16:16Z',
'fuel_type': 'diesel',
'id': '0e970613-97d1-5123-90ef-1f1dbdd9862a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN12908',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Seat',
'model': 'Leon',
'odometer': 155367,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_fc3438d12135bc1c277f6eb0eb292d17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_18b85f8b88122f38953c14ed4b9d2a86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_edf5ea48c788547af3b6a8c7c63afda8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_361a1cf445a65d434e4b55262e051b10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_c1930bde53cd81edfea44289cab69c6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_88c603348276396a940e30161c63b788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_60d0124d860c621fd3108121311d5d84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_e5e7789652d15a968b27fe2e55ea74c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_bd012e98b420d21cc5fe0f6075dec834.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0e970613-97d1-5123-90ef-1f1dbdd9862a/0e970613-97d1-5123-90ef-1f1dbdd9862a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/da/95dad81761c33743cc014d59cd91c1c5/pa/EN12908_da7fabbe4ff0e29834a29643a2c73f0f.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2014-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2014}
2026-04-27 07:59:01 [auto1.es] INFO: Saving data for EN12908: {'created_time': 1777276741.551591, 'last_price_update_time': 1777276741.551607, 'has_photos': True, 'auction_closing_time': 1777302976.0}
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_07ccf3d0cc7164c7c96086599b969ce2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880f690>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_56beed32b61434c3e5377ceef98c1d2d.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_06766de805079f0343a64a82d3ba58e2.jpg not downloaded yet
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e8110>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_47cd17f2fa6f5086a5ee501629defdf3.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c847bd28-e04e-5316-91da-6e0ee2c14c17 with identifier: UR77549
2026-04-27 07:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c847bd28-e04e-5316-91da-6e0ee2c14c17 with scrape type 1
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_50c13edac5c80818bfa1ebe9f06d06c7.jpg not downloaded yet
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_2b33feb92a6d56c7005244bb761483d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_b5563bad92560ab035507de26094cdf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_98fd613de24f85a38cab6b04b1a80100.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_6ef26dd432beb9061cca27659950fe73.jpg not downloaded yet
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_c99d370b08b3df2b6098a03ea09f6b08.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_7d55dad75c926f5df1b12fe354fbe943.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e45c85a0e78cdc44878662a43f952279.jpg not downloaded yet
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486561d0>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_07ccf3d0cc7164c7c96086599b969ce2.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_41613997e91bd95b544f9a6ef54e6cb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_2e94c121e5b2242791713d9704936483.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e21d4cfca239ae98a66ccd06e45c10f2.jpg not downloaded yet
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_50c13edac5c80818bfa1ebe9f06d06c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d41d0>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_2b33feb92a6d56c7005244bb761483d0.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c6910>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_b5563bad92560ab035507de26094cdf5.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80
2026-04-27 07:59:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3c2435e-c3d3-53d8-96cf-cf8c628b4b80, skipping ID generation
2026-04-27 07:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 with scrape type 1
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 sending to next pipeline
2026-04-27 07:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3c2435e-c3d3-53d8-96cf-cf8c628b4b80, identifier: FY33661
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_06766de805079f0343a64a82d3ba58e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_227475ae5fe28faeeafa5bed9ba262ab.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_b6b9de47c6fc189a7dfd9c75c6739771.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 with identifier: FY33661
2026-04-27 07:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 with identifier: FY33661
2026-04-27 07:59:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3c2435e-c3d3-53d8-96cf-cf8c628b4b80 with identifier: FY33661 to the API
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_b5563bad92560ab035507de26094cdf5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Granyanella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:56:08Z',
'fuel_type': 'diesel',
'id': 'b3c2435e-c3d3-53d8-96cf-cf8c628b4b80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY33661',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 152211,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_31a3776ee85d15b62e1aa1900ba632c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_9790b63f25960a718f4ce6c7594942cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_13d0dda903466a5f469d0ae9b196b2d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_6d161c8e3f3d5e0c423fe057adc4ec0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_e21beb6d41c278817c0ed5d7302ded34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_47cd17f2fa6f5086a5ee501629defdf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_56beed32b61434c3e5377ceef98c1d2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_2b33feb92a6d56c7005244bb761483d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_07ccf3d0cc7164c7c96086599b969ce2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3c2435e-c3d3-53d8-96cf-cf8c628b4b80/b3c2435e-c3d3-53d8-96cf-cf8c628b4b80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/0b/540b7e29eecfd962039b181249430f79/pa/FY33661_b5563bad92560ab035507de26094cdf5.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2017-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2017}
2026-04-27 07:59:02 [auto1.es] INFO: Saving data for FY33661: {'created_time': 1777276742.437353, 'last_price_update_time': 1777276742.437362, 'has_photos': True, 'auction_closing_time': 1777305368.0}
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9f90>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_c99d370b08b3df2b6098a03ea09f6b08.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d2cd871e3016c1a0db0cbdda7762d9d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_6ef26dd432beb9061cca27659950fe73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_a878dd1dbaf00d9d4c7d1730230e9fcc.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_5127e96d8fa8e6c4842f675fd840102b.jpg not downloaded yet
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB03508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848fd50>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_41613997e91bd95b544f9a6ef54e6cb4.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04816a690>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_50c13edac5c80818bfa1ebe9f06d06c7.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836de50>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_06766de805079f0343a64a82d3ba58e2.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e45c85a0e78cdc44878662a43f952279.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_6366bfe4b8a2cb2f06a0d5ea9b8155e0.jpg not downloaded yet
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e21d4cfca239ae98a66ccd06e45c10f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048970790>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d2cd871e3016c1a0db0cbdda7762d9d4.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0480ebb90>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_6ef26dd432beb9061cca27659950fe73.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_2e94c121e5b2242791713d9704936483.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836ba90>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e45c85a0e78cdc44878662a43f952279.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_227475ae5fe28faeeafa5bed9ba262ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS45242> (referer: https://www.auto1.com/v1/car-details-view/RS45242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3c090>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e21d4cfca239ae98a66ccd06e45c10f2.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_5127e96d8fa8e6c4842f675fd840102b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_6366bfe4b8a2cb2f06a0d5ea9b8155e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0480eae50>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_2e94c121e5b2242791713d9704936483.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_98fd613de24f85a38cab6b04b1a80100.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_888cd58048d53dbd88d2fc616b69b167.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485efa90>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_227475ae5fe28faeeafa5bed9ba262ab.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_7d55dad75c926f5df1b12fe354fbe943.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 777b8aa3-1a32-5811-aecb-2f1e82ec3523 with identifier: RS45242
2026-04-27 07:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523 with scrape type 1
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_ee6111d9ac87d89cf7616154988a2d0a.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_752d27ac39de08757d6b49251b209690.jpg not downloaded yet
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_a878dd1dbaf00d9d4c7d1730230e9fcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_17bffb01dc4afbcfe8f9af3f5e9bf240.jpg not downloaded yet
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489b0450>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_5127e96d8fa8e6c4842f675fd840102b.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ed350>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_6366bfe4b8a2cb2f06a0d5ea9b8155e0.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_b6b9de47c6fc189a7dfd9c75c6739771.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5cc72581a67fffb81bb9998b4fcc7a11.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5103503f6488e1f85d4877d268e8e6a9.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a5d390>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_98fd613de24f85a38cab6b04b1a80100.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f8b90>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_888cd58048d53dbd88d2fc616b69b167.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bd210>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_7d55dad75c926f5df1b12fe354fbe943.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_26a6f62a6fb3f4432b954ec784df6ee2.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824310>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_a878dd1dbaf00d9d4c7d1730230e9fcc.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d423d3aa-89cc-5ab3-b884-a2c71de5086d
2026-04-27 07:59:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d423d3aa-89cc-5ab3-b884-a2c71de5086d, skipping ID generation
2026-04-27 07:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d423d3aa-89cc-5ab3-b884-a2c71de5086d with scrape type 1
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d423d3aa-89cc-5ab3-b884-a2c71de5086d sending to next pipeline
2026-04-27 07:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d423d3aa-89cc-5ab3-b884-a2c71de5086d, identifier: SW56668
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_754cf82e859c826be19e7a7173638b67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668
2026-04-27 07:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668
2026-04-27 07:59:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668 to the API
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_a878dd1dbaf00d9d4c7d1730230e9fcc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Sevilla',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:28:51Z',
'fuel_type': 'diesel',
'id': 'd423d3aa-89cc-5ab3-b884-a2c71de5086d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW56668',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Citroen',
'model': 'C4',
'odometer': 35505,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_c99d370b08b3df2b6098a03ea09f6b08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_41613997e91bd95b544f9a6ef54e6cb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_888cd58048d53dbd88d2fc616b69b167.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_06766de805079f0343a64a82d3ba58e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_98fd613de24f85a38cab6b04b1a80100.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_7d55dad75c926f5df1b12fe354fbe943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_2e94c121e5b2242791713d9704936483.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_227475ae5fe28faeeafa5bed9ba262ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_a878dd1dbaf00d9d4c7d1730230e9fcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d423d3aa-89cc-5ab3-b884-a2c71de5086d/d423d3aa-89cc-5ab3-b884-a2c71de5086d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/38/c63824e9c6b8d6f9b1034eb4f0b96bf9/pa/SW56668_6366bfe4b8a2cb2f06a0d5ea9b8155e0.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2012-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2012}
2026-04-27 07:59:03 [auto1.es] INFO: Saving data for SW56668: {'created_time': 1777276743.871685, 'last_price_update_time': 1777276743.871695, 'has_photos': True, 'auction_closing_time': 1777303731.0}
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_17bffb01dc4afbcfe8f9af3f5e9bf240.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_c9e5e1bd82d87813dd3a0ca12e49a31f.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663750>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_b6b9de47c6fc189a7dfd9c75c6739771.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c847bd28-e04e-5316-91da-6e0ee2c14c17
2026-04-27 07:59:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c847bd28-e04e-5316-91da-6e0ee2c14c17, skipping ID generation
2026-04-27 07:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c847bd28-e04e-5316-91da-6e0ee2c14c17 with scrape type 1
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c847bd28-e04e-5316-91da-6e0ee2c14c17 sending to next pipeline
2026-04-27 07:59:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c847bd28-e04e-5316-91da-6e0ee2c14c17, identifier: UR77549
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_752d27ac39de08757d6b49251b209690.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c847bd28-e04e-5316-91da-6e0ee2c14c17 with identifier: UR77549
2026-04-27 07:59:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c847bd28-e04e-5316-91da-6e0ee2c14c17 with identifier: UR77549
2026-04-27 07:59:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c847bd28-e04e-5316-91da-6e0ee2c14c17 with identifier: UR77549 to the API
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_b6b9de47c6fc189a7dfd9c75c6739771.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': 'Rental',
'city': 'La Roda De Andalucia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:15:08Z',
'fuel_type': 'diesel',
'id': 'c847bd28-e04e-5316-91da-6e0ee2c14c17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR77549',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Volvo',
'model': 'V40',
'odometer': 372156,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_50c13edac5c80818bfa1ebe9f06d06c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_6ef26dd432beb9061cca27659950fe73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e45c85a0e78cdc44878662a43f952279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_e21d4cfca239ae98a66ccd06e45c10f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_b6b9de47c6fc189a7dfd9c75c6739771.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c847bd28-e04e-5316-91da-6e0ee2c14c17/c847bd28-e04e-5316-91da-6e0ee2c14c17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/1d/4c1d4ee600d251a945b87bf3dd19577d/pa/UR77549_5127e96d8fa8e6c4842f675fd840102b.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2013-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 1.6 D2 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2013}
2026-04-27 07:59:04 [auto1.es] INFO: Saving data for UR77549: {'created_time': 1777276744.357103, 'last_price_update_time': 1777276744.357115, 'has_photos': True, 'auction_closing_time': 1777302908.0}
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_d3df4559e93b5ffa6c11de59dd35797d.jpg not downloaded yet
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX18680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481dae50>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_754cf82e859c826be19e7a7173638b67.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV86151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836cdd0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_17bffb01dc4afbcfe8f9af3f5e9bf240.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5103503f6488e1f85d4877d268e8e6a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_2e16d3bf75bcfecd247a026fb84d61a8.jpg not downloaded yet
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895c050>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_752d27ac39de08757d6b49251b209690.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_048139166387af5adb1edd3596958cc6.jpg not downloaded yet
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e1650>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5103503f6488e1f85d4877d268e8e6a9.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5cc72581a67fffb81bb9998b4fcc7a11.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_d3df4559e93b5ffa6c11de59dd35797d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_ee6111d9ac87d89cf7616154988a2d0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_26a6f62a6fb3f4432b954ec784df6ee2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869d890>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5cc72581a67fffb81bb9998b4fcc7a11.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_c9e5e1bd82d87813dd3a0ca12e49a31f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d4750>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_d3df4559e93b5ffa6c11de59dd35797d.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_2e16d3bf75bcfecd247a026fb84d61a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483649d0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_ee6111d9ac87d89cf7616154988a2d0a.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d5010>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_26a6f62a6fb3f4432b954ec784df6ee2.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_048139166387af5adb1edd3596958cc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_9fc8511dff1e710cf08e40d456f1483b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895d2d0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_c9e5e1bd82d87813dd3a0ca12e49a31f.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895c950>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_2e16d3bf75bcfecd247a026fb84d61a8.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04851ee90>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_048139166387af5adb1edd3596958cc6.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523
2026-04-27 07:59:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 777b8aa3-1a32-5811-aecb-2f1e82ec3523, skipping ID generation
2026-04-27 07:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523 with scrape type 1
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 777b8aa3-1a32-5811-aecb-2f1e82ec3523 sending to next pipeline
2026-04-27 07:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 777b8aa3-1a32-5811-aecb-2f1e82ec3523, identifier: RS45242
2026-04-27 07:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 777b8aa3-1a32-5811-aecb-2f1e82ec3523 with identifier: RS45242
2026-04-27 07:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 777b8aa3-1a32-5811-aecb-2f1e82ec3523 with identifier: RS45242
2026-04-27 07:59:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 777b8aa3-1a32-5811-aecb-2f1e82ec3523 with identifier: RS45242 to the API
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_048139166387af5adb1edd3596958cc6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Madrid',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:13:42Z',
'fuel_type': 'diesel',
'id': '777b8aa3-1a32-5811-aecb-2f1e82ec3523',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS45242',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 92694,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_ee6111d9ac87d89cf7616154988a2d0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_752d27ac39de08757d6b49251b209690.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_17bffb01dc4afbcfe8f9af3f5e9bf240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5cc72581a67fffb81bb9998b4fcc7a11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_5103503f6488e1f85d4877d268e8e6a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_26a6f62a6fb3f4432b954ec784df6ee2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_c9e5e1bd82d87813dd3a0ca12e49a31f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_d3df4559e93b5ffa6c11de59dd35797d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_2e16d3bf75bcfecd247a026fb84d61a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_777b8aa3-1a32-5811-aecb-2f1e82ec3523/777b8aa3-1a32-5811-aecb-2f1e82ec3523_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/b1/95b162a171de357ed0a59c6ec0bd2085/pa/RS45242_048139166387af5adb1edd3596958cc6.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2011-05-05',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2011}
2026-04-27 07:59:05 [auto1.es] INFO: Saving data for RS45242: {'created_time': 1777276745.596322, 'last_price_update_time': 1777276745.596332, 'has_photos': True, 'auction_closing_time': 1777302822.0}
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_e2ab8682e43710b34c363b5e3483e06d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_c4838fa7218c0e735b1be49017494781.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX82700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048503590>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_9fc8511dff1e710cf08e40d456f1483b.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_550a76856e4f95ef0766cfc398bb7189.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048362490>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_e2ab8682e43710b34c363b5e3483e06d.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836d010>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_c4838fa7218c0e735b1be49017494781.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836db90>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_550a76856e4f95ef0766cfc398bb7189.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4
2026-04-27 07:59:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a66d90c9-7806-5bd3-ad34-2f73b33bfcf4, skipping ID generation
2026-04-27 07:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 with scrape type 1
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 sending to next pipeline
2026-04-27 07:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a66d90c9-7806-5bd3-ad34-2f73b33bfcf4, identifier: WT06803
2026-04-27 07:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 with identifier: WT06803
2026-04-27 07:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 with identifier: WT06803
2026-04-27 07:59:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a66d90c9-7806-5bd3-ad34-2f73b33bfcf4 with identifier: WT06803 to the API
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_550a76856e4f95ef0766cfc398bb7189.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'city': 'Madrid',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2026-04-28T15:47:45Z',
'fuel_type': 'diesel',
'id': 'a66d90c9-7806-5bd3-ad34-2f73b33bfcf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06803',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Peugeot',
'model': '5008',
'odometer': 210215,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_550a76856e4f95ef0766cfc398bb7189.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_e2ab8682e43710b34c363b5e3483e06d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_30e0a887872c5474f7cb75ac7148546d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_03c489c2face48cb95201d2b118a3a12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_7f89811b7ceae37e4fccd560096584ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_80e828a996449172ac256edd5829b419.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_fdb95f7e55b7de60f5d5d5ff8dd86ba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_6a7ae88692f82136664eb557d287fb5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_85227ced9ea3f5b3e0b316baffc1a134.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a66d90c9-7806-5bd3-ad34-2f73b33bfcf4/a66d90c9-7806-5bd3-ad34-2f73b33bfcf4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/74/2b74940fbcd329071e54031a3dfc9d00/pa/WT06803_278a93dc422a1d7211028f19f9d165f3.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2021-12-29',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2026-04-27 07:59:06 [auto1.es] INFO: Saving data for WT06803: {'created_time': 1777276746.480221, 'last_price_update_time': 1777276746.480233, 'has_photos': True, 'auction_closing_time': 1777391265.0}
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7f90f8bf390f46bacced8ea98304fa96.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488eda10>
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7f90f8bf390f46bacced8ea98304fa96.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB03508> (referer: https://www.auto1.com/v1/car-details-view/AB03508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_e593a8a29f1c6af4d4a8b2c2419b523b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3830ae5-b575-557d-9777-3bad9af24d12 with identifier: AB03508
2026-04-27 07:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3830ae5-b575-557d-9777-3bad9af24d12 with scrape type 1
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_51615672a6d4057607db0bffcb3352b9.jpg not downloaded yet
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_55b09dc04f4c69ad27da25e0c4371914.jpg not downloaded yet
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e79aadf269799c2db0a0bb23428bee7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d81e9d68aa0cb1f484fe3313bcf5e324.jpg not downloaded yet
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_10c609c11c5f5b1135bf47f5dcbac911.jpg not downloaded yet
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d62712fcd7d2204a29daac6445f065ac.jpg not downloaded yet
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_b9e3fd6eec42b5a07c2c95dd2fa0d36d.jpg not downloaded yet
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048366390>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_e593a8a29f1c6af4d4a8b2c2419b523b.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_968e5861cb07be156a4088dc89e34182.jpg not downloaded yet
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_55b09dc04f4c69ad27da25e0c4371914.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_711137ac57dae58bf75b545dda24d01f.jpg not downloaded yet
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834fc50>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e79aadf269799c2db0a0bb23428bee7c.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_ecdd8bb7b9d7f9f7dbce731d4342dcd8.jpg not downloaded yet
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_2f476d52043275b35b4f492b4ef886a3.jpg not downloaded yet
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235790>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_55b09dc04f4c69ad27da25e0c4371914.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_968e5861cb07be156a4088dc89e34182.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_2f476d52043275b35b4f492b4ef886a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048234bd0>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_968e5861cb07be156a4088dc89e34182.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_ecdd8bb7b9d7f9f7dbce731d4342dcd8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048342490>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_2f476d52043275b35b4f492b4ef886a3.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_711137ac57dae58bf75b545dda24d01f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048783f90>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_ecdd8bb7b9d7f9f7dbce731d4342dcd8.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE32472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836d550>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_711137ac57dae58bf75b545dda24d01f.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_b9e3fd6eec42b5a07c2c95dd2fa0d36d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d62712fcd7d2204a29daac6445f065ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c7810>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_b9e3fd6eec42b5a07c2c95dd2fa0d36d.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_10c609c11c5f5b1135bf47f5dcbac911.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e2e50>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d62712fcd7d2204a29daac6445f065ac.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048503350>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_10c609c11c5f5b1135bf47f5dcbac911.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d81e9d68aa0cb1f484fe3313bcf5e324.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU70286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_51615672a6d4057607db0bffcb3352b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04816a010>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d81e9d68aa0cb1f484fe3313bcf5e324.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d53d0>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_51615672a6d4057607db0bffcb3352b9.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3830ae5-b575-557d-9777-3bad9af24d12
2026-04-27 07:59:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3830ae5-b575-557d-9777-3bad9af24d12, skipping ID generation
2026-04-27 07:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3830ae5-b575-557d-9777-3bad9af24d12 with scrape type 1
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3830ae5-b575-557d-9777-3bad9af24d12 sending to next pipeline
2026-04-27 07:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3830ae5-b575-557d-9777-3bad9af24d12, identifier: AB03508
2026-04-27 07:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3830ae5-b575-557d-9777-3bad9af24d12 with identifier: AB03508
2026-04-27 07:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3830ae5-b575-557d-9777-3bad9af24d12 with identifier: AB03508
2026-04-27 07:59:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3830ae5-b575-557d-9777-3bad9af24d12 with identifier: AB03508 to the API
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_51615672a6d4057607db0bffcb3352b9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': 'Rental',
'city': 'Pedrola',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:48:58Z',
'fuel_type': 'diesel',
'id': 'f3830ae5-b575-557d-9777-3bad9af24d12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB03508',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 273946,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_51615672a6d4057607db0bffcb3352b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_55b09dc04f4c69ad27da25e0c4371914.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d81e9d68aa0cb1f484fe3313bcf5e324.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_10c609c11c5f5b1135bf47f5dcbac911.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_d62712fcd7d2204a29daac6445f065ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_b9e3fd6eec42b5a07c2c95dd2fa0d36d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_968e5861cb07be156a4088dc89e34182.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_711137ac57dae58bf75b545dda24d01f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_ecdd8bb7b9d7f9f7dbce731d4342dcd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3830ae5-b575-557d-9777-3bad9af24d12/f3830ae5-b575-557d-9777-3bad9af24d12_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/24/c024e5514b1ad1be7a898d55624406a1/pa/AB03508_2f476d52043275b35b4f492b4ef886a3.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2010-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-04-27 07:59:09 [auto1.es] INFO: Saving data for AB03508: {'created_time': 1777276749.422728, 'last_price_update_time': 1777276749.42274, 'has_photos': True, 'auction_closing_time': 1777304938.0}
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8895d32ed5a1e794be4a44b86b4a9767.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_6f09b4b5e35eafb04788b88e738933df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ75829> (referer: https://www.auto1.com/v1/car-details-view/JJ75829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e3810>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8895d32ed5a1e794be4a44b86b4a9767.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048975f90>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_6f09b4b5e35eafb04788b88e738933df.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_149df617713fcc6d43042df8337f0772.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829
2026-04-27 07:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with scrape type 1
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_7504c8589e2a85b9065c2e4b6f78d9ff.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ba1ac05b5eb268965f4f44efd37d12e4.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_492dcdd0aec6e3a909015f47a9335d85.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_54066b097597e7f394b81ccc83d10d5c.jpg not downloaded yet
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_a8efc15c50fcf103e2cb1c138cb8612f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_f9c8c6813195bbfc4a97f135d12c4275.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ee83cf3b7e438fc1b6b933fdbee0e015.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_14bc08b1fa965471cb8b923f57eca0b4.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_954c11e7eee93bbd769727fb9414525c.jpg not downloaded yet
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a54b10>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_149df617713fcc6d43042df8337f0772.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ebb8b769181ca1a8659a982f8248cbc1.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_8b443fb38469c22576da59fd0b20cafc.jpg not downloaded yet
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_54066b097597e7f394b81ccc83d10d5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_492dcdd0aec6e3a909015f47a9335d85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_1d8cf311bc58c6f0c367d574cf6f0590.jpg not downloaded yet
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048436190>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_a8efc15c50fcf103e2cb1c138cb8612f.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ee8d0>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_f9c8c6813195bbfc4a97f135d12c4275.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057026f50>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_54066b097597e7f394b81ccc83d10d5c.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483673d0>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_492dcdd0aec6e3a909015f47a9335d85.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ebb8b769181ca1a8659a982f8248cbc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_1d8cf311bc58c6f0c367d574cf6f0590.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048418810>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ebb8b769181ca1a8659a982f8248cbc1.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_954c11e7eee93bbd769727fb9414525c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3f5d0>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_1d8cf311bc58c6f0c367d574cf6f0590.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_8b443fb38469c22576da59fd0b20cafc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869c3d0>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_954c11e7eee93bbd769727fb9414525c.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ee83cf3b7e438fc1b6b933fdbee0e015.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_14bc08b1fa965471cb8b923f57eca0b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3c6d0>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_8b443fb38469c22576da59fd0b20cafc.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ba1ac05b5eb268965f4f44efd37d12e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_7504c8589e2a85b9065c2e4b6f78d9ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869c390>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ee83cf3b7e438fc1b6b933fdbee0e015.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_2d78b5a6b37f28cbecdbcf272e647219.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048575990>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_14bc08b1fa965471cb8b923f57eca0b4.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836c0d0>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ba1ac05b5eb268965f4f44efd37d12e4.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837dc10>
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_7504c8589e2a85b9065c2e4b6f78d9ff.jpg saved to cache
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc
2026-04-27 07:59:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc, skipping ID generation
2026-04-27 07:59:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with scrape type 1
2026-04-27 07:59:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc sending to next pipeline
2026-04-27 07:59:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc, identifier: JJ75829
2026-04-27 07:59:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829
2026-04-27 07:59:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829
2026-04-27 07:59:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829 to the API
2026-04-27 07:59:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_7504c8589e2a85b9065c2e4b6f78d9ff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 193,
'category': None,
'city': 'Sevilla',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-27T15:06:07Z',
'fuel_type': 'diesel',
'id': '7039613d-ecd3-578a-b8fa-2fdbd4c56ebc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ75829',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 405740,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_7504c8589e2a85b9065c2e4b6f78d9ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ba1ac05b5eb268965f4f44efd37d12e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_492dcdd0aec6e3a909015f47a9335d85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_54066b097597e7f394b81ccc83d10d5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ee83cf3b7e438fc1b6b933fdbee0e015.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_14bc08b1fa965471cb8b923f57eca0b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_954c11e7eee93bbd769727fb9414525c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_ebb8b769181ca1a8659a982f8248cbc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_8b443fb38469c22576da59fd0b20cafc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7039613d-ecd3-578a-b8fa-2fdbd4c56ebc/7039613d-ecd3-578a-b8fa-2fdbd4c56ebc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ec/10ec73d12c620e330102ecec9ecff7b3/pa/JJ75829_1d8cf311bc58c6f0c367d574cf6f0590.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2012-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 350 CDI L BlueTEC Grand Edition',
'transmission': 'automatic',
'trim': 'L BlueTEC Grand Edition',
'year': 2012}
2026-04-27 07:59:11 [auto1.es] INFO: Saving data for JJ75829: {'created_time': 1777276751.111569, 'last_price_update_time': 1777276751.11158, 'has_photos': True, 'auction_closing_time': 1777302367.0}
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1165528fdfef5e8a3dea4173610c6bf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876e2d0>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_2d78b5a6b37f28cbecdbcf272e647219.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846e2d0>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1165528fdfef5e8a3dea4173610c6bf6.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_1e1c520bbddc1c811fd3e5da967e3ced.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048977250>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_1e1c520bbddc1c811fd3e5da967e3ced.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_fbcf0323900398b31e8306141885e55a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_9f5171bd6c777964f197a1d5e11910e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846e290>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_fbcf0323900398b31e8306141885e55a.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891e790>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_9f5171bd6c777964f197a1d5e11910e1.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_bb2fb094bc0438cb433cf8ad08429576.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836a710>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_bb2fb094bc0438cb433cf8ad08429576.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_f0ad8cbeee64ebe308b9229d30ba692d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF84239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d4490>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_f0ad8cbeee64ebe308b9229d30ba692d.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_56eab744679461e900f956f875dbca75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX18680> (referer: https://www.auto1.com/v1/car-details-view/LX18680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ea090>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_56eab744679461e900f956f875dbca75.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65177319-09c4-55f6-8f96-337d949bf581
2026-04-27 07:59:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65177319-09c4-55f6-8f96-337d949bf581, skipping ID generation
2026-04-27 07:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65177319-09c4-55f6-8f96-337d949bf581 with scrape type 1
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65177319-09c4-55f6-8f96-337d949bf581 sending to next pipeline
2026-04-27 07:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65177319-09c4-55f6-8f96-337d949bf581, identifier: DW60608
2026-04-27 07:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65177319-09c4-55f6-8f96-337d949bf581 with identifier: DW60608
2026-04-27 07:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65177319-09c4-55f6-8f96-337d949bf581 with identifier: DW60608
2026-04-27 07:59:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65177319-09c4-55f6-8f96-337d949bf581 with identifier: DW60608 to the API
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_56eab744679461e900f956f875dbca75.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'city': 'Calaf',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:04:05Z',
'fuel_type': 'petrol',
'id': '65177319-09c4-55f6-8f96-337d949bf581',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW60608',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Fiat',
'model': '500X',
'odometer': 46571,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_4101d80e4283aedcb7d4a4b81c015c50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_56eab744679461e900f956f875dbca75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_430686107fb3dcd62eb7fb33736c0c59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_132920465c28f95f9b60c1b5865f2ea9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_0aa70b15039362bba5e4a9e15db84933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7c085988bb6db65149ceea1a8b2a5cdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d518666fd4d044b346b8f88892d19fa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_7f90f8bf390f46bacced8ea98304fa96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_c4838fa7218c0e735b1be49017494781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65177319-09c4-55f6-8f96-337d949bf581/65177319-09c4-55f6-8f96-337d949bf581_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/83/118300117ea82953469fc99dacef0ca3/pa/DW60608_d2cd871e3016c1a0db0cbdda7762d9d4.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.0 Turbo City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2021}
2026-04-27 07:59:12 [auto1.es] INFO: Saving data for DW60608: {'created_time': 1777276752.740817, 'last_price_update_time': 1777276752.740829, 'has_photos': True, 'auction_closing_time': 1777388645.0}
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_644eb33f697a00722ae1230c49a2f6be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86677a59-87ba-5cc5-b886-9dc695592f98 with identifier: LX18680
2026-04-27 07:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86677a59-87ba-5cc5-b886-9dc695592f98 with scrape type 1
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_b286ade811520d05e5482a6c73bd069f.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ad851610f6b1b033ee756a44b2580319.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0404b6cf1f2675e2953f5e9661a13edf.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_4b7472e8e082e8ded7b71f302ee3f9e2.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_2bce36b84af7613037e6276893a2a709.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_70772da0e16388ac85c67be538c67120.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_a5810a5f8a11f527f6ece6d0833ce490.jpg not downloaded yet
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0d3671c6d28c218781d4c5aad02bcdd1.jpg not downloaded yet
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048382b50>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_644eb33f697a00722ae1230c49a2f6be.jpg saved to cache
2026-04-27 07:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 07:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ec50c598a2d4678d4d5750cedb3f8026.jpg not downloaded yet
2026-04-27 07:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_98e43fa7b68994e90f76cb3fdb799e2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_029ccbe5acda8ff316cd6f54731ad575.jpg not downloaded yet
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663150>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_98e43fa7b68994e90f76cb3fdb799e2c.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0d3671c6d28c218781d4c5aad02bcdd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_029ccbe5acda8ff316cd6f54731ad575.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e16d0>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0d3671c6d28c218781d4c5aad02bcdd1.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e0a10>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_029ccbe5acda8ff316cd6f54731ad575.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ec50c598a2d4678d4d5750cedb3f8026.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_a5810a5f8a11f527f6ece6d0833ce490.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048501a10>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ec50c598a2d4678d4d5750cedb3f8026.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_70772da0e16388ac85c67be538c67120.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841ae90>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_a5810a5f8a11f527f6ece6d0833ce490.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_2bce36b84af7613037e6276893a2a709.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a54910>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_70772da0e16388ac85c67be538c67120.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_4b7472e8e082e8ded7b71f302ee3f9e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3d3d0>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_2bce36b84af7613037e6276893a2a709.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0404b6cf1f2675e2953f5e9661a13edf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a56350>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_4b7472e8e082e8ded7b71f302ee3f9e2.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836f510>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0404b6cf1f2675e2953f5e9661a13edf.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_b286ade811520d05e5482a6c73bd069f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2020 | hits on page: 40
2026-04-27 07:59:17 [auto1.es] INFO: Found listing with ID: MB84722
2026-04-27 07:59:17 [auto1.es] INFO: Scrape type for MB84722: 0
2026-04-27 07:59:17 [auto1.es] INFO: Found listing with ID: DY61189
2026-04-27 07:59:17 [auto1.es] INFO: Scrape type for DY61189: 0
2026-04-27 07:59:17 [auto1.es] INFO: Found listing with ID: SU83736
2026-04-27 07:59:17 [auto1.es] INFO: Scrape type for SU83736: 2
2026-04-27 07:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40548525-bf69-563f-9b55-b1b03b2e3f29 with identifier: SU83736
2026-04-27 07:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40548525-bf69-563f-9b55-b1b03b2e3f29 with scrape type 2
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40548525-bf69-563f-9b55-b1b03b2e3f29 with scrape type 2
2026-04-27 07:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40548525-bf69-563f-9b55-b1b03b2e3f29, identifier: SU83736
2026-04-27 07:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40548525-bf69-563f-9b55-b1b03b2e3f29 with identifier: SU83736
2026-04-27 07:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40548525-bf69-563f-9b55-b1b03b2e3f29 with identifier: SU83736
2026-04-27 07:59:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40548525-bf69-563f-9b55-b1b03b2e3f29 with identifier: SU83736 to the API
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:18:53Z',
'fuel_type': 'diesel',
'id': '40548525-bf69-563f-9b55-b1b03b2e3f29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU83736',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 228162,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-11-02',
'seller_name': None,
'title': 'BMW 3er 318d GT Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2015}
2026-04-27 07:59:17 [auto1.es] INFO: Saving data for SU83736: {'auction_closing_time': 1777303133.0, 'created_time': 1777018998.070556, 'has_photos': True, 'last_price_update_time': 1777276757.830539}
2026-04-27 07:59:17 [auto1.es] INFO: Found listing with ID: MZ54464
2026-04-27 07:59:17 [auto1.es] INFO: Scrape type for MZ54464: 2
2026-04-27 07:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdd5cb81-ab55-5eae-97cc-779a031d105f with identifier: MZ54464
2026-04-27 07:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdd5cb81-ab55-5eae-97cc-779a031d105f with scrape type 2
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdd5cb81-ab55-5eae-97cc-779a031d105f with scrape type 2
2026-04-27 07:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdd5cb81-ab55-5eae-97cc-779a031d105f, identifier: MZ54464
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ad851610f6b1b033ee756a44b2580319.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_ed2180a4b8829bdc7b11550dc67b50fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdd5cb81-ab55-5eae-97cc-779a031d105f with identifier: MZ54464
2026-04-27 07:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdd5cb81-ab55-5eae-97cc-779a031d105f with identifier: MZ54464
2026-04-27 07:59:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdd5cb81-ab55-5eae-97cc-779a031d105f with identifier: MZ54464 to the API
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:24:53Z',
'fuel_type': 'diesel',
'id': 'bdd5cb81-ab55-5eae-97cc-779a031d105f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ54464',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 98726,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-11',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport 4Motion BlueMotion Tech',
'year': 2016}
2026-04-27 07:59:18 [auto1.es] INFO: Saving data for MZ54464: {'auction_closing_time': 1777303493.0, 'created_time': 1777018917.522586, 'has_photos': True, 'last_price_update_time': 1777276758.224274}
2026-04-27 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB27489> (referer: https://www.auto1.com/v1/car-details-view/DB27489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e8450>
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_b286ade811520d05e5482a6c73bd069f.jpg saved to cache
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:18 [auto1.es] INFO: Found listing with ID: JU92139
2026-04-27 07:59:18 [auto1.es] INFO: Scrape type for JU92139: 2
2026-04-27 07:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139
2026-04-27 07:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e260d9-3b71-5749-b77e-e15005e315c6 with scrape type 2
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e260d9-3b71-5749-b77e-e15005e315c6 with scrape type 2
2026-04-27 07:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5e260d9-3b71-5749-b77e-e15005e315c6, identifier: JU92139
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139
2026-04-27 07:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139
2026-04-27 07:59:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139 to the API
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:38:07Z',
'fuel_type': 'diesel',
'id': 'f5e260d9-3b71-5749-b77e-e15005e315c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU92139',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 102604,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-08-30',
'seller_name': None,
'title': 'BMW X1 xDrive 18d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-04-27 07:59:18 [auto1.es] INFO: Saving data for JU92139: {'auction_closing_time': 1777304287.0, 'created_time': 1777019490.443394, 'has_photos': True, 'last_price_update_time': 1777276758.690719}
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.219(s), this was the 1st time calling it.
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.63054017370722 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.220(s), this was the 1st time calling it.
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.137495569313537 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:18 [auto1.es] INFO: Found listing with ID: ZT52456
2026-04-27 07:59:18 [auto1.es] INFO: Scrape type for ZT52456: 2
2026-04-27 07:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bd731d-ff6a-561f-8dde-a0dabfacd789 with identifier: ZT52456
2026-04-27 07:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bd731d-ff6a-561f-8dde-a0dabfacd789 with scrape type 2
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73bd731d-ff6a-561f-8dde-a0dabfacd789 with scrape type 2
2026-04-27 07:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73bd731d-ff6a-561f-8dde-a0dabfacd789, identifier: ZT52456
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048343e50>
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ad851610f6b1b033ee756a44b2580319.jpg saved to cache
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86677a59-87ba-5cc5-b886-9dc695592f98
2026-04-27 07:59:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86677a59-87ba-5cc5-b886-9dc695592f98, skipping ID generation
2026-04-27 07:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86677a59-87ba-5cc5-b886-9dc695592f98 with scrape type 1
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86677a59-87ba-5cc5-b886-9dc695592f98 sending to next pipeline
2026-04-27 07:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 86677a59-87ba-5cc5-b886-9dc695592f98, identifier: LX18680
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048381b90>
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_ed2180a4b8829bdc7b11550dc67b50fa.jpg saved to cache
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 07:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73bd731d-ff6a-561f-8dde-a0dabfacd789 with identifier: ZT52456
2026-04-27 07:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73bd731d-ff6a-561f-8dde-a0dabfacd789 with identifier: ZT52456
2026-04-27 07:59:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73bd731d-ff6a-561f-8dde-a0dabfacd789 with identifier: ZT52456 to the API
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:06:43Z',
'fuel_type': 'diesel',
'id': '73bd731d-ff6a-561f-8dde-a0dabfacd789',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT52456',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Kuga',
'odometer': 170884,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-07-09',
'seller_name': None,
'title': 'Ford Kuga 1.5 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2017}
2026-04-27 07:59:19 [auto1.es] INFO: Saving data for ZT52456: {'auction_closing_time': 1777302403.0, 'created_time': 1777020154.811807, 'has_photos': True, 'last_price_update_time': 1777276759.252627}
2026-04-27 07:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 86677a59-87ba-5cc5-b886-9dc695592f98 with identifier: LX18680
2026-04-27 07:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 86677a59-87ba-5cc5-b886-9dc695592f98 with identifier: LX18680
2026-04-27 07:59:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 86677a59-87ba-5cc5-b886-9dc695592f98 with identifier: LX18680 to the API
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ad851610f6b1b033ee756a44b2580319.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'city': 'Araia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 122,
'expiration_date': '2026-04-27T15:39:55Z',
'fuel_type': 'petrol',
'id': '86677a59-87ba-5cc5-b886-9dc695592f98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX18680',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Volkswagen',
'model': 'Golf VI Plus',
'odometer': 111580,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_b286ade811520d05e5482a6c73bd069f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ad851610f6b1b033ee756a44b2580319.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0404b6cf1f2675e2953f5e9661a13edf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_4b7472e8e082e8ded7b71f302ee3f9e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_2bce36b84af7613037e6276893a2a709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_70772da0e16388ac85c67be538c67120.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_a5810a5f8a11f527f6ece6d0833ce490.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_0d3671c6d28c218781d4c5aad02bcdd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_ec50c598a2d4678d4d5750cedb3f8026.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_86677a59-87ba-5cc5-b886-9dc695592f98/86677a59-87ba-5cc5-b886-9dc695592f98_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/ce/68ce83c8f0610eeb19445009e1b993c6/pa/LX18680_029ccbe5acda8ff316cd6f54731ad575.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2011-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI Plus 1.4 TSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2011}
2026-04-27 07:59:19 [auto1.es] INFO: Saving data for LX18680: {'created_time': 1777276759.602061, 'last_price_update_time': 1777276759.602071, 'has_photos': True, 'auction_closing_time': 1777304395.0}
2026-04-27 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_08c92f4bb5a56dd3406a2257f021ac4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:19 [auto1.es] INFO: Found listing with ID: LX97647
2026-04-27 07:59:19 [auto1.es] INFO: Scrape type for LX97647: 2
2026-04-27 07:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33bca8b3-5659-5668-9adb-79c6d3aea699 with identifier: LX97647
2026-04-27 07:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33bca8b3-5659-5668-9adb-79c6d3aea699 with scrape type 2
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33bca8b3-5659-5668-9adb-79c6d3aea699 with scrape type 2
2026-04-27 07:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33bca8b3-5659-5668-9adb-79c6d3aea699, identifier: LX97647
2026-04-27 07:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 407cf447-15dc-5b26-8e6b-df9f385d81b6 with identifier: DB27489
2026-04-27 07:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 407cf447-15dc-5b26-8e6b-df9f385d81b6 with scrape type 1
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_c0baa8f4115b76f42bbc3285fc89705b.jpg not downloaded yet
2026-04-27 07:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33bca8b3-5659-5668-9adb-79c6d3aea699 with identifier: LX97647
2026-04-27 07:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33bca8b3-5659-5668-9adb-79c6d3aea699 with identifier: LX97647
2026-04-27 07:59:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33bca8b3-5659-5668-9adb-79c6d3aea699 with identifier: LX97647 to the API
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:39:09Z',
'fuel_type': 'diesel',
'id': '33bca8b3-5659-5668-9adb-79c6d3aea699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX97647',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 118279,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-26',
'seller_name': None,
'title': 'BMW X1 sDrive 18d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2015}
2026-04-27 07:59:20 [auto1.es] INFO: Saving data for LX97647: {'auction_closing_time': 1777304349.0, 'created_time': 1777018388.042914, 'has_photos': True, 'last_price_update_time': 1777276760.038661}
2026-04-27 07:59:20 [auto1.es] INFO: Found listing with ID: XN31464
2026-04-27 07:59:20 [auto1.es] INFO: Scrape type for XN31464: 2
2026-04-27 07:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fa7cc4-4e0f-57a0-85da-74fa984a0554 with identifier: XN31464
2026-04-27 07:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fa7cc4-4e0f-57a0-85da-74fa984a0554 with scrape type 2
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3fa7cc4-4e0f-57a0-85da-74fa984a0554 with scrape type 2
2026-04-27 07:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d3fa7cc4-4e0f-57a0-85da-74fa984a0554, identifier: XN31464
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_91745ad1e9975418fdac360aa96b621e.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d3fa7cc4-4e0f-57a0-85da-74fa984a0554 with identifier: XN31464
2026-04-27 07:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d3fa7cc4-4e0f-57a0-85da-74fa984a0554 with identifier: XN31464
2026-04-27 07:59:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d3fa7cc4-4e0f-57a0-85da-74fa984a0554 with identifier: XN31464 to the API
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-04-27T15:12:39Z',
'fuel_type': 'diesel',
'id': 'd3fa7cc4-4e0f-57a0-85da-74fa984a0554',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN31464',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 125507,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-07',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2016}
2026-04-27 07:59:20 [auto1.es] INFO: Saving data for XN31464: {'auction_closing_time': 1777302759.0, 'created_time': 1777021820.307139, 'has_photos': True, 'last_price_update_time': 1777276760.455399}
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481cea50>
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_08c92f4bb5a56dd3406a2257f021ac4c.jpg saved to cache
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ccfecd56443ace9ba77a315479173507.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:20 [auto1.es] INFO: Found listing with ID: HD72326
2026-04-27 07:59:20 [auto1.es] INFO: Scrape type for HD72326: 2
2026-04-27 07:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f75844-0716-5cf9-80d0-6b9d1860301d with identifier: HD72326
2026-04-27 07:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f75844-0716-5cf9-80d0-6b9d1860301d with scrape type 2
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f75844-0716-5cf9-80d0-6b9d1860301d with scrape type 2
2026-04-27 07:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55f75844-0716-5cf9-80d0-6b9d1860301d, identifier: HD72326
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_4152a928ce3c4e050367c3d919bb18b5.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55f75844-0716-5cf9-80d0-6b9d1860301d with identifier: HD72326
2026-04-27 07:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55f75844-0716-5cf9-80d0-6b9d1860301d with identifier: HD72326
2026-04-27 07:59:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 55f75844-0716-5cf9-80d0-6b9d1860301d with identifier: HD72326 to the API
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:32:30Z',
'fuel_type': 'diesel',
'id': '55f75844-0716-5cf9-80d0-6b9d1860301d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD72326',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 245154,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-07-28',
'seller_name': None,
'title': 'Renault Megane 1.9 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-04-27 07:59:20 [auto1.es] INFO: Saving data for HD72326: {'auction_closing_time': 1777303950.0, 'created_time': 1777018289.669561, 'has_photos': True, 'last_price_update_time': 1777276760.879054}
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.788(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.903889170089637 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.819(s), this was the 1st time calling it.
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.850014199816703 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:20 [auto1.es] INFO: Found listing with ID: US62634
2026-04-27 07:59:20 [auto1.es] INFO: Scrape type for US62634: 2
2026-04-27 07:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-04-27 07:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293340dc-a86b-5def-944a-801bccd1ff63 with scrape type 2
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293340dc-a86b-5def-944a-801bccd1ff63 with scrape type 2
2026-04-27 07:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 293340dc-a86b-5def-944a-801bccd1ff63, identifier: US62634
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_defce21e30f578e773d6f0e6bd46aa30.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-04-27 07:59:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-04-27 07:59:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634 to the API
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:25:22Z',
'fuel_type': 'gas',
'id': '293340dc-a86b-5def-944a-801bccd1ff63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US62634',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 33466,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-01-12',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-04-27 07:59:21 [auto1.es] INFO: Saving data for US62634: {'auction_closing_time': 1777303522.0, 'created_time': 1777019266.226448, 'has_photos': True, 'last_price_update_time': 1777276761.440153}
2026-04-27 07:59:21 [auto1.es] INFO: Found listing with ID: HZ87853
2026-04-27 07:59:21 [auto1.es] INFO: Scrape type for HZ87853: 2
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with scrape type 2
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with scrape type 2
2026-04-27 07:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad, identifier: HZ87853
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_2ec00bf25518b1872ed3afcbb989e4ef.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048840e50>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ccfecd56443ace9ba77a315479173507.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9c33856-0f7c-5dda-95e9-3e4231d9233d
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9c33856-0f7c-5dda-95e9-3e4231d9233d, skipping ID generation
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c33856-0f7c-5dda-95e9-3e4231d9233d with scrape type 1
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9c33856-0f7c-5dda-95e9-3e4231d9233d sending to next pipeline
2026-04-27 07:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9c33856-0f7c-5dda-95e9-3e4231d9233d, identifier: JV95856
2026-04-27 07:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853
2026-04-27 07:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853
2026-04-27 07:59:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad with identifier: HZ87853 to the API
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:28:38Z',
'fuel_type': 'petrol',
'id': '8d80706a-cb9e-5f7c-bef8-19c5fc6cdbad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ87853',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Alhambra',
'odometer': 156716,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-07-31',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2022}
2026-04-27 07:59:22 [auto1.es] INFO: Saving data for HZ87853: {'auction_closing_time': 1777303718.0, 'created_time': 1777021036.25075, 'has_photos': True, 'last_price_update_time': 1777276762.129161}
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM10376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9c33856-0f7c-5dda-95e9-3e4231d9233d with identifier: JV95856
2026-04-27 07:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9c33856-0f7c-5dda-95e9-3e4231d9233d with identifier: JV95856
2026-04-27 07:59:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9c33856-0f7c-5dda-95e9-3e4231d9233d with identifier: JV95856 to the API
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ccfecd56443ace9ba77a315479173507.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': 'Granyanella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:24:44Z',
'fuel_type': 'diesel',
'id': 'd9c33856-0f7c-5dda-95e9-3e4231d9233d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV95856',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'BMW',
'model': 'X1',
'odometer': 121259,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ddd16577113b2df1f698d49bdd4a7620.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_ccfecd56443ace9ba77a315479173507.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_c04f536756f1ff907ceb1b0a8ead353c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_fb21118ebb38c91e18d3b0fd2453155b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_97758c376dd6209513d8bda169a84087.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8da74ed92db2191fc62dd74ac1f61145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_8895d32ed5a1e794be4a44b86b4a9767.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_e593a8a29f1c6af4d4a8b2c2419b523b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_9c163c0e974e439fa818b7bf4704123b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9c33856-0f7c-5dda-95e9-3e4231d9233d/d9c33856-0f7c-5dda-95e9-3e4231d9233d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/91/e5914298717bfe474f264eb1f552e1cb/pa/JV95856_754cf82e859c826be19e7a7173638b67.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-04-27 07:59:22 [auto1.es] INFO: Saving data for JV95856: {'created_time': 1777276762.490676, 'last_price_update_time': 1777276762.490688, 'has_photos': True, 'auction_closing_time': 1777389884.0}
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_91745ad1e9975418fdac360aa96b621e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [auto1.es] INFO: Found listing with ID: VN25957
2026-04-27 07:59:22 [auto1.es] INFO: Scrape type for VN25957: 2
2026-04-27 07:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90049608-6d31-538a-9b5c-eb94a0fa4255 with identifier: VN25957
2026-04-27 07:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90049608-6d31-538a-9b5c-eb94a0fa4255 with scrape type 2
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90049608-6d31-538a-9b5c-eb94a0fa4255 with scrape type 2
2026-04-27 07:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90049608-6d31-538a-9b5c-eb94a0fa4255, identifier: VN25957
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_80798f2f0972fb7d2e7ae13454262b46.jpg not downloaded yet
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90049608-6d31-538a-9b5c-eb94a0fa4255 with identifier: VN25957
2026-04-27 07:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90049608-6d31-538a-9b5c-eb94a0fa4255 with identifier: VN25957
2026-04-27 07:59:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90049608-6d31-538a-9b5c-eb94a0fa4255 with identifier: VN25957 to the API
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:05:05Z',
'fuel_type': 'diesel',
'id': '90049608-6d31-538a-9b5c-eb94a0fa4255',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN25957',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 171150,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-01-08',
'seller_name': None,
'title': 'Jaguar F-Pace 20d Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2017}
2026-04-27 07:59:22 [auto1.es] INFO: Saving data for VN25957: {'auction_closing_time': 1777302305.0, 'created_time': 1777021597.724631, 'has_photos': True, 'last_price_update_time': 1777276762.945529}
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY79472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:22 [auto1.es] INFO: Found listing with ID: NE32180
2026-04-27 07:59:22 [auto1.es] INFO: Scrape type for NE32180: 1
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_0f773f230c918ad596fc373647561d51.jpg not downloaded yet
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV86151> (referer: https://www.auto1.com/v1/car-details-view/HV86151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9f50>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_91745ad1e9975418fdac360aa96b621e.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:23 [auto1.es] INFO: Found listing with ID: ZK42012
2026-04-27 07:59:23 [auto1.es] INFO: Scrape type for ZK42012: 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_917fbbbcc5566f4f327e54c9152b0d76.jpg not downloaded yet
2026-04-27 07:59:23 [auto1.es] INFO: Found listing with ID: PV61341
2026-04-27 07:59:23 [auto1.es] INFO: Scrape type for PV61341: 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_b4219ac56d3ee7a5d0d3a0930819e175.jpg not downloaded yet
2026-04-27 07:59:23 [auto1.es] INFO: Found listing with ID: XX98366
2026-04-27 07:59:23 [auto1.es] INFO: Scrape type for XX98366: 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_3b7f87081224fb83690c433d5d7c0b12.jpg not downloaded yet
2026-04-27 07:59:23 [auto1.es] INFO: Found listing with ID: UK08613
2026-04-27 07:59:23 [auto1.es] INFO: Scrape type for UK08613: 2
2026-04-27 07:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613
2026-04-27 07:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df78b7bb-7b41-549f-bac2-339816bc3a19 with scrape type 2
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df78b7bb-7b41-549f-bac2-339816bc3a19 with scrape type 2
2026-04-27 07:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: df78b7bb-7b41-549f-bac2-339816bc3a19, identifier: UK08613
2026-04-27 07:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 with identifier: HV86151
2026-04-27 07:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 with scrape type 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e377b63e6afcbc130b7419ac83849e99.jpg not downloaded yet
2026-04-27 07:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613
2026-04-27 07:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613
2026-04-27 07:59:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: df78b7bb-7b41-549f-bac2-339816bc3a19 with identifier: UK08613 to the API
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:26:24Z',
'fuel_type': 'diesel',
'id': 'df78b7bb-7b41-549f-bac2-339816bc3a19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK08613',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Alhambra',
'odometer': 142187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-03-08',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style I-Tech',
'transmission': 'automatic',
'trim': 'Style I-Tech',
'year': 2015}
2026-04-27 07:59:23 [auto1.es] INFO: Saving data for UK08613: {'auction_closing_time': 1777303584.0, 'created_time': 1777018814.110032, 'has_photos': True, 'last_price_update_time': 1777276763.59307}
2026-04-27 07:59:23 [auto1.es] INFO: Found listing with ID: BU76259
2026-04-27 07:59:23 [auto1.es] INFO: Scrape type for BU76259: 2
2026-04-27 07:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d3f677d-8043-576d-9aff-283d3fc6a2e4 with identifier: BU76259
2026-04-27 07:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d3f677d-8043-576d-9aff-283d3fc6a2e4 with scrape type 2
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d3f677d-8043-576d-9aff-283d3fc6a2e4 with scrape type 2
2026-04-27 07:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d3f677d-8043-576d-9aff-283d3fc6a2e4, identifier: BU76259
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_8486aea529e972301e6b96fcc87cd56f.jpg not downloaded yet
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_defce21e30f578e773d6f0e6bd46aa30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_2ec00bf25518b1872ed3afcbb989e4ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_80798f2f0972fb7d2e7ae13454262b46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d3f677d-8043-576d-9aff-283d3fc6a2e4 with identifier: BU76259
2026-04-27 07:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d3f677d-8043-576d-9aff-283d3fc6a2e4 with identifier: BU76259
2026-04-27 07:59:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d3f677d-8043-576d-9aff-283d3fc6a2e4 with identifier: BU76259 to the API
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:36:40Z',
'fuel_type': 'diesel',
'id': '2d3f677d-8043-576d-9aff-283d3fc6a2e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU76259',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 92196,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-06-28',
'seller_name': None,
'title': 'Ford Focus 1.8 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2009}
2026-04-27 07:59:24 [auto1.es] INFO: Saving data for BU76259: {'auction_closing_time': 1777304200.0, 'created_time': 1777020615.85221, 'has_photos': True, 'last_price_update_time': 1777276764.030084}
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_4152a928ce3c4e050367c3d919bb18b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [auto1.es] INFO: Found listing with ID: HH60103
2026-04-27 07:59:24 [auto1.es] INFO: Scrape type for HH60103: 2
2026-04-27 07:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18817e9b-cadd-5efd-9887-1b7ceb00f7b0 with identifier: HH60103
2026-04-27 07:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18817e9b-cadd-5efd-9887-1b7ceb00f7b0 with scrape type 2
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18817e9b-cadd-5efd-9887-1b7ceb00f7b0 with scrape type 2
2026-04-27 07:59:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 18817e9b-cadd-5efd-9887-1b7ceb00f7b0, identifier: HH60103
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_72f3f071fb4546edf94142e54a351c55.jpg not downloaded yet
2026-04-27 07:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 18817e9b-cadd-5efd-9887-1b7ceb00f7b0 with identifier: HH60103
2026-04-27 07:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 18817e9b-cadd-5efd-9887-1b7ceb00f7b0 with identifier: HH60103
2026-04-27 07:59:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 18817e9b-cadd-5efd-9887-1b7ceb00f7b0 with identifier: HH60103 to the API
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:20:01Z',
'fuel_type': 'diesel',
'id': '18817e9b-cadd-5efd-9887-1b7ceb00f7b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH60103',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 158219,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-03-05',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Excellence',
'transmission': 'manual',
'trim': 'Excellence',
'year': 2013}
2026-04-27 07:59:24 [auto1.es] INFO: Saving data for HH60103: {'auction_closing_time': 1777303201.0, 'created_time': 1777019790.495534, 'has_photos': True, 'last_price_update_time': 1777276764.530089}
2026-04-27 07:59:24 [auto1.es] INFO: Found listing with ID: MR50800
2026-04-27 07:59:24 [auto1.es] INFO: Scrape type for MR50800: 1
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_0136c35f276422580d22497422ba16ba.jpg not downloaded yet
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048387b90>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_defce21e30f578e773d6f0e6bd46aa30.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048801dd0>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_2ec00bf25518b1872ed3afcbb989e4ef.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528850>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_80798f2f0972fb7d2e7ae13454262b46.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c7790>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_4152a928ce3c4e050367c3d919bb18b5.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e377b63e6afcbc130b7419ac83849e99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_3b7f87081224fb83690c433d5d7c0b12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [auto1.es] INFO: Found listing with ID: JF88454
2026-04-27 07:59:24 [auto1.es] INFO: Scrape type for JF88454: 1
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e49b6a229bd412d4e918a608f15b218c.jpg not downloaded yet
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM79142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_8486aea529e972301e6b96fcc87cd56f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:24 [auto1.es] INFO: Found listing with ID: LT09027
2026-04-27 07:59:24 [auto1.es] INFO: Scrape type for LT09027: 2
2026-04-27 07:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027
2026-04-27 07:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df8e18c-0247-538d-b8f4-93056c076b00 with scrape type 2
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7df8e18c-0247-538d-b8f4-93056c076b00 with scrape type 2
2026-04-27 07:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7df8e18c-0247-538d-b8f4-93056c076b00, identifier: LT09027
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_3034add9d904a60b4d2dc21c695be562.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER40714> (referer: https://www.auto1.com/v1/car-details-view/ER40714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027
2026-04-27 07:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027
2026-04-27 07:59:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7df8e18c-0247-538d-b8f4-93056c076b00 with identifier: LT09027 to the API
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:39:32Z',
'fuel_type': 'diesel',
'id': '7df8e18c-0247-538d-b8f4-93056c076b00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT09027',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'XE',
'odometer': 157845,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-07-28',
'seller_name': None,
'title': 'Jaguar XE 20d Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2015}
2026-04-27 07:59:25 [auto1.es] INFO: Saving data for LT09027: {'auction_closing_time': 1777304372.0, 'created_time': 1777020388.941139, 'has_photos': True, 'last_price_update_time': 1777276765.311552}
2026-04-27 07:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:25 [auto1.es] INFO: Found listing with ID: CT91769
2026-04-27 07:59:25 [auto1.es] INFO: Scrape type for CT91769: 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_6eb3b0cc98e572b987d08f5a39e80eab.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_0136c35f276422580d22497422ba16ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_72f3f071fb4546edf94142e54a351c55.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX82700> (referer: https://www.auto1.com/v1/car-details-view/WX82700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:25 [auto1.es] INFO: Found listing with ID: YU35408
2026-04-27 07:59:25 [auto1.es] INFO: Scrape type for YU35408: 2
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d10146-1d57-59f7-a347-3e5609f534dc with identifier: YU35408
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d10146-1d57-59f7-a347-3e5609f534dc with scrape type 2
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d10146-1d57-59f7-a347-3e5609f534dc with scrape type 2
2026-04-27 07:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92d10146-1d57-59f7-a347-3e5609f534dc, identifier: YU35408
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_db1924f4b7679f3ab72b61186532f2ff.jpg not downloaded yet
2026-04-27 07:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a46f90>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e377b63e6afcbc130b7419ac83849e99.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885c610>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_3b7f87081224fb83690c433d5d7c0b12.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048593f10>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_8486aea529e972301e6b96fcc87cd56f.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ef3d6d2-b6c6-55b3-9016-088794133529 with identifier: ER40714
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ef3d6d2-b6c6-55b3-9016-088794133529 with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_5d282942f6c1c41cca4020a3190d3429.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92d10146-1d57-59f7-a347-3e5609f534dc with identifier: YU35408
2026-04-27 07:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92d10146-1d57-59f7-a347-3e5609f534dc with identifier: YU35408
2026-04-27 07:59:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92d10146-1d57-59f7-a347-3e5609f534dc with identifier: YU35408 to the API
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:51:05Z',
'fuel_type': 'diesel',
'id': '92d10146-1d57-59f7-a347-3e5609f534dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU35408',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 107893,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-12-28',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Reference I-Tech 30 Aniversario',
'transmission': 'manual',
'trim': 'Reference I-Tech 30 Aniversario',
'year': 2014}
2026-04-27 07:59:26 [auto1.es] INFO: Saving data for YU35408: {'auction_closing_time': 1777305065.0, 'created_time': 1777021078.625466, 'has_photos': True, 'last_price_update_time': 1777276766.026341}
2026-04-27 07:59:26 [auto1.es] INFO: Found listing with ID: WZ44927
2026-04-27 07:59:26 [auto1.es] INFO: Scrape type for WZ44927: 1
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_d875323a3cde7594ed045b88acd72d58.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_a8c3db168203ffc02f8f3f1e47a4d1ef.jpg not downloaded yet
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e49b6a229bd412d4e918a608f15b218c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_3034add9d904a60b4d2dc21c695be562.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE32472> (referer: https://www.auto1.com/v1/car-details-view/DE32472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485da390>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_0136c35f276422580d22497422ba16ba.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481cf090>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_72f3f071fb4546edf94142e54a351c55.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 with identifier: WX82700
2026-04-27 07:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 with scrape type 1
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_ebab33726f826a6e875de4490600e94f.jpg not downloaded yet
2026-04-27 07:59:26 [auto1.es] INFO: Found listing with ID: PB68594
2026-04-27 07:59:26 [auto1.es] INFO: Scrape type for PB68594: 2
2026-04-27 07:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76bf146e-54d8-59b8-8e46-df567f46ad54 with identifier: PB68594
2026-04-27 07:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76bf146e-54d8-59b8-8e46-df567f46ad54 with scrape type 2
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76bf146e-54d8-59b8-8e46-df567f46ad54 with scrape type 2
2026-04-27 07:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76bf146e-54d8-59b8-8e46-df567f46ad54, identifier: PB68594
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_b00c1496a7baca1035298f4188f3d57c.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_8fb4aeb0a5e9f04b0b9a70f39e0667d7.jpg not downloaded yet
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_6eb3b0cc98e572b987d08f5a39e80eab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76bf146e-54d8-59b8-8e46-df567f46ad54 with identifier: PB68594
2026-04-27 07:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76bf146e-54d8-59b8-8e46-df567f46ad54 with identifier: PB68594
2026-04-27 07:59:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76bf146e-54d8-59b8-8e46-df567f46ad54 with identifier: PB68594 to the API
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-04-27T15:42:06Z',
'fuel_type': 'petrol',
'id': '76bf146e-54d8-59b8-8e46-df567f46ad54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB68594',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Porsche',
'model': 'Macan',
'odometer': 122856,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-03-31',
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 07:59:26 [auto1.es] INFO: Saving data for PB68594: {'auction_closing_time': 1777304526.0, 'created_time': 1777018150.323939, 'has_photos': True, 'last_price_update_time': 1777276766.641725}
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_30fcf223b514f9820d4ab36d2ba10d2b.jpg not downloaded yet
2026-04-27 07:59:26 [auto1.es] INFO: Found listing with ID: YG24338
2026-04-27 07:59:26 [auto1.es] INFO: Scrape type for YG24338: 2
2026-04-27 07:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4290866b-267c-574a-a35e-d240551c38be with identifier: YG24338
2026-04-27 07:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4290866b-267c-574a-a35e-d240551c38be with scrape type 2
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4290866b-267c-574a-a35e-d240551c38be with scrape type 2
2026-04-27 07:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4290866b-267c-574a-a35e-d240551c38be, identifier: YG24338
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_0cf39401f74d9ea9220f0b6844838740.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4290866b-267c-574a-a35e-d240551c38be with identifier: YG24338
2026-04-27 07:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4290866b-267c-574a-a35e-d240551c38be with identifier: YG24338
2026-04-27 07:59:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4290866b-267c-574a-a35e-d240551c38be with identifier: YG24338 to the API
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:31:38Z',
'fuel_type': 'petrol',
'id': '4290866b-267c-574a-a35e-d240551c38be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG24338',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 92040,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-05',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI FR Crono',
'transmission': 'manual',
'trim': 'FR Crono',
'year': 2017}
2026-04-27 07:59:27 [auto1.es] INFO: Saving data for YG24338: {'auction_closing_time': 1777303898.0, 'created_time': 1777021112.887595, 'has_photos': True, 'last_price_update_time': 1777276767.105459}
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_42343857c2fa78655f61f52af23431ce.jpg not downloaded yet
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU70286> (referer: https://www.auto1.com/v1/car-details-view/XU70286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC86632> (referer: https://www.auto1.com/v1/car-details-view/RC86632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_5d282942f6c1c41cca4020a3190d3429.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [auto1.es] INFO: Found listing with ID: YM84351
2026-04-27 07:59:27 [auto1.es] INFO: Scrape type for YM84351: 2
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc3abc0-83b1-5150-b155-5f67f1a04aba with identifier: YM84351
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc3abc0-83b1-5150-b155-5f67f1a04aba with scrape type 2
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc3abc0-83b1-5150-b155-5f67f1a04aba with scrape type 2
2026-04-27 07:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ddc3abc0-83b1-5150-b155-5f67f1a04aba, identifier: YM84351
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_044e5f33cb2778af8bf0ca9f070fdf75.jpg not downloaded yet
2026-04-27 07:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894f4d0>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e49b6a229bd412d4e918a608f15b218c.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048543910>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_3034add9d904a60b4d2dc21c695be562.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d84837-49fc-5a55-a5fc-cebb8985ac17 with scrape type 1
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_647f2148c4a8a33067d5e7e78430de15.jpg not downloaded yet
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048383990>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_6eb3b0cc98e572b987d08f5a39e80eab.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ddc3abc0-83b1-5150-b155-5f67f1a04aba with identifier: YM84351
2026-04-27 07:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ddc3abc0-83b1-5150-b155-5f67f1a04aba with identifier: YM84351
2026-04-27 07:59:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ddc3abc0-83b1-5150-b155-5f67f1a04aba with identifier: YM84351 to the API
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-04-27T15:20:56Z',
'fuel_type': 'diesel',
'id': 'ddc3abc0-83b1-5150-b155-5f67f1a04aba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM84351',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Talento',
'odometer': 144526,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-02-21',
'seller_name': None,
'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 1,2t SX',
'transmission': 'manual',
'trim': 'L2H1 1,2t SX',
'year': 2019}
2026-04-27 07:59:28 [auto1.es] INFO: Saving data for YM84351: {'auction_closing_time': 1777303256.0, 'created_time': 1777021233.110811, 'has_photos': True, 'last_price_update_time': 1777276768.001279}
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_cf3922f3ed5be9f277541aaf5f01dbe8.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_ebab33726f826a6e875de4490600e94f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_a8c3db168203ffc02f8f3f1e47a4d1ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [auto1.es] INFO: Found listing with ID: KX75561
2026-04-27 07:59:28 [auto1.es] INFO: Scrape type for KX75561: 2
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0159037-2b9c-59f3-b57e-db6447fd147b with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0159037-2b9c-59f3-b57e-db6447fd147b with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e0159037-2b9c-59f3-b57e-db6447fd147b, identifier: KX75561
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_f328716f6c680ed3b6a208b5ae9a88ca.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_597d3fc0be218725c87bbc733a4f657c.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561
2026-04-27 07:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561
2026-04-27 07:59:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561 to the API
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:36:04Z',
'fuel_type': 'diesel',
'id': 'e0159037-2b9c-59f3-b57e-db6447fd147b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX75561',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 141407,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-11-03',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2014}
2026-04-27 07:59:28 [auto1.es] INFO: Saving data for KX75561: {'auction_closing_time': 1777304164.0, 'created_time': 1777018302.02069, 'has_photos': True, 'last_price_update_time': 1777276768.58892}
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_685e1de5bcad751cc279b7a8e2296f44.jpg not downloaded yet
2026-04-27 07:59:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a1464c-1aaf-5355-84b0-5d5b692ee265 with identifier: XU70286
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a1464c-1aaf-5355-84b0-5d5b692ee265 with scrape type 1
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bbd70e458ad73bbf83954aaa1051adcf.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d234b9-87a1-5977-aa7f-8c6a754b27b4 with identifier: RC86632
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4 with scrape type 1
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_10204b0cbad3a58eeda712a12a76f624.jpg not downloaded yet
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048390b10>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_5d282942f6c1c41cca4020a3190d3429.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:28 [auto1.es] INFO: Found listing with ID: VY31603
2026-04-27 07:59:28 [auto1.es] INFO: Scrape type for VY31603: 1
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_c2ca62ec353f5433bb6db00975379bc1.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_12c289839bcb3eeba5abb486fd6b268f.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_0cf39401f74d9ea9220f0b6844838740.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_8fb4aeb0a5e9f04b0b9a70f39e0667d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_810634e660c6066f2f1d9adad33fdfe8.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_925f3c5a469ef54318978bbbd753a68c.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f6a48b72ffb9eb56bbd158edc3605515.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_30fcf223b514f9820d4ab36d2ba10d2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [auto1.es] INFO: Found listing with ID: TH62472
2026-04-27 07:59:28 [auto1.es] INFO: Scrape type for TH62472: 2
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4429553-6311-509d-b988-791030921faf with identifier: TH62472
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4429553-6311-509d-b988-791030921faf with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4429553-6311-509d-b988-791030921faf with scrape type 2
2026-04-27 07:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4429553-6311-509d-b988-791030921faf, identifier: TH62472
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_b5834ba1ecb11fd3169b1dd400e4317c.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_4a3126f2838bcef6e5e997b314898976.jpg not downloaded yet
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048843f90>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_ebab33726f826a6e875de4490600e94f.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bc350>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_a8c3db168203ffc02f8f3f1e47a4d1ef.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4429553-6311-509d-b988-791030921faf with identifier: TH62472
2026-04-27 07:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4429553-6311-509d-b988-791030921faf with identifier: TH62472
2026-04-27 07:59:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4429553-6311-509d-b988-791030921faf with identifier: TH62472 to the API
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:38:48Z',
'fuel_type': 'diesel',
'id': 'b4429553-6311-509d-b988-791030921faf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH62472',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 132393,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-03-09',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2026-04-27 07:59:29 [auto1.es] INFO: Saving data for TH62472: {'auction_closing_time': 1777304328.0, 'created_time': 1777020807.583688, 'has_photos': True, 'last_price_update_time': 1777276769.393092}
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_9c5e2eba2a43eb337239b4c839234c81.jpg not downloaded yet
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_3919f75056855ffbf04f0c185fc46aca.jpg not downloaded yet
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_53d6527eff4fd3170f67f85a7951e79f.jpg not downloaded yet
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_647f2148c4a8a33067d5e7e78430de15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [auto1.es] INFO: Found listing with ID: EY86051
2026-04-27 07:59:29 [auto1.es] INFO: Scrape type for EY86051: 2
2026-04-27 07:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051
2026-04-27 07:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c31f812-678b-50be-9c37-12225fb0bc97 with scrape type 2
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c31f812-678b-50be-9c37-12225fb0bc97 with scrape type 2
2026-04-27 07:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c31f812-678b-50be-9c37-12225fb0bc97, identifier: EY86051
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_449805eb5c693cabeafe96f125568ce3.jpg not downloaded yet
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_945d350956e4e517d9f4d4ea6d50d71a.jpg not downloaded yet
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_cf3922f3ed5be9f277541aaf5f01dbe8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051
2026-04-27 07:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051
2026-04-27 07:59:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c31f812-678b-50be-9c37-12225fb0bc97 with identifier: EY86051 to the API
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:31:15Z',
'fuel_type': 'diesel',
'id': '9c31f812-678b-50be-9c37-12225fb0bc97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY86051',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 230862,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-01-04',
'seller_name': None,
'title': 'BMW 1er 116d Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-04-27 07:59:30 [auto1.es] INFO: Saving data for EY86051: {'auction_closing_time': 1777303875.0, 'created_time': 1777020918.643781, 'has_photos': True, 'last_price_update_time': 1777276770.658211}
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_77c3c83f27112681285a621f44673ea7.jpg not downloaded yet
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_18c1143f1c3a156e4618bc6c87b4ad5b.jpg not downloaded yet
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_36a07d6678a3c84473b9733d139ca5af.jpg not downloaded yet
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a3910>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_0cf39401f74d9ea9220f0b6844838740.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04883d9d0>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_8fb4aeb0a5e9f04b0b9a70f39e0667d7.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a3b10>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_30fcf223b514f9820d4ab36d2ba10d2b.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:30 [auto1.es] INFO: Found listing with ID: BL04820
2026-04-27 07:59:30 [auto1.es] INFO: Scrape type for BL04820: 1
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_740621fe3f0bc3b451429d7b9b7a2bf6.jpg not downloaded yet
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_ece71e89934d5a764d09675c42612998.jpg not downloaded yet
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_c2ca62ec353f5433bb6db00975379bc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_1101d7904641001025f94500a74d2751.jpg not downloaded yet
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_8b8c52beec75a6d43b0d64c10be60004.jpg not downloaded yet
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f311789b27718e628412c6ac83f62c59.jpg not downloaded yet
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_12c289839bcb3eeba5abb486fd6b268f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [auto1.es] INFO: Found listing with ID: HT85667
2026-04-27 07:59:30 [auto1.es] INFO: Scrape type for HT85667: 2
2026-04-27 07:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667
2026-04-27 07:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with scrape type 2
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with scrape type 2
2026-04-27 07:59:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4df26b7-1bc4-56ac-98dc-c299f1a9b702, identifier: HT85667
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_3e50f064656afd97a9ce71754ee2bdca.jpg not downloaded yet
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482129d0>
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_647f2148c4a8a33067d5e7e78430de15.jpg saved to cache
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a4610>
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_cf3922f3ed5be9f277541aaf5f01dbe8.jpg saved to cache
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667
2026-04-27 07:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667
2026-04-27 07:59:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667 to the API
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:59:51Z',
'fuel_type': 'diesel',
'id': 'e4df26b7-1bc4-56ac-98dc-c299f1a9b702',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT85667',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q5',
'odometer': 280790,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-27',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Advanced edition',
'transmission': 'automatic',
'trim': 'quattro Advanced edition',
'year': 2016}
2026-04-27 07:59:31 [auto1.es] INFO: Saving data for HT85667: {'auction_closing_time': 1777305591.0, 'created_time': 1777020312.212747, 'has_photos': True, 'last_price_update_time': 1777276771.925741}
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_52841be1d0ab0c22d392c672eb57df65.jpg not downloaded yet
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_2ec2728a72c68335f55ae385a6f6eea1.jpg not downloaded yet
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_6762bc3ccea54484e918548aa840ed89.jpg not downloaded yet
2026-04-27 07:59:32 [auto1.es] INFO: Found listing with ID: SU85789
2026-04-27 07:59:32 [auto1.es] INFO: Scrape type for SU85789: 2
2026-04-27 07:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789
2026-04-27 07:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31364266-138b-569b-9e5a-943d3de37e5b with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31364266-138b-569b-9e5a-943d3de37e5b with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31364266-138b-569b-9e5a-943d3de37e5b, identifier: SU85789
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_c3d2e7a4791554024b268a43eba8176c.jpg not downloaded yet
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_4a3126f2838bcef6e5e997b314898976.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_53d6527eff4fd3170f67f85a7951e79f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789
2026-04-27 07:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789
2026-04-27 07:59:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31364266-138b-569b-9e5a-943d3de37e5b with identifier: SU85789 to the API
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-04-27T15:57:47Z',
'fuel_type': 'petrol',
'id': '31364266-138b-569b-9e5a-943d3de37e5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU85789',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mazda',
'model': 'CX-5',
'odometer': 156185,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-07-10',
'seller_name': None,
'title': 'Mazda CX-5 2.0 Style 2WD',
'transmission': 'manual',
'trim': 'Style 2WD',
'year': 2014}
2026-04-27 07:59:32 [auto1.es] INFO: Saving data for SU85789: {'auction_closing_time': 1777305467.0, 'created_time': 1777020665.626404, 'has_photos': True, 'last_price_update_time': 1777276772.702377}
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_5d847a0d8b5462640562b5c28b68fd29.jpg not downloaded yet
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_e1bc18178fc73e362fdbc7eb95160bd8.jpg not downloaded yet
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04868ad90>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_c2ca62ec353f5433bb6db00975379bc1.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c6c10>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_12c289839bcb3eeba5abb486fd6b268f.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:32 [auto1.es] INFO: Found listing with ID: ZA55994
2026-04-27 07:59:32 [auto1.es] INFO: Scrape type for ZA55994: 2
2026-04-27 07:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479 with identifier: ZA55994
2026-04-27 07:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479 with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479 with scrape type 2
2026-04-27 07:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479, identifier: ZA55994
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_af172149acd354af6a333d5b8b4d2c4a.jpg not downloaded yet
2026-04-27 07:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479 with identifier: ZA55994
2026-04-27 07:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479 with identifier: ZA55994
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479 with identifier: ZA55994 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:05:52Z',
'fuel_type': 'diesel',
'id': 'bcdbe2d9-cd7a-5606-a1a5-4e629c9e2479',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA55994',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 93352,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-08-05',
'seller_name': None,
'title': 'Jaguar E-Pace D180 R-Dynamic SE AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic SE AWD',
'year': 2019}
2026-04-27 07:59:33 [auto1.es] INFO: Saving data for ZA55994: {'auction_closing_time': 1777302352.0, 'created_time': 1777020877.257014, 'has_photos': True, 'last_price_update_time': 1777276773.282086}
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_765ef2c8c1ac8c46e46121153a3780d4.jpg not downloaded yet
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f4bfd5ca680fe77e0c1f2f0400c7e00d.jpg not downloaded yet
2026-04-27 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_740621fe3f0bc3b451429d7b9b7a2bf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_ece71e89934d5a764d09675c42612998.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:33 [auto1.es] INFO: Found listing with ID: CC52810
2026-04-27 07:59:33 [auto1.es] INFO: Scrape type for CC52810: 1
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_837d3bcb518c602fd87dbb2f5915fcc6.jpg not downloaded yet
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876bf50>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_4a3126f2838bcef6e5e997b314898976.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870e3d0>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_53d6527eff4fd3170f67f85a7951e79f.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_2ec2728a72c68335f55ae385a6f6eea1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bba3de3844fab4bb20b0f25ea27a6d59.jpg not downloaded yet
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_ab24b6ce2423fe4e2f617e7c7f49437e.jpg not downloaded yet
2026-04-27 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_6762bc3ccea54484e918548aa840ed89.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:33 [auto1.es] INFO: Found listing with ID: TZ15382
2026-04-27 07:59:33 [auto1.es] INFO: Scrape type for TZ15382: 2
2026-04-27 07:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15cc74c5-034a-596d-95fd-3ee89932c545 with identifier: TZ15382
2026-04-27 07:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15cc74c5-034a-596d-95fd-3ee89932c545 with scrape type 2
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15cc74c5-034a-596d-95fd-3ee89932c545 with scrape type 2
2026-04-27 07:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15cc74c5-034a-596d-95fd-3ee89932c545, identifier: TZ15382
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15cc74c5-034a-596d-95fd-3ee89932c545 with identifier: TZ15382
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15cc74c5-034a-596d-95fd-3ee89932c545 with identifier: TZ15382
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15cc74c5-034a-596d-95fd-3ee89932c545 with identifier: TZ15382 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:07:06Z',
'fuel_type': 'diesel',
'id': '15cc74c5-034a-596d-95fd-3ee89932c545',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ15382',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 102937,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-02-26',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport BlueMotion Tech',
'year': 2020}
2026-04-27 07:59:33 [auto1.es] INFO: Saving data for TZ15382: {'auction_closing_time': 1777302426.0, 'created_time': 1777021227.116349, 'has_photos': True, 'last_price_update_time': 1777276773.937896}
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bc64e7d1ece124759994dae26fa0931d.jpg not downloaded yet
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_7ba6b8411c192fd4cc3cda0a1503b346.jpg not downloaded yet
2026-04-27 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS90007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3bc90>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_740621fe3f0bc3b451429d7b9b7a2bf6.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048846610>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_ece71e89934d5a764d09675c42612998.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:34 [auto1.es] INFO: Found listing with ID: XH57732
2026-04-27 07:59:34 [auto1.es] INFO: Scrape type for XH57732: 2
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3 with identifier: XH57732
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3 with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3 with scrape type 2
2026-04-27 07:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3, identifier: XH57732
2026-04-27 07:59:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_e1bc18178fc73e362fdbc7eb95160bd8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_af172149acd354af6a333d5b8b4d2c4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.extensions.logstats] INFO: Crawled 281 pages (at 54 pages/min), scraped 341 items (at 53 items/min)
2026-04-27 07:59:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 378MiB
2026-04-27 07:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3 with identifier: XH57732
2026-04-27 07:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3 with identifier: XH57732
2026-04-27 07:59:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3 with identifier: XH57732 to the API
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-04-27T15:20:09Z',
'fuel_type': 'diesel',
'id': 'aeac812e-7e51-54cb-b2a0-fb6f2bd76dd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH57732',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 64401,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-12-26',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.5 TDI Highline 4Motion',
'transmission': 'manual',
'trim': 'Highline 4Motion',
'year': 2007}
2026-04-27 07:59:34 [auto1.es] INFO: Saving data for XH57732: {'auction_closing_time': 1777303209.0, 'created_time': 1777021097.889366, 'has_photos': True, 'last_price_update_time': 1777276774.553278}
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048930250>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_2ec2728a72c68335f55ae385a6f6eea1.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876b890>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_6762bc3ccea54484e918548aa840ed89.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f4bfd5ca680fe77e0c1f2f0400c7e00d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [auto1.es] INFO: Found listing with ID: NP87805
2026-04-27 07:59:34 [auto1.es] INFO: Scrape type for NP87805: 1
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_837d3bcb518c602fd87dbb2f5915fcc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057361150>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_e1bc18178fc73e362fdbc7eb95160bd8.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209590>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_af172149acd354af6a333d5b8b4d2c4a.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bc64e7d1ece124759994dae26fa0931d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048616550>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f4bfd5ca680fe77e0c1f2f0400c7e00d.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3ab50>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_837d3bcb518c602fd87dbb2f5915fcc6.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bba3de3844fab4bb20b0f25ea27a6d59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485c0950>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bc64e7d1ece124759994dae26fa0931d.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_ab24b6ce2423fe4e2f617e7c7f49437e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_7ba6b8411c192fd4cc3cda0a1503b346.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485821d0>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bba3de3844fab4bb20b0f25ea27a6d59.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048616bd0>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_ab24b6ce2423fe4e2f617e7c7f49437e.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885bd0>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_7ba6b8411c192fd4cc3cda0a1503b346.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_765ef2c8c1ac8c46e46121153a3780d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_5d847a0d8b5462640562b5c28b68fd29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_c3d2e7a4791554024b268a43eba8176c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841e210>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_765ef2c8c1ac8c46e46121153a3780d4.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a441d0>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_5d847a0d8b5462640562b5c28b68fd29.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fe950>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_c3d2e7a4791554024b268a43eba8176c.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_3e50f064656afd97a9ce71754ee2bdca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_52841be1d0ab0c22d392c672eb57df65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485810d0>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_3e50f064656afd97a9ce71754ee2bdca.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048932590>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_52841be1d0ab0c22d392c672eb57df65.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f311789b27718e628412c6ac83f62c59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_8b8c52beec75a6d43b0d64c10be60004.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_1101d7904641001025f94500a74d2751.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485ff510>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f311789b27718e628412c6ac83f62c59.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980490>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_8b8c52beec75a6d43b0d64c10be60004.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a39410>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_1101d7904641001025f94500a74d2751.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS13258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_18c1143f1c3a156e4618bc6c87b4ad5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_36a07d6678a3c84473b9733d139ca5af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a38c90>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_18c1143f1c3a156e4618bc6c87b4ad5b.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF84239> (referer: https://www.auto1.com/v1/car-details-view/BF84239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848f390>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_36a07d6678a3c84473b9733d139ca5af.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG51952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_77c3c83f27112681285a621f44673ea7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50733578-80ee-572c-a852-33fa4fe7ca14 with identifier: BF84239
2026-04-27 07:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50733578-80ee-572c-a852-33fa4fe7ca14 with scrape type 1
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_8b332f4eecdbf313aca87bd8b5fe8b25.jpg not downloaded yet
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2cdfb55267e313fc5b73b722b3d64e4b.jpg not downloaded yet
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_945d350956e4e517d9f4d4ea6d50d71a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_4f8ffecbfdc91727020b831b2ccf8f95.jpg not downloaded yet
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_91b6c951fdb5d1a268f190acc6e484ac.jpg not downloaded yet
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_71b8bd083888b0ba7cf45a0b56470d18.jpg not downloaded yet
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2464e7f7184ffbde218298c1b8c1ac15.jpg not downloaded yet
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484fb890>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_77c3c83f27112681285a621f44673ea7.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_8b332f4eecdbf313aca87bd8b5fe8b25.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fca90>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_945d350956e4e517d9f4d4ea6d50d71a.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_3919f75056855ffbf04f0c185fc46aca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489a1b90>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_8b332f4eecdbf313aca87bd8b5fe8b25.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_449805eb5c693cabeafe96f125568ce3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2464e7f7184ffbde218298c1b8c1ac15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484f9cd0>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_3919f75056855ffbf04f0c185fc46aca.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_91b6c951fdb5d1a268f190acc6e484ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a7390>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_449805eb5c693cabeafe96f125568ce3.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_71b8bd083888b0ba7cf45a0b56470d18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d7210>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2464e7f7184ffbde218298c1b8c1ac15.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887dfd0>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_91b6c951fdb5d1a268f190acc6e484ac.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048845090>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_71b8bd083888b0ba7cf45a0b56470d18.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2cdfb55267e313fc5b73b722b3d64e4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_4f8ffecbfdc91727020b831b2ccf8f95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823ef50>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2cdfb55267e313fc5b73b722b3d64e4b.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887fcd0>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_4f8ffecbfdc91727020b831b2ccf8f95.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50733578-80ee-572c-a852-33fa4fe7ca14
2026-04-27 07:59:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50733578-80ee-572c-a852-33fa4fe7ca14, skipping ID generation
2026-04-27 07:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50733578-80ee-572c-a852-33fa4fe7ca14 with scrape type 1
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50733578-80ee-572c-a852-33fa4fe7ca14 sending to next pipeline
2026-04-27 07:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50733578-80ee-572c-a852-33fa4fe7ca14, identifier: BF84239
2026-04-27 07:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50733578-80ee-572c-a852-33fa4fe7ca14 with identifier: BF84239
2026-04-27 07:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50733578-80ee-572c-a852-33fa4fe7ca14 with identifier: BF84239
2026-04-27 07:59:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50733578-80ee-572c-a852-33fa4fe7ca14 with identifier: BF84239 to the API
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_4f8ffecbfdc91727020b831b2ccf8f95.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.1L',
'engine_horse_power': 63,
'expiration_date': '2026-04-27T15:02:39Z',
'fuel_type': 'petrol',
'id': '50733578-80ee-572c-a852-33fa4fe7ca14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF84239',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Hyundai',
'model': 'Getz',
'odometer': 156360,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_8b332f4eecdbf313aca87bd8b5fe8b25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2cdfb55267e313fc5b73b722b3d64e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_4f8ffecbfdc91727020b831b2ccf8f95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_91b6c951fdb5d1a268f190acc6e484ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_71b8bd083888b0ba7cf45a0b56470d18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_50733578-80ee-572c-a852-33fa4fe7ca14/50733578-80ee-572c-a852-33fa4fe7ca14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/21/71213669acfe059ccc74c2154ebea693/pa/BF84239_2464e7f7184ffbde218298c1b8c1ac15.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2004-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Getz 1.1 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2004}
2026-04-27 07:59:37 [auto1.es] INFO: Saving data for BF84239: {'created_time': 1777276777.699706, 'last_price_update_time': 1777276777.699716, 'has_photos': True, 'auction_closing_time': 1777302159.0}
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_9c5e2eba2a43eb337239b4c839234c81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_b5834ba1ecb11fd3169b1dd400e4317c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887eed0>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_9c5e2eba2a43eb337239b4c839234c81.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a65d0>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_b5834ba1ecb11fd3169b1dd400e4317c.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_925f3c5a469ef54318978bbbd753a68c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f6a48b72ffb9eb56bbd158edc3605515.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d4650>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_925f3c5a469ef54318978bbbd753a68c.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_10204b0cbad3a58eeda712a12a76f624.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fc990>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f6a48b72ffb9eb56bbd158edc3605515.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bbd70e458ad73bbf83954aaa1051adcf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887dfd0>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_10204b0cbad3a58eeda712a12a76f624.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4
2026-04-27 07:59:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5d234b9-87a1-5977-aa7f-8c6a754b27b4, skipping ID generation
2026-04-27 07:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4 with scrape type 1
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5d234b9-87a1-5977-aa7f-8c6a754b27b4 sending to next pipeline
2026-04-27 07:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b5d234b9-87a1-5977-aa7f-8c6a754b27b4, identifier: RC86632
2026-04-27 07:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b5d234b9-87a1-5977-aa7f-8c6a754b27b4 with identifier: RC86632
2026-04-27 07:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b5d234b9-87a1-5977-aa7f-8c6a754b27b4 with identifier: RC86632
2026-04-27 07:59:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b5d234b9-87a1-5977-aa7f-8c6a754b27b4 with identifier: RC86632 to the API
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_10204b0cbad3a58eeda712a12a76f624.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:34:47Z',
'fuel_type': 'diesel',
'id': 'b5d234b9-87a1-5977-aa7f-8c6a754b27b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC86632',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'BMW',
'model': '4er',
'odometer': 216246,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_10204b0cbad3a58eeda712a12a76f624.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f6a48b72ffb9eb56bbd158edc3605515.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_53d6527eff4fd3170f67f85a7951e79f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_36a07d6678a3c84473b9733d139ca5af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f311789b27718e628412c6ac83f62c59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_6762bc3ccea54484e918548aa840ed89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_e1bc18178fc73e362fdbc7eb95160bd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_f4bfd5ca680fe77e0c1f2f0400c7e00d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_ab24b6ce2423fe4e2f617e7c7f49437e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5d234b9-87a1-5977-aa7f-8c6a754b27b4/b5d234b9-87a1-5977-aa7f-8c6a754b27b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/50/6050601ac91f74c54814544370faa1f4/pa/RC86632_7ba6b8411c192fd4cc3cda0a1503b346.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 4er 420d Gran Coupé xDrive',
'transmission': 'manual',
'trim': 'xDrive',
'year': 2015}
2026-04-27 07:59:38 [auto1.es] INFO: Saving data for RC86632: {'created_time': 1777276778.652173, 'last_price_update_time': 1777276778.652186, 'has_photos': True, 'auction_closing_time': 1777304087.0}
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_810634e660c6066f2f1d9adad33fdfe8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_685e1de5bcad751cc279b7a8e2296f44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057226ed0>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bbd70e458ad73bbf83954aaa1051adcf.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1a1464c-1aaf-5355-84b0-5d5b692ee265
2026-04-27 07:59:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1a1464c-1aaf-5355-84b0-5d5b692ee265, skipping ID generation
2026-04-27 07:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a1464c-1aaf-5355-84b0-5d5b692ee265 with scrape type 1
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1a1464c-1aaf-5355-84b0-5d5b692ee265 sending to next pipeline
2026-04-27 07:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1a1464c-1aaf-5355-84b0-5d5b692ee265, identifier: XU70286
2026-04-27 07:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1a1464c-1aaf-5355-84b0-5d5b692ee265 with identifier: XU70286
2026-04-27 07:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1a1464c-1aaf-5355-84b0-5d5b692ee265 with identifier: XU70286
2026-04-27 07:59:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1a1464c-1aaf-5355-84b0-5d5b692ee265 with identifier: XU70286 to the API
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bbd70e458ad73bbf83954aaa1051adcf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:32:24Z',
'fuel_type': 'petrol',
'id': 'd1a1464c-1aaf-5355-84b0-5d5b692ee265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU70286',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 105004,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bbd70e458ad73bbf83954aaa1051adcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_925f3c5a469ef54318978bbbd753a68c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_3919f75056855ffbf04f0c185fc46aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_18c1143f1c3a156e4618bc6c87b4ad5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_8b8c52beec75a6d43b0d64c10be60004.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_2ec2728a72c68335f55ae385a6f6eea1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_5d847a0d8b5462640562b5c28b68fd29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_765ef2c8c1ac8c46e46121153a3780d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bba3de3844fab4bb20b0f25ea27a6d59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d1a1464c-1aaf-5355-84b0-5d5b692ee265/d1a1464c-1aaf-5355-84b0-5d5b692ee265_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/5e/eb5e7f0c86235f02d2ed0774ca42a16b/pa/XU70286_bc64e7d1ece124759994dae26fa0931d.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-03-12',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.2 PureTech First',
'transmission': 'manual',
'trim': 'First',
'year': 2017}
2026-04-27 07:59:39 [auto1.es] INFO: Saving data for XU70286: {'created_time': 1777276779.161495, 'last_price_update_time': 1777276779.161508, 'has_photos': True, 'auction_closing_time': 1777303944.0}
2026-04-27 07:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_597d3fc0be218725c87bbc733a4f657c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048165710>
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_810634e660c6066f2f1d9adad33fdfe8.jpg saved to cache
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870e9d0>
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_685e1de5bcad751cc279b7a8e2296f44.jpg saved to cache
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_f328716f6c680ed3b6a208b5ae9a88ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ca590>
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_597d3fc0be218725c87bbc733a4f657c.jpg saved to cache
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8d84837-49fc-5a55-a5fc-cebb8985ac17
2026-04-27 07:59:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8d84837-49fc-5a55-a5fc-cebb8985ac17, skipping ID generation
2026-04-27 07:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d84837-49fc-5a55-a5fc-cebb8985ac17 with scrape type 1
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8d84837-49fc-5a55-a5fc-cebb8985ac17 sending to next pipeline
2026-04-27 07:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8d84837-49fc-5a55-a5fc-cebb8985ac17, identifier: DE32472
2026-04-27 07:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472
2026-04-27 07:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472
2026-04-27 07:59:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472 to the API
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_597d3fc0be218725c87bbc733a4f657c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'A Cañiza Pontevedra',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:33:45Z',
'fuel_type': 'diesel',
'id': 'c8d84837-49fc-5a55-a5fc-cebb8985ac17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE32472',
'listing': 'auction',
'location': 'ES, A Cañiza Pontevedra',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '5er',
'odometer': 330064,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_647f2148c4a8a33067d5e7e78430de15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_597d3fc0be218725c87bbc733a4f657c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_12c289839bcb3eeba5abb486fd6b268f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_4a3126f2838bcef6e5e997b314898976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_945d350956e4e517d9f4d4ea6d50d71a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_ece71e89934d5a764d09675c42612998.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_3e50f064656afd97a9ce71754ee2bdca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_c3d2e7a4791554024b268a43eba8176c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_af172149acd354af6a333d5b8b4d2c4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8d84837-49fc-5a55-a5fc-cebb8985ac17/c8d84837-49fc-5a55-a5fc-cebb8985ac17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3c/0e3c429b4f648a9c6bf5a909ecc30985/pa/DE32472_837d3bcb518c602fd87dbb2f5915fcc6.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 07:59:39 [auto1.es] INFO: Saving data for DE32472: {'created_time': 1777276779.867336, 'last_price_update_time': 1777276779.867346, 'has_photos': True, 'auction_closing_time': 1777304025.0}
2026-04-27 07:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_044e5f33cb2778af8bf0ca9f070fdf75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_42343857c2fa78655f61f52af23431ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e3f10>
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_f328716f6c680ed3b6a208b5ae9a88ca.jpg saved to cache
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048583050>
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_044e5f33cb2778af8bf0ca9f070fdf75.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ef3d6d2-b6c6-55b3-9016-088794133529
2026-04-27 07:59:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ef3d6d2-b6c6-55b3-9016-088794133529, skipping ID generation
2026-04-27 07:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ef3d6d2-b6c6-55b3-9016-088794133529 with scrape type 1
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ef3d6d2-b6c6-55b3-9016-088794133529 sending to next pipeline
2026-04-27 07:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4ef3d6d2-b6c6-55b3-9016-088794133529, identifier: ER40714
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823eb10>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_42343857c2fa78655f61f52af23431ce.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833
2026-04-27 07:59:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833, skipping ID generation
2026-04-27 07:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 with scrape type 1
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 sending to next pipeline
2026-04-27 07:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833, identifier: WX82700
2026-04-27 07:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4ef3d6d2-b6c6-55b3-9016-088794133529 with identifier: ER40714
2026-04-27 07:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4ef3d6d2-b6c6-55b3-9016-088794133529 with identifier: ER40714
2026-04-27 07:59:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4ef3d6d2-b6c6-55b3-9016-088794133529 with identifier: ER40714 to the API
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_044e5f33cb2778af8bf0ca9f070fdf75.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-04-27T15:12:00Z',
'fuel_type': 'diesel',
'id': '4ef3d6d2-b6c6-55b3-9016-088794133529',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER40714',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Citroen',
'model': 'C4',
'odometer': 154453,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_5d282942f6c1c41cca4020a3190d3429.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_a8c3db168203ffc02f8f3f1e47a4d1ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_8fb4aeb0a5e9f04b0b9a70f39e0667d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_0cf39401f74d9ea9220f0b6844838740.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_044e5f33cb2778af8bf0ca9f070fdf75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_f328716f6c680ed3b6a208b5ae9a88ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_c2ca62ec353f5433bb6db00975379bc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_b5834ba1ecb11fd3169b1dd400e4317c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_449805eb5c693cabeafe96f125568ce3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ef3d6d2-b6c6-55b3-9016-088794133529/4ef3d6d2-b6c6-55b3-9016-088794133529_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/37/4037a620ac76ffcdcdd126333bddfe70/pa/ER40714_740621fe3f0bc3b451429d7b9b7a2bf6.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2015}
2026-04-27 07:59:40 [auto1.es] INFO: Saving data for ER40714: {'created_time': 1777276780.64559, 'last_price_update_time': 1777276780.645601, 'has_photos': True, 'auction_closing_time': 1777302720.0}
2026-04-27 07:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 with identifier: WX82700
2026-04-27 07:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 with identifier: WX82700
2026-04-27 07:59:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b17a48f-03c4-55a5-a0cc-f7c91fcd8833 with identifier: WX82700 to the API
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_42343857c2fa78655f61f52af23431ce.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Barcelona',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:00:01Z',
'fuel_type': 'diesel',
'id': '9b17a48f-03c4-55a5-a0cc-f7c91fcd8833',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX82700',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 127312,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_ebab33726f826a6e875de4490600e94f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_30fcf223b514f9820d4ab36d2ba10d2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_42343857c2fa78655f61f52af23431ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_cf3922f3ed5be9f277541aaf5f01dbe8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_685e1de5bcad751cc279b7a8e2296f44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_810634e660c6066f2f1d9adad33fdfe8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_9c5e2eba2a43eb337239b4c839234c81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_77c3c83f27112681285a621f44673ea7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_1101d7904641001025f94500a74d2751.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b17a48f-03c4-55a5-a0cc-f7c91fcd8833/9b17a48f-03c4-55a5-a0cc-f7c91fcd8833_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/58/5a58cd0fa15677cf5f49c3a904c1fcb2/pa/WX82700_52841be1d0ab0c22d392c672eb57df65.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2018-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Basis 2WD',
'transmission': 'automatic',
'trim': 'Basis 2WD',
'year': 2018}
2026-04-27 07:59:40 [auto1.es] INFO: Saving data for WX82700: {'created_time': 1777276780.973163, 'last_price_update_time': 1777276780.973176, 'has_photos': True, 'auction_closing_time': 1777302001.0}
2026-04-27 07:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_d875323a3cde7594ed045b88acd72d58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_b00c1496a7baca1035298f4188f3d57c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048698190>
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_d875323a3cde7594ed045b88acd72d58.jpg saved to cache
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d59d0>
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_b00c1496a7baca1035298f4188f3d57c.jpg saved to cache
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_db1924f4b7679f3ab72b61186532f2ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a1c10>
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_db1924f4b7679f3ab72b61186532f2ff.jpg saved to cache
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68
2026-04-27 07:59:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99ad6b35-ae9c-53b9-8ff9-6a858b744e68, skipping ID generation
2026-04-27 07:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 with scrape type 1
2026-04-27 07:59:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 sending to next pipeline
2026-04-27 07:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 99ad6b35-ae9c-53b9-8ff9-6a858b744e68, identifier: HV86151
2026-04-27 07:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 with identifier: HV86151
2026-04-27 07:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 with identifier: HV86151
2026-04-27 07:59:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 99ad6b35-ae9c-53b9-8ff9-6a858b744e68 with identifier: HV86151 to the API
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_db1924f4b7679f3ab72b61186532f2ff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'city': 'Pedrola',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:52:02Z',
'fuel_type': 'petrol',
'id': '99ad6b35-ae9c-53b9-8ff9-6a858b744e68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV86151',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Ford',
'model': 'Focus',
'odometer': 126825,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e377b63e6afcbc130b7419ac83849e99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_8486aea529e972301e6b96fcc87cd56f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_72f3f071fb4546edf94142e54a351c55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_0136c35f276422580d22497422ba16ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_e49b6a229bd412d4e918a608f15b218c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_3034add9d904a60b4d2dc21c695be562.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_6eb3b0cc98e572b987d08f5a39e80eab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_db1924f4b7679f3ab72b61186532f2ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_d875323a3cde7594ed045b88acd72d58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_99ad6b35-ae9c-53b9-8ff9-6a858b744e68/99ad6b35-ae9c-53b9-8ff9-6a858b744e68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/12/29124700af7187208787f03ca5c933a3/pa/HV86151_b00c1496a7baca1035298f4188f3d57c.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2015-08-04',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-04-27 07:59:41 [auto1.es] INFO: Saving data for HV86151: {'created_time': 1777276781.814177, 'last_price_update_time': 1777276781.814189, 'has_photos': True, 'auction_closing_time': 1777305122.0}
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY31603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM79142> (referer: https://www.auto1.com/v1/car-details-view/RM79142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_b4219ac56d3ee7a5d0d3a0930819e175.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21733316-025e-5947-8f6f-af33d9a27768 with identifier: RM79142
2026-04-27 07:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21733316-025e-5947-8f6f-af33d9a27768 with scrape type 1
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f83d61eb106e2e6928036cedbc1e256d.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75e048a64edbee51e7a92da7e490b921.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_4644d1c660f2718b6028160d846bf1e8.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f5a1eb3352c0d82b9a1e6fddcb033e03.jpg not downloaded yet
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048844d10>
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_b4219ac56d3ee7a5d0d3a0930819e175.jpg saved to cache
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_9c098ccb1a905131ba495afe6e34742e.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75f2670eb44a5e3f28e72d5764ea6d19.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_100f93019d19d9879d2ceb4b15996f64.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_076acb0c932b669a747fe0bfb8c4ba09.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_334aa5ff29a1477938ef82762f7eed0a.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_0a96c73d4b1cdefd4eb0455d477d9548.jpg not downloaded yet
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY79472> (referer: https://www.auto1.com/v1/car-details-view/XY79472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_0a96c73d4b1cdefd4eb0455d477d9548.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 with identifier: XY79472
2026-04-27 07:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 with scrape type 1
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_c0d4f747e209381f937edd5f01b4b273.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_f27ec23a1c74ce4e6b1565e14eb1b631.jpg not downloaded yet
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_334aa5ff29a1477938ef82762f7eed0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_9882d7cd0ddfdb7cab911d4ed233dc7a.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_60b7bf210448d6718c40f6a8650b9889.jpg not downloaded yet
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF88454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_afcebd3462041aa717d647135e51b440.jpg not downloaded yet
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_ed70e0644a977bf64745066fdc63fb4f.jpg not downloaded yet
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048419450>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_0a96c73d4b1cdefd4eb0455d477d9548.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870f4d0>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_334aa5ff29a1477938ef82762f7eed0a.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_f27ec23a1c74ce4e6b1565e14eb1b631.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_60b7bf210448d6718c40f6a8650b9889.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048930a90>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_f27ec23a1c74ce4e6b1565e14eb1b631.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fe0d0>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_60b7bf210448d6718c40f6a8650b9889.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP87805/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_ed70e0644a977bf64745066fdc63fb4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823ecd0>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_ed70e0644a977bf64745066fdc63fb4f.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_9882d7cd0ddfdb7cab911d4ed233dc7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_afcebd3462041aa717d647135e51b440.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_c0d4f747e209381f937edd5f01b4b273.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048878290>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_9882d7cd0ddfdb7cab911d4ed233dc7a.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848f5d0>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_afcebd3462041aa717d647135e51b440.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_076acb0c932b669a747fe0bfb8c4ba09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d4b10>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_c0d4f747e209381f937edd5f01b4b273.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578
2026-04-27 07:59:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578, skipping ID generation
2026-04-27 07:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 with scrape type 1
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 sending to next pipeline
2026-04-27 07:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578, identifier: XY79472
2026-04-27 07:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 with identifier: XY79472
2026-04-27 07:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 with identifier: XY79472
2026-04-27 07:59:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 001bbdeb-c3b5-5bd1-b63e-ffcd55f46578 with identifier: XY79472 to the API
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_c0d4f747e209381f937edd5f01b4b273.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Caldes De Malavella',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:11:05Z',
'fuel_type': 'petrol',
'id': '001bbdeb-c3b5-5bd1-b63e-ffcd55f46578',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7743,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY79472',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'location_confidence': 'geocoded',
'longitude': 2.6451,
'make': 'Fiat',
'model': 'Idea',
'odometer': 209430,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_c0d4f747e209381f937edd5f01b4b273.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_f27ec23a1c74ce4e6b1565e14eb1b631.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_9882d7cd0ddfdb7cab911d4ed233dc7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_60b7bf210448d6718c40f6a8650b9889.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_afcebd3462041aa717d647135e51b440.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_001bbdeb-c3b5-5bd1-b63e-ffcd55f46578/001bbdeb-c3b5-5bd1-b63e-ffcd55f46578_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/24/78246da129cb59f7bd40580d5747b89a/pa/XY79472_ed70e0644a977bf64745066fdc63fb4f.jpg',
'Width': 800}],
'postal_code': '17455',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2004-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Idea 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2004}
2026-04-27 07:59:50 [auto1.es] INFO: Saving data for XY79472: {'created_time': 1777276790.71265, 'last_price_update_time': 1777276790.712661, 'has_photos': True, 'auction_closing_time': 1777302665.0}
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_100f93019d19d9879d2ceb4b15996f64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e3c10>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_076acb0c932b669a747fe0bfb8c4ba09.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75f2670eb44a5e3f28e72d5764ea6d19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823cc90>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_100f93019d19d9879d2ceb4b15996f64.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_9c098ccb1a905131ba495afe6e34742e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6c90>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75f2670eb44a5e3f28e72d5764ea6d19.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f5a1eb3352c0d82b9a1e6fddcb033e03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822b950>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_9c098ccb1a905131ba495afe6e34742e.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_4644d1c660f2718b6028160d846bf1e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6b10>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f5a1eb3352c0d82b9a1e6fddcb033e03.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822ae10>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_4644d1c660f2718b6028160d846bf1e8.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75e048a64edbee51e7a92da7e490b921.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f83d61eb106e2e6928036cedbc1e256d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823d2d0>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75e048a64edbee51e7a92da7e490b921.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR50800/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e3910>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f83d61eb106e2e6928036cedbc1e256d.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21733316-025e-5947-8f6f-af33d9a27768
2026-04-27 07:59:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21733316-025e-5947-8f6f-af33d9a27768, skipping ID generation
2026-04-27 07:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21733316-025e-5947-8f6f-af33d9a27768 with scrape type 1
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21733316-025e-5947-8f6f-af33d9a27768 sending to next pipeline
2026-04-27 07:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 21733316-025e-5947-8f6f-af33d9a27768, identifier: RM79142
2026-04-27 07:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 21733316-025e-5947-8f6f-af33d9a27768 with identifier: RM79142
2026-04-27 07:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 21733316-025e-5947-8f6f-af33d9a27768 with identifier: RM79142
2026-04-27 07:59:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 21733316-025e-5947-8f6f-af33d9a27768 with identifier: RM79142 to the API
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f83d61eb106e2e6928036cedbc1e256d.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:53:26Z',
'fuel_type': 'diesel',
'id': '21733316-025e-5947-8f6f-af33d9a27768',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM79142',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 140436,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f83d61eb106e2e6928036cedbc1e256d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75e048a64edbee51e7a92da7e490b921.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_4644d1c660f2718b6028160d846bf1e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_f5a1eb3352c0d82b9a1e6fddcb033e03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_9c098ccb1a905131ba495afe6e34742e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_75f2670eb44a5e3f28e72d5764ea6d19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_100f93019d19d9879d2ceb4b15996f64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_076acb0c932b669a747fe0bfb8c4ba09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_334aa5ff29a1477938ef82762f7eed0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21733316-025e-5947-8f6f-af33d9a27768/21733316-025e-5947-8f6f-af33d9a27768_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/93/9593cc6a7e2064748195a9dac0d333c4/pa/RM79142_0a96c73d4b1cdefd4eb0455d477d9548.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2012-02-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2012}
2026-04-27 07:59:51 [auto1.es] INFO: Saving data for RM79142: {'created_time': 1777276791.883986, 'last_price_update_time': 1777276791.884, 'has_photos': True, 'auction_closing_time': 1777305206.0}
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_917fbbbcc5566f4f327e54c9152b0d76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC52810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048250c50>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_917fbbbcc5566f4f327e54c9152b0d76.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS90007> (referer: https://www.auto1.com/v1/car-details-view/CS90007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac523e38-455e-51b3-a2db-ce468b614076 with identifier: CS90007
2026-04-27 07:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac523e38-455e-51b3-a2db-ce468b614076 with scrape type 1
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_ec05a838eb479fc63e862b93e3c2afce.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_a81ce05a8f64a3c0a3cb93a71edb45b8.jpg not downloaded yet
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_0f773f230c918ad596fc373647561d51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_39794af202cce9590d6113bfd5d201e2.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_45d9768948953546600b381a2cbf0bae.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_62293d2d19a6ed4957fe24c8e3b7fea9.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_03c05ff32ae3e994e20e8bf351504518.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_079c3ef8d17b154ecfade73a69802b5e.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_83e19a081b3e1ab4024b1388ddf8d896.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_853881d82cd8a02b391f79c49925e702.jpg not downloaded yet
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c9b90>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_0f773f230c918ad596fc373647561d51.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_ec05a838eb479fc63e862b93e3c2afce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_e29bc87059aa705cbe156f713290955f.jpg not downloaded yet
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980550>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_ec05a838eb479fc63e862b93e3c2afce.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_853881d82cd8a02b391f79c49925e702.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887af90>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_853881d82cd8a02b391f79c49925e702.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS13258> (referer: https://www.auto1.com/v1/car-details-view/XS13258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d3ae55-6191-5e3a-bcf7-9664a342bd59 with identifier: XS13258
2026-04-27 07:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59 with scrape type 1
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_c454a38a3190ed45554bc3f10b641344.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_e192d57b5ae0d4cb9ec31cd3586c0da9.jpg not downloaded yet
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_e29bc87059aa705cbe156f713290955f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_6f293641d70c141ca992baea412e13d9.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_701bb042d2d266f3399293a5a0114203.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_36f60eea515cd30f1b8047c3390905fa.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_89575994c58635bff36749eea021b81e.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_736035361c10aa996e11c5098ff003f0.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_825de49bc76ca5dc5d81d0f897456b75.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_231c3ff8add5d69ee7bfc98a61cbd346.jpg not downloaded yet
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_83e19a081b3e1ab4024b1388ddf8d896.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_29cff9b1b9085550c3e03e1e525bda7a.jpg not downloaded yet
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048844490>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_e29bc87059aa705cbe156f713290955f.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ44927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cbd10>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_83e19a081b3e1ab4024b1388ddf8d896.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_e192d57b5ae0d4cb9ec31cd3586c0da9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_825de49bc76ca5dc5d81d0f897456b75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e1cd0>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_e192d57b5ae0d4cb9ec31cd3586c0da9.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_29cff9b1b9085550c3e03e1e525bda7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_231c3ff8add5d69ee7bfc98a61cbd346.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048847890>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_825de49bc76ca5dc5d81d0f897456b75.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_736035361c10aa996e11c5098ff003f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_89575994c58635bff36749eea021b81e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX98366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931390>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_29cff9b1b9085550c3e03e1e525bda7a.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834ead0>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_231c3ff8add5d69ee7bfc98a61cbd346.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484fb8d0>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_736035361c10aa996e11c5098ff003f0.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048166810>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_89575994c58635bff36749eea021b81e.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_36f60eea515cd30f1b8047c3390905fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_6f293641d70c141ca992baea412e13d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_701bb042d2d266f3399293a5a0114203.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048580a90>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_36f60eea515cd30f1b8047c3390905fa.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_c454a38a3190ed45554bc3f10b641344.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_079c3ef8d17b154ecfade73a69802b5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a47150>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_6f293641d70c141ca992baea412e13d9.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY31603> (referer: https://www.auto1.com/v1/car-details-view/VY31603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e2590>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_701bb042d2d266f3399293a5a0114203.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_62293d2d19a6ed4957fe24c8e3b7fea9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_03c05ff32ae3e994e20e8bf351504518.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT91769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048501e10>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_c454a38a3190ed45554bc3f10b641344.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59
2026-04-27 07:59:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85d3ae55-6191-5e3a-bcf7-9664a342bd59, skipping ID generation
2026-04-27 07:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59 with scrape type 1
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85d3ae55-6191-5e3a-bcf7-9664a342bd59 sending to next pipeline
2026-04-27 07:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85d3ae55-6191-5e3a-bcf7-9664a342bd59, identifier: XS13258
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048503b50>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_079c3ef8d17b154ecfade73a69802b5e.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85d3ae55-6191-5e3a-bcf7-9664a342bd59 with identifier: XS13258
2026-04-27 07:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85d3ae55-6191-5e3a-bcf7-9664a342bd59 with identifier: XS13258
2026-04-27 07:59:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 85d3ae55-6191-5e3a-bcf7-9664a342bd59 with identifier: XS13258 to the API
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_c454a38a3190ed45554bc3f10b641344.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:21:58Z',
'fuel_type': 'diesel',
'id': '85d3ae55-6191-5e3a-bcf7-9664a342bd59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS13258',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Honda',
'model': 'CR-V',
'odometer': 195354,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_c454a38a3190ed45554bc3f10b641344.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_e192d57b5ae0d4cb9ec31cd3586c0da9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_6f293641d70c141ca992baea412e13d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_701bb042d2d266f3399293a5a0114203.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_36f60eea515cd30f1b8047c3390905fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_89575994c58635bff36749eea021b81e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_736035361c10aa996e11c5098ff003f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_825de49bc76ca5dc5d81d0f897456b75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_231c3ff8add5d69ee7bfc98a61cbd346.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_85d3ae55-6191-5e3a-bcf7-9664a342bd59/85d3ae55-6191-5e3a-bcf7-9664a342bd59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/55/45554a2dac0f0b0b02acbad229531315/pa/XS13258_29cff9b1b9085550c3e03e1e525bda7a.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2014-04-15',
'seats_number': 5,
'seller_name': None,
'title': 'Honda CR-V 2.2 DTEC Lifestyle 4WD',
'transmission': 'manual',
'trim': 'Lifestyle 4WD',
'year': 2014}
2026-04-27 07:59:54 [auto1.es] INFO: Saving data for XS13258: {'created_time': 1777276794.743823, 'last_price_update_time': 1777276794.743832, 'has_photos': True, 'auction_closing_time': 1777303318.0}
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_45d9768948953546600b381a2cbf0bae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603
2026-04-27 07:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e8f1d8-f774-515b-a507-9f924db61ad2 with scrape type 1
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67687d3ae0ebbbb5a58de3921084c79f.jpg not downloaded yet
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048845810>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_62293d2d19a6ed4957fe24c8e3b7fea9.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484dee10>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_03c05ff32ae3e994e20e8bf351504518.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_0432730e506bac41d1ad8077da0fd7c7.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_207af69dc41c0b7d710ce70d53b0d400.jpg not downloaded yet
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c2bd0>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_45d9768948953546600b381a2cbf0bae.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_e718d1c8c9487c577668a89b077d0f42.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_7192d464e3a501f544770d4e21f8e8ce.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_8f6ecac8fb519eb2c4d5a50ceb6f2785.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_ddb624d456f05289478d716a4a005588.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_f3457279eef71ba0ee4061c6ea347731.jpg not downloaded yet
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_39794af202cce9590d6113bfd5d201e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_80169fb735fe91a6eb34a5ccb026d683.jpg not downloaded yet
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_a81ce05a8f64a3c0a3cb93a71edb45b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67f6147c7f215df1193cb6c0449a0bc6.jpg not downloaded yet
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048855690>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_39794af202cce9590d6113bfd5d201e2.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c1110>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_a81ce05a8f64a3c0a3cb93a71edb45b8.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac523e38-455e-51b3-a2db-ce468b614076
2026-04-27 07:59:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac523e38-455e-51b3-a2db-ce468b614076, skipping ID generation
2026-04-27 07:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac523e38-455e-51b3-a2db-ce468b614076 with scrape type 1
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac523e38-455e-51b3-a2db-ce468b614076 sending to next pipeline
2026-04-27 07:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac523e38-455e-51b3-a2db-ce468b614076, identifier: CS90007
2026-04-27 07:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac523e38-455e-51b3-a2db-ce468b614076 with identifier: CS90007
2026-04-27 07:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac523e38-455e-51b3-a2db-ce468b614076 with identifier: CS90007
2026-04-27 07:59:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ac523e38-455e-51b3-a2db-ce468b614076 with identifier: CS90007 to the API
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_a81ce05a8f64a3c0a3cb93a71edb45b8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:26:25Z',
'fuel_type': 'diesel',
'id': 'ac523e38-455e-51b3-a2db-ce468b614076',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS90007',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Peugeot',
'model': '3008',
'odometer': 162882,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_ec05a838eb479fc63e862b93e3c2afce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_a81ce05a8f64a3c0a3cb93a71edb45b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_39794af202cce9590d6113bfd5d201e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_45d9768948953546600b381a2cbf0bae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_62293d2d19a6ed4957fe24c8e3b7fea9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_03c05ff32ae3e994e20e8bf351504518.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_079c3ef8d17b154ecfade73a69802b5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_83e19a081b3e1ab4024b1388ddf8d896.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_853881d82cd8a02b391f79c49925e702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac523e38-455e-51b3-a2db-ce468b614076/ac523e38-455e-51b3-a2db-ce468b614076_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/1c/191c3fecc685e36421ffff5078b7d8ef/pa/CS90007_e29bc87059aa705cbe156f713290955f.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2020-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-04-27 07:59:55 [auto1.es] INFO: Saving data for CS90007: {'created_time': 1777276795.639179, 'last_price_update_time': 1777276795.639193, 'has_photos': True, 'auction_closing_time': 1777303585.0}
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_ddb624d456f05289478d716a4a005588.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_80169fb735fe91a6eb34a5ccb026d683.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834d310>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_ddb624d456f05289478d716a4a005588.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869fc50>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_80169fb735fe91a6eb34a5ccb026d683.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_f3457279eef71ba0ee4061c6ea347731.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67f6147c7f215df1193cb6c0449a0bc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_8f6ecac8fb519eb2c4d5a50ceb6f2785.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_7192d464e3a501f544770d4e21f8e8ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048695050>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_f3457279eef71ba0ee4061c6ea347731.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048591410>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67f6147c7f215df1193cb6c0449a0bc6.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485d9dd0>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_8f6ecac8fb519eb2c4d5a50ceb6f2785.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3fed0>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_7192d464e3a501f544770d4e21f8e8ce.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_e718d1c8c9487c577668a89b077d0f42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_207af69dc41c0b7d710ce70d53b0d400.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG51952> (referer: https://www.auto1.com/v1/car-details-view/FG51952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0576834d0>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_e718d1c8c9487c577668a89b077d0f42.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483de490>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_207af69dc41c0b7d710ce70d53b0d400.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0819419-f794-59d8-aaa4-0d9cc87d4ddc with identifier: FG51952
2026-04-27 07:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc with scrape type 1
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_61f856c3d2ee1b502437481bfb6f4a7d.jpg not downloaded yet
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_0432730e506bac41d1ad8077da0fd7c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_543a09e722f53e8265df90f33498ce70.jpg not downloaded yet
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67687d3ae0ebbbb5a58de3921084c79f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_9abcfd2a830058d781b68264bc2345c5.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_470bbd2dbd3887bef812045d124ae4e7.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_b81bd4cbb0a6ce6114fa8af170e9aac2.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_db77c7ae1bb61548eccc7914a0a568de.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_ca304f3bc973fac821efd36ef6f19f03.jpg not downloaded yet
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_c0baa8f4115b76f42bbc3285fc89705b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_fc7d6fbd9023c03298e5a9804d50475d.jpg not downloaded yet
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04839bfd0>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_0432730e506bac41d1ad8077da0fd7c7.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_f4b85e9103360f22d0f3549993d8423b.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_17006d97c268df3825e9be70a5d08a2e.jpg not downloaded yet
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841f310>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67687d3ae0ebbbb5a58de3921084c79f.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7e8f1d8-f774-515b-a507-9f924db61ad2
2026-04-27 07:59:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7e8f1d8-f774-515b-a507-9f924db61ad2, skipping ID generation
2026-04-27 07:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e8f1d8-f774-515b-a507-9f924db61ad2 with scrape type 1
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7e8f1d8-f774-515b-a507-9f924db61ad2 sending to next pipeline
2026-04-27 07:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7e8f1d8-f774-515b-a507-9f924db61ad2, identifier: VY31603
2026-04-27 07:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603
2026-04-27 07:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603
2026-04-27 07:59:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7e8f1d8-f774-515b-a507-9f924db61ad2 with identifier: VY31603 to the API
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67687d3ae0ebbbb5a58de3921084c79f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Campo Real',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:06:47Z',
'fuel_type': 'diesel',
'id': 'e7e8f1d8-f774-515b-a507-9f924db61ad2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY31603',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'Isuzu',
'model': 'D-MAX',
'odometer': 47591,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67687d3ae0ebbbb5a58de3921084c79f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_0432730e506bac41d1ad8077da0fd7c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_207af69dc41c0b7d710ce70d53b0d400.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_e718d1c8c9487c577668a89b077d0f42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_7192d464e3a501f544770d4e21f8e8ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_8f6ecac8fb519eb2c4d5a50ceb6f2785.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_ddb624d456f05289478d716a4a005588.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_f3457279eef71ba0ee4061c6ea347731.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_80169fb735fe91a6eb34a5ccb026d683.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7e8f1d8-f774-515b-a507-9f924db61ad2/e7e8f1d8-f774-515b-a507-9f924db61ad2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828270aa894721edad392438795a579/pa/VY31603_67f6147c7f215df1193cb6c0449a0bc6.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2023-07-31',
'seats_number': 4,
'seller_name': None,
'title': 'Isuzu D-MAX 1.9 Turbodiesel Space Cab 4WD L',
'transmission': 'manual',
'trim': 'Space Cab 4WD L',
'year': 2023}
2026-04-27 07:59:57 [auto1.es] INFO: Saving data for VY31603: {'created_time': 1777276797.166149, 'last_price_update_time': 1777276797.166162, 'has_photos': True, 'auction_closing_time': 1777302407.0}
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_ca304f3bc973fac821efd36ef6f19f03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_543a09e722f53e8265df90f33498ce70.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK42012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP87805> (referer: https://www.auto1.com/v1/car-details-view/NP87805/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484f9350>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_c0baa8f4115b76f42bbc3285fc89705b.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 407cf447-15dc-5b26-8e6b-df9f385d81b6
2026-04-27 07:59:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 407cf447-15dc-5b26-8e6b-df9f385d81b6, skipping ID generation
2026-04-27 07:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 407cf447-15dc-5b26-8e6b-df9f385d81b6 with scrape type 1
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 407cf447-15dc-5b26-8e6b-df9f385d81b6 sending to next pipeline
2026-04-27 07:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 407cf447-15dc-5b26-8e6b-df9f385d81b6, identifier: DB27489
2026-04-27 07:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 407cf447-15dc-5b26-8e6b-df9f385d81b6 with identifier: DB27489
2026-04-27 07:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 407cf447-15dc-5b26-8e6b-df9f385d81b6 with identifier: DB27489
2026-04-27 07:59:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 407cf447-15dc-5b26-8e6b-df9f385d81b6 with identifier: DB27489 to the API
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_c0baa8f4115b76f42bbc3285fc89705b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Esquivias',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 132,
'expiration_date': '2026-04-27T15:11:11Z',
'fuel_type': 'petrol',
'id': '407cf447-15dc-5b26-8e6b-df9f385d81b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB27489',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Renault',
'model': 'Megane',
'odometer': 75659,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_c0baa8f4115b76f42bbc3285fc89705b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_91745ad1e9975418fdac360aa96b621e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_4152a928ce3c4e050367c3d919bb18b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_defce21e30f578e773d6f0e6bd46aa30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_2ec00bf25518b1872ed3afcbb989e4ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_80798f2f0972fb7d2e7ae13454262b46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_0f773f230c918ad596fc373647561d51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_917fbbbcc5566f4f327e54c9152b0d76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_b4219ac56d3ee7a5d0d3a0930819e175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_407cf447-15dc-5b26-8e6b-df9f385d81b6/407cf447-15dc-5b26-8e6b-df9f385d81b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/95/6295ff24493d3922b469100804330477/pa/DB27489_3b7f87081224fb83690c433d5d7c0b12.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-04-27 07:59:57 [auto1.es] INFO: Saving data for DB27489: {'created_time': 1777276797.665184, 'last_price_update_time': 1777276797.665196, 'has_photos': True, 'auction_closing_time': 1777302671.0}
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d6f90>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_ca304f3bc973fac821efd36ef6f19f03.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848e190>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_543a09e722f53e8265df90f33498ce70.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21956959-f04e-554e-8648-5df95c6587af with identifier: NP87805
2026-04-27 07:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21956959-f04e-554e-8648-5df95c6587af with scrape type 1
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6d5811fcdc67ec4e507ecb1fc0a657e5.jpg not downloaded yet
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_17006d97c268df3825e9be70a5d08a2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_f4b85e9103360f22d0f3549993d8423b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_eec50b7aa6404df57c7adccb4ec2b0c1.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_2fc4222a61da365dbed973ddddbd6e45.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_631e61309c92668d6d370dcc66ff1756.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_3632fe2412ee335e0ae6058eef647330.jpg not downloaded yet
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_db77c7ae1bb61548eccc7914a0a568de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_37cc354564c23768dfa111ebc4392005.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_870d152e2028123158806498d6a546da.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_f6fd7a87fe9bbb5012188710519b91d0.jpg not downloaded yet
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_fc7d6fbd9023c03298e5a9804d50475d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6befa3b9f0e771d9cb371449446ee52a.jpg not downloaded yet
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484dcb50>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_17006d97c268df3825e9be70a5d08a2e.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488016d0>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_f4b85e9103360f22d0f3549993d8423b.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_9e2e9dc8a881f38213894c946295a9d8.jpg not downloaded yet
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a1350>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_db77c7ae1bb61548eccc7914a0a568de.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048972ed0>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_fc7d6fbd9023c03298e5a9804d50475d.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_3632fe2412ee335e0ae6058eef647330.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_f6fd7a87fe9bbb5012188710519b91d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0588f61d0>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_3632fe2412ee335e0ae6058eef647330.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048581b10>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_f6fd7a87fe9bbb5012188710519b91d0.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_9e2e9dc8a881f38213894c946295a9d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6befa3b9f0e771d9cb371449446ee52a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6d5811fcdc67ec4e507ecb1fc0a657e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e1750>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_9e2e9dc8a881f38213894c946295a9d8.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04887a390>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6befa3b9f0e771d9cb371449446ee52a.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 110 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 118 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00~'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:59:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870c190>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6d5811fcdc67ec4e507ecb1fc0a657e5.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_870d152e2028123158806498d6a546da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_631e61309c92668d6d370dcc66ff1756.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_37cc354564c23768dfa111ebc4392005.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048591610>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_870d152e2028123158806498d6a546da.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823df50>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_631e61309c92668d6d370dcc66ff1756.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a2850>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_37cc354564c23768dfa111ebc4392005.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 07:59:58 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2022 | hits on page: 40
2026-04-27 07:59:58 [auto1.es] INFO: Found listing with ID: XH57732
2026-04-27 07:59:58 [auto1.es] INFO: Scrape type for XH57732: 0
2026-04-27 07:59:58 [auto1.es] INFO: Found listing with ID: NP87805
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_b81bd4cbb0a6ce6114fa8af170e9aac2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_2fc4222a61da365dbed973ddddbd6e45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [auto1.es] INFO: Found listing with ID: BL57262
2026-04-27 07:59:58 [auto1.es] INFO: Scrape type for BL57262: 1
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_eec50b7aa6404df57c7adccb4ec2b0c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_470bbd2dbd3887bef812045d124ae4e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [auto1.es] INFO: Found listing with ID: TW18887
2026-04-27 07:59:58 [auto1.es] INFO: Scrape type for TW18887: 2
2026-04-27 07:59:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088565e4-f596-57ad-ac47-b175c02a70d4 with identifier: TW18887
2026-04-27 07:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088565e4-f596-57ad-ac47-b175c02a70d4 with scrape type 2
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088565e4-f596-57ad-ac47-b175c02a70d4 with scrape type 2
2026-04-27 07:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 088565e4-f596-57ad-ac47-b175c02a70d4, identifier: TW18887
2026-04-27 07:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 088565e4-f596-57ad-ac47-b175c02a70d4 with identifier: TW18887
2026-04-27 07:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 088565e4-f596-57ad-ac47-b175c02a70d4 with identifier: TW18887
2026-04-27 07:59:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 088565e4-f596-57ad-ac47-b175c02a70d4 with identifier: TW18887 to the API
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:18:34Z',
'fuel_type': 'diesel',
'id': '088565e4-f596-57ad-ac47-b175c02a70d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW18887',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'C-Max',
'odometer': 182758,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-05-30',
'seller_name': None,
'title': 'Ford C-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2013}
2026-04-27 07:59:59 [auto1.es] INFO: Saving data for TW18887: {'auction_closing_time': 1777303114.0, 'created_time': 1777018814.800656, 'has_photos': True, 'last_price_update_time': 1777276799.391604}
2026-04-27 07:59:59 [auto1.es] INFO: Found listing with ID: YF80848
2026-04-27 07:59:59 [auto1.es] INFO: Scrape type for YF80848: 2
2026-04-27 07:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daa430d2-2d22-54ad-954c-6b62d77093f1 with identifier: YF80848
2026-04-27 07:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daa430d2-2d22-54ad-954c-6b62d77093f1 with scrape type 2
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daa430d2-2d22-54ad-954c-6b62d77093f1 with scrape type 2
2026-04-27 07:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: daa430d2-2d22-54ad-954c-6b62d77093f1, identifier: YF80848
2026-04-27 07:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: daa430d2-2d22-54ad-954c-6b62d77093f1 with identifier: YF80848
2026-04-27 07:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: daa430d2-2d22-54ad-954c-6b62d77093f1 with identifier: YF80848
2026-04-27 07:59:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: daa430d2-2d22-54ad-954c-6b62d77093f1 with identifier: YF80848 to the API
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:54:42Z',
'fuel_type': 'diesel',
'id': 'daa430d2-2d22-54ad-954c-6b62d77093f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF80848',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 206187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-05-08',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Excellence',
'transmission': 'manual',
'trim': 'Excellence',
'year': 2016}
2026-04-27 07:59:59 [auto1.es] INFO: Saving data for YF80848: {'auction_closing_time': 1777305282.0, 'created_time': 1777019918.985319, 'has_photos': True, 'last_price_update_time': 1777276799.815}
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ44927> (referer: https://www.auto1.com/v1/car-details-view/WZ44927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_9abcfd2a830058d781b68264bc2345c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [auto1.es] INFO: Found listing with ID: LS97770
2026-04-27 07:59:59 [auto1.es] INFO: Scrape type for LS97770: 2
2026-04-27 07:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4028b4-a378-5e3e-971b-722482ed4c6c with identifier: LS97770
2026-04-27 07:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4028b4-a378-5e3e-971b-722482ed4c6c with scrape type 2
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4028b4-a378-5e3e-971b-722482ed4c6c with scrape type 2
2026-04-27 07:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee4028b4-a378-5e3e-971b-722482ed4c6c, identifier: LS97770
2026-04-27 07:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR50800> (referer: https://www.auto1.com/v1/car-details-view/MR50800/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895dc10>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_b81bd4cbb0a6ce6114fa8af170e9aac2.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c79d0>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_2fc4222a61da365dbed973ddddbd6e45.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04815c710>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_eec50b7aa6404df57c7adccb4ec2b0c1.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21956959-f04e-554e-8648-5df95c6587af
2026-04-27 08:00:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21956959-f04e-554e-8648-5df95c6587af, skipping ID generation
2026-04-27 08:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21956959-f04e-554e-8648-5df95c6587af with scrape type 1
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21956959-f04e-554e-8648-5df95c6587af sending to next pipeline
2026-04-27 08:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 21956959-f04e-554e-8648-5df95c6587af, identifier: NP87805
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048250c50>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_470bbd2dbd3887bef812045d124ae4e7.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_61f856c3d2ee1b502437481bfb6f4a7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee4028b4-a378-5e3e-971b-722482ed4c6c with identifier: LS97770
2026-04-27 08:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee4028b4-a378-5e3e-971b-722482ed4c6c with identifier: LS97770
2026-04-27 08:00:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee4028b4-a378-5e3e-971b-722482ed4c6c with identifier: LS97770 to the API
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:36:42Z',
'fuel_type': 'diesel',
'id': 'ee4028b4-a378-5e3e-971b-722482ed4c6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS97770',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': "cee'd",
'odometer': 191874,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-11-14',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi Drive",
'transmission': 'manual',
'trim': 'Drive',
'year': 2010}
2026-04-27 08:00:00 [auto1.es] INFO: Saving data for LS97770: {'auction_closing_time': 1777304202.0, 'created_time': 1777018405.130707, 'has_photos': True, 'last_price_update_time': 1777276800.601237}
2026-04-27 08:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 21956959-f04e-554e-8648-5df95c6587af with identifier: NP87805
2026-04-27 08:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 21956959-f04e-554e-8648-5df95c6587af with identifier: NP87805
2026-04-27 08:00:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 21956959-f04e-554e-8648-5df95c6587af with identifier: NP87805 to the API
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_eec50b7aa6404df57c7adccb4ec2b0c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'city': 'Madrid',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:39:07Z',
'fuel_type': 'diesel',
'id': '21956959-f04e-554e-8648-5df95c6587af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP87805',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Audi',
'model': 'Q3',
'odometer': 67259,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3778432,
'Height': 3060,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6d5811fcdc67ec4e507ecb1fc0a657e5.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_eec50b7aa6404df57c7adccb4ec2b0c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_2fc4222a61da365dbed973ddddbd6e45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_631e61309c92668d6d370dcc66ff1756.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_3632fe2412ee335e0ae6058eef647330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_37cc354564c23768dfa111ebc4392005.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_870d152e2028123158806498d6a546da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_f6fd7a87fe9bbb5012188710519b91d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_6befa3b9f0e771d9cb371449446ee52a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_21956959-f04e-554e-8648-5df95c6587af/21956959-f04e-554e-8648-5df95c6587af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/e6/3fe67ff0d45462b1a746a429a5241773/pa/NP87805_9e2e9dc8a881f38213894c946295a9d8.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2023-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-04-27 08:00:01 [auto1.es] INFO: Saving data for NP87805: {'created_time': 1777276801.060031, 'last_price_update_time': 1777276801.060041, 'has_photos': True, 'auction_closing_time': 1777304347.0}
2026-04-27 08:00:01 [auto1.es] INFO: Found listing with ID: DP38844
2026-04-27 08:00:01 [auto1.es] INFO: Scrape type for DP38844: 2
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 432d98b0-7e02-59bf-9066-4911b4488e55 with identifier: DP38844
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432d98b0-7e02-59bf-9066-4911b4488e55 with scrape type 2
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 432d98b0-7e02-59bf-9066-4911b4488e55 with scrape type 2
2026-04-27 08:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 432d98b0-7e02-59bf-9066-4911b4488e55, identifier: DP38844
2026-04-27 08:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 432d98b0-7e02-59bf-9066-4911b4488e55 with identifier: DP38844
2026-04-27 08:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 432d98b0-7e02-59bf-9066-4911b4488e55 with identifier: DP38844
2026-04-27 08:00:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 432d98b0-7e02-59bf-9066-4911b4488e55 with identifier: DP38844 to the API
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-04-27T15:51:18Z',
'fuel_type': 'petrol',
'id': '432d98b0-7e02-59bf-9066-4911b4488e55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP38844',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 83841,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-02-24',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2020}
2026-04-27 08:00:01 [auto1.es] INFO: Saving data for DP38844: {'auction_closing_time': 1777305078.0, 'created_time': 1777020692.633171, 'has_photos': True, 'last_price_update_time': 1777276801.50507}
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with scrape type 1
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_95e5fbad166dc109bedefd14d000ee32.jpg not downloaded yet
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c6150>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_9abcfd2a830058d781b68264bc2345c5.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7070970-120e-532a-9cdc-ae6509930565 with identifier: MR50800
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7070970-120e-532a-9cdc-ae6509930565 with scrape type 1
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2079579e8556370e13efd7e290a759e2.jpg not downloaded yet
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_8939539ab865e9f4d2abc57438077783.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_39deea7ec21ccbbfebe8201b15a5aa20.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [auto1.es] INFO: Found listing with ID: GA70707
2026-04-27 08:00:01 [auto1.es] INFO: Scrape type for GA70707: 2
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 093bc95f-0e20-5e90-b585-ff5d4438cd94 with identifier: GA70707
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 093bc95f-0e20-5e90-b585-ff5d4438cd94 with scrape type 2
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 093bc95f-0e20-5e90-b585-ff5d4438cd94 with scrape type 2
2026-04-27 08:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 093bc95f-0e20-5e90-b585-ff5d4438cd94, identifier: GA70707
2026-04-27 08:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 093bc95f-0e20-5e90-b585-ff5d4438cd94 with identifier: GA70707
2026-04-27 08:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 093bc95f-0e20-5e90-b585-ff5d4438cd94 with identifier: GA70707
2026-04-27 08:00:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 093bc95f-0e20-5e90-b585-ff5d4438cd94 with identifier: GA70707 to the API
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:08:52Z',
'fuel_type': 'diesel',
'id': '093bc95f-0e20-5e90-b585-ff5d4438cd94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA70707',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Mokka',
'odometer': 181700,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-09-21',
'seller_name': None,
'title': 'Opel Mokka 1.6 CDTI DPF Excellence',
'transmission': 'manual',
'trim': 'Excellence',
'year': 2015}
2026-04-27 08:00:02 [auto1.es] INFO: Saving data for GA70707: {'auction_closing_time': 1777302532.0, 'created_time': 1777018334.973583, 'has_photos': True, 'last_price_update_time': 1777276802.207336}
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_81ac26e20adc25916c85419f31a08f4e.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_ff6eff1bfb4cb7b2ad814678b2f5953e.jpg not downloaded yet
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048543b50>
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_61f856c3d2ee1b502437481bfb6f4a7d.jpg saved to cache
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc
2026-04-27 08:00:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0819419-f794-59d8-aaa4-0d9cc87d4ddc, skipping ID generation
2026-04-27 08:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc with scrape type 1
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0819419-f794-59d8-aaa4-0d9cc87d4ddc sending to next pipeline
2026-04-27 08:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d0819419-f794-59d8-aaa4-0d9cc87d4ddc, identifier: FG51952
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_9063eef14d36135f7626b25271a5a117.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_fa54c77d335094140ac0ca4661ad9200.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [auto1.es] INFO: Found listing with ID: RJ00848
2026-04-27 08:00:02 [auto1.es] INFO: Scrape type for RJ00848: 1
2026-04-27 08:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d0819419-f794-59d8-aaa4-0d9cc87d4ddc with identifier: FG51952
2026-04-27 08:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d0819419-f794-59d8-aaa4-0d9cc87d4ddc with identifier: FG51952
2026-04-27 08:00:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d0819419-f794-59d8-aaa4-0d9cc87d4ddc with identifier: FG51952 to the API
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_61f856c3d2ee1b502437481bfb6f4a7d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Pedrola',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:29:58Z',
'fuel_type': 'diesel',
'id': 'd0819419-f794-59d8-aaa4-0d9cc87d4ddc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG51952',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 139689,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_61f856c3d2ee1b502437481bfb6f4a7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_543a09e722f53e8265df90f33498ce70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_9abcfd2a830058d781b68264bc2345c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_470bbd2dbd3887bef812045d124ae4e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_b81bd4cbb0a6ce6114fa8af170e9aac2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_db77c7ae1bb61548eccc7914a0a568de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_ca304f3bc973fac821efd36ef6f19f03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_fc7d6fbd9023c03298e5a9804d50475d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_f4b85e9103360f22d0f3549993d8423b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0819419-f794-59d8-aaa4-0d9cc87d4ddc/d0819419-f794-59d8-aaa4-0d9cc87d4ddc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/89/11898dcd832c2d0b7c45a01c86c5c8bb/pa/FG51952_17006d97c268df3825e9be70a5d08a2e.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2014-05-21',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.2 Sd4 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2014}
2026-04-27 08:00:03 [auto1.es] INFO: Saving data for FG51952: {'created_time': 1777276803.051867, 'last_price_update_time': 1777276803.05188, 'has_photos': True, 'auction_closing_time': 1777303798.0}
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_ed4e9e815067f513d372c8dc48e65a0d.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_1c209889b3a7060d6f7418802bfc1af4.jpg not downloaded yet
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6ed0>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_8939539ab865e9f4d2abc57438077783.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04899b390>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_39deea7ec21ccbbfebe8201b15a5aa20.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9
2026-04-27 08:00:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8aeb8b52-2f03-5270-ac1d-8941fd3076e9, skipping ID generation
2026-04-27 08:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 with scrape type 1
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 sending to next pipeline
2026-04-27 08:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8aeb8b52-2f03-5270-ac1d-8941fd3076e9, identifier: DS58896
2026-04-27 08:00:03 [auto1.es] INFO: Found listing with ID: XZ69020
2026-04-27 08:00:03 [auto1.es] INFO: Scrape type for XZ69020: 2
2026-04-27 08:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0882cf-caf8-5740-a57f-bc8d38414466 with identifier: XZ69020
2026-04-27 08:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0882cf-caf8-5740-a57f-bc8d38414466 with scrape type 2
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0882cf-caf8-5740-a57f-bc8d38414466 with scrape type 2
2026-04-27 08:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c0882cf-caf8-5740-a57f-bc8d38414466, identifier: XZ69020
2026-04-27 08:00:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 with identifier: DS58896
2026-04-27 08:00:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 with identifier: DS58896
2026-04-27 08:00:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8aeb8b52-2f03-5270-ac1d-8941fd3076e9 with identifier: DS58896 to the API
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_39deea7ec21ccbbfebe8201b15a5aa20.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:47:20Z',
'fuel_type': 'diesel',
'id': '8aeb8b52-2f03-5270-ac1d-8941fd3076e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS58896',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Ford',
'model': 'Kuga',
'odometer': 72226,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_dfb9c104bde14e417431b42661aeb5f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_39deea7ec21ccbbfebe8201b15a5aa20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_b304a6e0d4974bf484708f2149147586.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_fbcf0323900398b31e8306141885e55a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e5b8d7601d0b704b34a51f4ba0e5b91f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_051e53886d3b6f27011a7225d0565204.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_6f09b4b5e35eafb04788b88e738933df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_e79aadf269799c2db0a0bb23428bee7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_aad3f77be4a9a6f1cb60edeac846a1d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8aeb8b52-2f03-5270-ac1d-8941fd3076e9/8aeb8b52-2f03-5270-ac1d-8941fd3076e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/97/f697c981248e388f16905d9806e8a338/pa/DS58896_9fc8511dff1e710cf08e40d456f1483b.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-04-27 08:00:04 [auto1.es] INFO: Saving data for DS58896: {'created_time': 1777276804.269989, 'last_price_update_time': 1777276804.269998, 'has_photos': True, 'auction_closing_time': 1777391240.0}
2026-04-27 08:00:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c0882cf-caf8-5740-a57f-bc8d38414466 with identifier: XZ69020
2026-04-27 08:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c0882cf-caf8-5740-a57f-bc8d38414466 with identifier: XZ69020
2026-04-27 08:00:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c0882cf-caf8-5740-a57f-bc8d38414466 with identifier: XZ69020 to the API
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:11:51Z',
'fuel_type': 'diesel',
'id': '9c0882cf-caf8-5740-a57f-bc8d38414466',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ69020',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 132807,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-06-06',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
'transmission': 'automatic',
'trim': 'AMG Sport',
'year': 2017}
2026-04-27 08:00:04 [auto1.es] INFO: Saving data for XZ69020: {'auction_closing_time': 1777302711.0, 'created_time': 1777021144.869236, 'has_photos': True, 'last_price_update_time': 1777276804.655852}
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_dd98526406a145bb13f95b1f1eb0776e.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_538e4b0f5f9f00c05bdc5c9b31db7670.jpg not downloaded yet
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM10376> (referer: https://www.auto1.com/v1/car-details-view/FM10376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048251350>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_9063eef14d36135f7626b25271a5a117.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b8710>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_fa54c77d335094140ac0ca4661ad9200.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_95e5fbad166dc109bedefd14d000ee32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2079579e8556370e13efd7e290a759e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [auto1.es] INFO: Found listing with ID: VY98450
2026-04-27 08:00:04 [auto1.es] INFO: Scrape type for VY98450: 2
2026-04-27 08:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3 with identifier: VY98450
2026-04-27 08:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3 with scrape type 2
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3 with scrape type 2
2026-04-27 08:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3, identifier: VY98450
2026-04-27 08:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_312078f5246952be9cfe4b2c89e38f6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3 with identifier: VY98450
2026-04-27 08:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3 with identifier: VY98450
2026-04-27 08:00:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75bdd30f-1cdb-5024-b72a-eb67a9cd18d3 with identifier: VY98450 to the API
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:43:35Z',
'fuel_type': 'diesel',
'id': '75bdd30f-1cdb-5024-b72a-eb67a9cd18d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY98450',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q3',
'odometer': 78852,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-10-21',
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-04-27 08:00:05 [auto1.es] INFO: Saving data for VY98450: {'auction_closing_time': 1777304615.0, 'created_time': 1777021225.902535, 'has_photos': True, 'last_price_update_time': 1777276805.48429}
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_2d49daf02370f847b08b982b8e9134c7.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_beaa4f98b9f7a937940bf84e56115142.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL04820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [auto1.es] INFO: Found listing with ID: DP37513
2026-04-27 08:00:05 [auto1.es] INFO: Scrape type for DP37513: 2
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82a4fce-80e0-57e8-a495-be683f2d8c53 with identifier: DP37513
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82a4fce-80e0-57e8-a495-be683f2d8c53 with scrape type 2
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82a4fce-80e0-57e8-a495-be683f2d8c53 with scrape type 2
2026-04-27 08:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f82a4fce-80e0-57e8-a495-be683f2d8c53, identifier: DP37513
2026-04-27 08:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA09417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF88454> (referer: https://www.auto1.com/v1/car-details-view/JF88454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC52810> (referer: https://www.auto1.com/v1/car-details-view/CC52810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 with identifier: FM10376
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 with scrape type 1
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_4489aa07cb479a6aafd57da2cadd77f4.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f82a4fce-80e0-57e8-a495-be683f2d8c53 with identifier: DP37513
2026-04-27 08:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f82a4fce-80e0-57e8-a495-be683f2d8c53 with identifier: DP37513
2026-04-27 08:00:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f82a4fce-80e0-57e8-a495-be683f2d8c53 with identifier: DP37513 to the API
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-04-27T15:36:55Z',
'fuel_type': 'petrol',
'id': 'f82a4fce-80e0-57e8-a495-be683f2d8c53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP37513',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Dacia',
'model': 'Duster',
'odometer': 93080,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-04-29',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe Deal',
'transmission': 'manual',
'trim': 'Deal',
'year': 2021}
2026-04-27 08:00:06 [auto1.es] INFO: Saving data for DP37513: {'auction_closing_time': 1777304215.0, 'created_time': 1777020989.684398, 'has_photos': True, 'last_price_update_time': 1777276806.25045}
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_435c855a2d7660a7daf63faa0bc6b56d.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_4768c17779551355c176fee8c9665ec4.jpg not downloaded yet
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048155e50>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_95e5fbad166dc109bedefd14d000ee32.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ac050>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2079579e8556370e13efd7e290a759e2.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_538e4b0f5f9f00c05bdc5c9b31db7670.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_1c209889b3a7060d6f7418802bfc1af4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [auto1.es] INFO: Found listing with ID: BT51966
2026-04-27 08:00:06 [auto1.es] INFO: Scrape type for BT51966: 2
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with scrape type 2
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with scrape type 2
2026-04-27 08:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ae0f6d0-a5c7-506b-af09-b033d54bc633, identifier: BT51966
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_a5a5d90f4004c347b33d7dbef61a0e2b.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841da50>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_312078f5246952be9cfe4b2c89e38f6e.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aee85d4b-5606-580f-ba0d-dd9e7c993c5d, skipping ID generation
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aee85d4b-5606-580f-ba0d-dd9e7c993c5d sending to next pipeline
2026-04-27 08:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aee85d4b-5606-580f-ba0d-dd9e7c993c5d, identifier: RF40380
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_ed4e9e815067f513d372c8dc48e65a0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966
2026-04-27 08:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966
2026-04-27 08:00:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966 to the API
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-04-27T15:07:39Z',
'fuel_type': 'petrol',
'id': '8ae0f6d0-a5c7-506b-af09-b033d54bc633',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT51966',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': '500',
'odometer': 164596,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-07-06',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2020}
2026-04-27 08:00:07 [auto1.es] INFO: Saving data for BT51966: {'auction_closing_time': 1777302459.0, 'created_time': 1777018687.586929, 'has_photos': True, 'last_price_update_time': 1777276807.020045}
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_0e3c56edb11ba797044322619203e96c.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_96e607072fb92773a694edaa5007a80f.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aee85d4b-5606-580f-ba0d-dd9e7c993c5d with identifier: RF40380
2026-04-27 08:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aee85d4b-5606-580f-ba0d-dd9e7c993c5d with identifier: RF40380
2026-04-27 08:00:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aee85d4b-5606-580f-ba0d-dd9e7c993c5d with identifier: RF40380 to the API
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_312078f5246952be9cfe4b2c89e38f6e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'city': 'Barcelona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:08:47Z',
'fuel_type': 'diesel',
'id': 'aee85d4b-5606-580f-ba0d-dd9e7c993c5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF40380',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Peugeot',
'model': '508',
'odometer': 186717,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_5fffc1d6b297cc09ee20e5196763c803.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_7fe934924b447af838431bfd5fc7d6fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_312078f5246952be9cfe4b2c89e38f6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a3ce6bdc629857f8195a95ef726389f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_644eb33f697a00722ae1230c49a2f6be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_9f5171bd6c777964f197a1d5e11910e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_2d78b5a6b37f28cbecdbcf272e647219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_acb19a8ec2dbbc08f8134808d289d04b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_f9c8c6813195bbfc4a97f135d12c4275.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aee85d4b-5606-580f-ba0d-dd9e7c993c5d/aee85d4b-5606-580f-ba0d-dd9e7c993c5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/95/f89584d81e06f92f2a05fa9aa7d85f95/pa/RF40380_a9410a1db52b03f7adbbe9aa21b376b2.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2017-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 1.6 Blue-HDi Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2017}
2026-04-27 08:00:07 [auto1.es] INFO: Saving data for RF40380: {'created_time': 1777276807.442067, 'last_price_update_time': 1777276807.442076, 'has_photos': True, 'auction_closing_time': 1777388927.0}
2026-04-27 08:00:07 [auto1.es] INFO: Found listing with ID: NJ73279
2026-04-27 08:00:07 [auto1.es] INFO: Scrape type for NJ73279: 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_6fd7d4b4c6ba7a0eada396021f7ba68f.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0699ef3-3c5e-5730-8300-b41462709556 with identifier: JF88454
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0699ef3-3c5e-5730-8300-b41462709556 with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9b00c61b55da46644a02cbdfc53b72b0.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdc12176-3d0c-5d5f-9181-b7c60781ad54 with identifier: CC52810
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc12176-3d0c-5d5f-9181-b7c60781ad54 with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_b293543aa51bb82add9db4610a5b654b.jpg not downloaded yet
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_beaa4f98b9f7a937940bf84e56115142.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_dd98526406a145bb13f95b1f1eb0776e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_71b73b31dab68c25b07a042043f55f97.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_41908e2650480ac38edb002ebb880cdd.jpg not downloaded yet
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_2d49daf02370f847b08b982b8e9134c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_ff6eff1bfb4cb7b2ad814678b2f5953e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [auto1.es] INFO: Found listing with ID: BR35184
2026-04-27 08:00:07 [auto1.es] INFO: Scrape type for BR35184: 2
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with scrape type 2
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with scrape type 2
2026-04-27 08:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa, identifier: BR35184
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_798c0c3d1a72107016e57ca9b8745fdb.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_ba34df1f82cc398e15ed106288985132.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_1ba8de8ad024f2d1a1e70e975dc89b8a.jpg not downloaded yet
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048975250>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_538e4b0f5f9f00c05bdc5c9b31db7670.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c5450>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_1c209889b3a7060d6f7418802bfc1af4.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048806050>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_ed4e9e815067f513d372c8dc48e65a0d.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_4489aa07cb479a6aafd57da2cadd77f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184
2026-04-27 08:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184
2026-04-27 08:00:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184 to the API
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 230,
'expiration_date': '2026-04-27T15:21:48Z',
'fuel_type': 'diesel',
'id': 'fdb0f429-7adf-5bbc-b408-a0b986d5b7fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR35184',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 137258,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-05-25',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2009}
2026-04-27 08:00:08 [auto1.es] INFO: Saving data for BR35184: {'auction_closing_time': 1777303308.0, 'created_time': 1777020799.704338, 'has_photos': True, 'last_price_update_time': 1777276808.172836}
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_a2be62596e76563e0729d104ab8cd0c9.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2623228dfd72e32aca91b44d386b08f1.jpg not downloaded yet
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_81ac26e20adc25916c85419f31a08f4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [auto1.es] INFO: Found listing with ID: DR60635
2026-04-27 08:00:08 [auto1.es] INFO: Scrape type for DR60635: 2
2026-04-27 08:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635
2026-04-27 08:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b605f172-3bbb-516a-a9e8-4125186801bd with scrape type 2
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b605f172-3bbb-516a-a9e8-4125186801bd with scrape type 2
2026-04-27 08:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b605f172-3bbb-516a-a9e8-4125186801bd, identifier: DR60635
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_7052d47c9419887b7654da78fd2f3586.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_df9f2e6c726a90255226148c5d2e187e.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_37bbd6fff9dd8992015b958820fbe5d9.jpg not downloaded yet
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_4768c17779551355c176fee8c9665ec4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635
2026-04-27 08:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635
2026-04-27 08:00:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635 to the API
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:03:00Z',
'fuel_type': 'diesel',
'id': 'b605f172-3bbb-516a-a9e8-4125186801bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR60635',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 198749,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Business BlueMotion Tech',
'year': 2018}
2026-04-27 08:00:08 [auto1.es] INFO: Saving data for DR60635: {'auction_closing_time': 1777302180.0, 'created_time': 1777021082.262956, 'has_photos': True, 'last_price_update_time': 1777276808.817515}
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_5fc8539620ecd615a7a692bffd22c565.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_b6c888c139bcc3a117ef2ed8565bd65d.jpg not downloaded yet
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE32180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483401d0>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_beaa4f98b9f7a937940bf84e56115142.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891c7d0>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_dd98526406a145bb13f95b1f1eb0776e.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482ddb50>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_2d49daf02370f847b08b982b8e9134c7.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d5990>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_ff6eff1bfb4cb7b2ad814678b2f5953e.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:09 [auto1.es] INFO: Found listing with ID: DD74793
2026-04-27 08:00:09 [auto1.es] INFO: Scrape type for DD74793: 1
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_0a550dab2468fff5fc2cb9aed113a073.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9a13f3fc830ca407043f531fd7c3e196.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_4075f5fb1caaaf753ae1590941f3a2a0.jpg not downloaded yet
2026-04-27 08:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV61341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX98366> (referer: https://www.auto1.com/v1/car-details-view/XX98366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4a50>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_4489aa07cb479a6aafd57da2cadd77f4.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9b00c61b55da46644a02cbdfc53b72b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_b293543aa51bb82add9db4610a5b654b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_6fd7d4b4c6ba7a0eada396021f7ba68f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT91769> (referer: https://www.auto1.com/v1/car-details-view/CT91769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486bc4d0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_81ac26e20adc25916c85419f31a08f4e.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_41908e2650480ac38edb002ebb880cdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [auto1.es] INFO: Found listing with ID: AW04396
2026-04-27 08:00:09 [auto1.es] INFO: Scrape type for AW04396: 2
2026-04-27 08:00:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396
2026-04-27 08:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a309712-bdc5-568e-936c-6b034dc46d72 with scrape type 2
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a309712-bdc5-568e-936c-6b034dc46d72 with scrape type 2
2026-04-27 08:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a309712-bdc5-568e-936c-6b034dc46d72, identifier: AW04396
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b95b6513ad09c6aac576ce34d6e64cf4.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c5f1d506fcaa4268744376fe18b12f44.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_a08ed0b5f2c8b0724057b93adf7bd0eb.jpg not downloaded yet
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048234a10>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_4768c17779551355c176fee8c9665ec4.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396
2026-04-27 08:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396
2026-04-27 08:00:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396 to the API
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:58:14Z',
'fuel_type': 'diesel',
'id': '5a309712-bdc5-568e-936c-6b034dc46d72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW04396',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C5',
'odometer': 140025,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-01-12',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2015}
2026-04-27 08:00:09 [auto1.es] INFO: Saving data for AW04396: {'auction_closing_time': 1777305494.0, 'created_time': 1777021021.549033, 'has_photos': True, 'last_price_update_time': 1777276809.718851}
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2623228dfd72e32aca91b44d386b08f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_1ba8de8ad024f2d1a1e70e975dc89b8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [auto1.es] INFO: Found listing with ID: GS59468
2026-04-27 08:00:09 [auto1.es] INFO: Scrape type for GS59468: 1
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b3c570efcb37c734bb2793761e15a7f5.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_4c257906bf4fc7e5654d195098ceaf2d.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_fb6296c0eb3b531e65b44122b25c16c5.jpg not downloaded yet
2026-04-27 08:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_37bbd6fff9dd8992015b958820fbe5d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366
2026-04-27 08:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af46a086-93d7-5ac9-b25f-351bf03ef09d with scrape type 1
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_08fe630efc1cd065396a7da85ddcd47a.jpg not downloaded yet
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048426fd0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9b00c61b55da46644a02cbdfc53b72b0.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0480ea950>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_b293543aa51bb82add9db4610a5b654b.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a64d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_6fd7d4b4c6ba7a0eada396021f7ba68f.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_50a0759e95dcc60531ff21818da9df31.jpg not downloaded yet
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833ee90>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_41908e2650480ac38edb002ebb880cdd.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_a2be62596e76563e0729d104ab8cd0c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_b6c888c139bcc3a117ef2ed8565bd65d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_df9f2e6c726a90255226148c5d2e187e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_5fc8539620ecd615a7a692bffd22c565.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [auto1.es] INFO: Found listing with ID: ZG55616
2026-04-27 08:00:10 [auto1.es] INFO: Scrape type for ZG55616: 2
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0402cd6-1e66-5149-808d-196b83989f43 with identifier: ZG55616
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0402cd6-1e66-5149-808d-196b83989f43 with scrape type 2
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0402cd6-1e66-5149-808d-196b83989f43 with scrape type 2
2026-04-27 08:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0402cd6-1e66-5149-808d-196b83989f43, identifier: ZG55616
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b9bcaea777a5a990a056ffed3e6a62bc.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_a9943479f63f4d2568d7dce26219cb89.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_75fc3b44e8a9a0293fb0df0f89dc5e54.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_4075f5fb1caaaf753ae1590941f3a2a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0402cd6-1e66-5149-808d-196b83989f43 with identifier: ZG55616
2026-04-27 08:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0402cd6-1e66-5149-808d-196b83989f43 with identifier: ZG55616
2026-04-27 08:00:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0402cd6-1e66-5149-808d-196b83989f43 with identifier: ZG55616 to the API
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:24:05Z',
'fuel_type': 'diesel',
'id': 'b0402cd6-1e66-5149-808d-196b83989f43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG55616',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 51606,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-10-16',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-04-27 08:00:10 [auto1.es] INFO: Saving data for ZG55616: {'auction_closing_time': 1777303445.0, 'created_time': 1777018646.190592, 'has_photos': True, 'last_price_update_time': 1777276810.715721}
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_1d7c4a7c8a1f3ff10838f6143c3fc81f.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_3b56b4b9efbfbb2ae3d234f1475ac40b.jpg not downloaded yet
2026-04-27 08:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_a08ed0b5f2c8b0724057b93adf7bd0eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9a13f3fc830ca407043f531fd7c3e196.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [auto1.es] INFO: Found listing with ID: NK01791
2026-04-27 08:00:10 [auto1.es] INFO: Scrape type for NK01791: 2
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa3bcb81-0b93-5aa1-9520-2c15db11c18a with identifier: NK01791
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3bcb81-0b93-5aa1-9520-2c15db11c18a with scrape type 2
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa3bcb81-0b93-5aa1-9520-2c15db11c18a with scrape type 2
2026-04-27 08:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa3bcb81-0b93-5aa1-9520-2c15db11c18a, identifier: NK01791
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_d72222136bcc63d8728d43987413369a.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_06de05c4af1ab7c7f84c6129783fb966.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_ea61dc83ac4e37ac73ac7876245eb8d4.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa3bcb81-0b93-5aa1-9520-2c15db11c18a with identifier: NK01791
2026-04-27 08:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa3bcb81-0b93-5aa1-9520-2c15db11c18a with identifier: NK01791
2026-04-27 08:00:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aa3bcb81-0b93-5aa1-9520-2c15db11c18a with identifier: NK01791 to the API
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:10:22Z',
'fuel_type': 'diesel',
'id': 'aa3bcb81-0b93-5aa1-9520-2c15db11c18a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK01791',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 75771,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-09-30',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-04-27 08:00:11 [auto1.es] INFO: Saving data for NK01791: {'auction_closing_time': 1777302622.0, 'created_time': 1777019132.715134, 'has_photos': True, 'last_price_update_time': 1777276811.26066}
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_7ed4fd35c57957974ef1f9ff718c0627.jpg not downloaded yet
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_301d8a986ec357f69870375b373fecd3.jpg not downloaded yet
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843ef50>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2623228dfd72e32aca91b44d386b08f1.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a943d0>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_1ba8de8ad024f2d1a1e70e975dc89b8a.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f9750>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_37bbd6fff9dd8992015b958820fbe5d9.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04867a090>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_a2be62596e76563e0729d104ab8cd0c9.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048386550>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_b6c888c139bcc3a117ef2ed8565bd65d.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482ba290>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_df9f2e6c726a90255226148c5d2e187e.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048398f90>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_5fc8539620ecd615a7a692bffd22c565.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:00:11 [auto1.es] INFO: Found listing with ID: HZ33836
2026-04-27 08:00:11 [auto1.es] INFO: Scrape type for HZ33836: 2
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c410bdbc-941f-5891-8825-4a1771af0de8 with identifier: HZ33836
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c410bdbc-941f-5891-8825-4a1771af0de8 with scrape type 2
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c410bdbc-941f-5891-8825-4a1771af0de8 with scrape type 2
2026-04-27 08:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c410bdbc-941f-5891-8825-4a1771af0de8, identifier: HZ33836
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c2ff52065c6b5dae418eab6f803a826b.jpg not downloaded yet
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_c0ea2eda80241017ceff3f322e9c8e3c.jpg not downloaded yet
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c5f1d506fcaa4268744376fe18b12f44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c410bdbc-941f-5891-8825-4a1771af0de8 with identifier: HZ33836
2026-04-27 08:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c410bdbc-941f-5891-8825-4a1771af0de8 with identifier: HZ33836
2026-04-27 08:00:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c410bdbc-941f-5891-8825-4a1771af0de8 with identifier: HZ33836 to the API
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-04-27T15:01:53Z',
'fuel_type': 'petrol',
'id': 'c410bdbc-941f-5891-8825-4a1771af0de8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ33836',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC40',
'odometer': 259850,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-07-19',
'seller_name': None,
'title': 'Volvo XC40 1.5 2WD',
'transmission': 'manual',
'trim': '2WD',
'year': 2018}
2026-04-27 08:00:12 [auto1.es] INFO: Saving data for HZ33836: {'auction_closing_time': 1777302113.0, 'created_time': 1772028244.594221, 'has_photos': False, 'last_price_update_time': 1777276812.024196}
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_34854c571fcb70d777becb844d219113.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_f8ae94a2ad2cc4942e69463f5d27696f.jpg not downloaded yet
2026-04-27 08:00:12 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2023 | hits on page: 40
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048677790>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_4075f5fb1caaaf753ae1590941f3a2a0.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f8c90>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_a08ed0b5f2c8b0724057b93adf7bd0eb.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528dd0>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9a13f3fc830ca407043f531fd7c3e196.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_75fc3b44e8a9a0293fb0df0f89dc5e54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_50a0759e95dcc60531ff21818da9df31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_08fe630efc1cd065396a7da85ddcd47a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_fb6296c0eb3b531e65b44122b25c16c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_4c257906bf4fc7e5654d195098ceaf2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b3c570efcb37c734bb2793761e15a7f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [auto1.es] INFO: Found listing with ID: GV34698
2026-04-27 08:00:12 [auto1.es] INFO: Scrape type for GV34698: 2
2026-04-27 08:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f802de-0d35-519f-99a1-4043f540f7a6 with identifier: GV34698
2026-04-27 08:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f802de-0d35-519f-99a1-4043f540f7a6 with scrape type 2
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f802de-0d35-519f-99a1-4043f540f7a6 with scrape type 2
2026-04-27 08:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15f802de-0d35-519f-99a1-4043f540f7a6, identifier: GV34698
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_dbd2483cb71ce6d8e7ff9652c51c34bf.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_f7dfc69393dda456ea83e6d065380f68.jpg not downloaded yet
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK42012> (referer: https://www.auto1.com/v1/car-details-view/ZK42012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15f802de-0d35-519f-99a1-4043f540f7a6 with identifier: GV34698
2026-04-27 08:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15f802de-0d35-519f-99a1-4043f540f7a6 with identifier: GV34698
2026-04-27 08:00:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15f802de-0d35-519f-99a1-4043f540f7a6 with identifier: GV34698 to the API
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 435,
'expiration_date': '2026-04-27T15:34:21Z',
'fuel_type': 'petrol',
'id': '15f802de-0d35-519f-99a1-4043f540f7a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV34698',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'S6',
'odometer': 207692,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-11-26',
'seller_name': None,
'title': 'Audi S6 5.2 V10 FSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2006}
2026-04-27 08:00:12 [auto1.es] INFO: Saving data for GV34698: {'auction_closing_time': 1777304061.0, 'created_time': 1777018624.487555, 'has_photos': True, 'last_price_update_time': 1777276812.681496}
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_efbead4a96eb2b3bd2cc684b6447d9c2.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_a3213e870cc1a347d37b7cf2056a6b81.jpg not downloaded yet
2026-04-27 08:00:12 [auto1.es] INFO: Found listing with ID: KE66826
2026-04-27 08:00:12 [auto1.es] INFO: Scrape type for KE66826: 2
2026-04-27 08:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8da02857-2ddb-515b-9429-0e6b73981715 with identifier: KE66826
2026-04-27 08:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8da02857-2ddb-515b-9429-0e6b73981715 with scrape type 2
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8da02857-2ddb-515b-9429-0e6b73981715 with scrape type 2
2026-04-27 08:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8da02857-2ddb-515b-9429-0e6b73981715, identifier: KE66826
2026-04-27 08:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_7052d47c9419887b7654da78fd2f3586.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [auto1.es] INFO: Found listing with ID: UR64839
2026-04-27 08:00:12 [auto1.es] INFO: Scrape type for UR64839: 2
2026-04-27 08:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839
2026-04-27 08:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e3166c3-75ef-54d7-bbe2-047dcb807855 with scrape type 2
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e3166c3-75ef-54d7-bbe2-047dcb807855 with scrape type 2
2026-04-27 08:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e3166c3-75ef-54d7-bbe2-047dcb807855, identifier: UR64839
2026-04-27 08:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8da02857-2ddb-515b-9429-0e6b73981715 with identifier: KE66826
2026-04-27 08:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8da02857-2ddb-515b-9429-0e6b73981715 with identifier: KE66826
2026-04-27 08:00:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8da02857-2ddb-515b-9429-0e6b73981715 with identifier: KE66826 to the API
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:56:05Z',
'fuel_type': 'diesel',
'id': '8da02857-2ddb-515b-9429-0e6b73981715',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE66826',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '5008',
'odometer': 203586,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-04-30',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2019}
2026-04-27 08:00:13 [auto1.es] INFO: Saving data for KE66826: {'auction_closing_time': 1777305365.0, 'created_time': 1777020682.101269, 'has_photos': True, 'last_price_update_time': 1777276813.238792}
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04859ec50>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c5f1d506fcaa4268744376fe18b12f44.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_a9943479f63f4d2568d7dce26219cb89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839
2026-04-27 08:00:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839
2026-04-27 08:00:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839 to the API
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:22:55Z',
'fuel_type': 'petrol',
'id': '2e3166c3-75ef-54d7-bbe2-047dcb807855',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR64839',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 109088,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-04-29',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2019}
2026-04-27 08:00:13 [auto1.es] INFO: Saving data for UR64839: {'auction_closing_time': 1777303375.0, 'created_time': 1777020999.341943, 'has_photos': True, 'last_price_update_time': 1777276813.856269}
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_98629c0ebbddc588bb7f345954f19727.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_6df3b89f71cc25ed6f514562f62722b0.jpg not downloaded yet
2026-04-27 08:00:13 [auto1.es] INFO: Found listing with ID: HJ75824
2026-04-27 08:00:13 [auto1.es] INFO: Scrape type for HJ75824: 2
2026-04-27 08:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824
2026-04-27 08:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e420c982-5771-543e-80ec-a8e0687d788f with scrape type 2
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e420c982-5771-543e-80ec-a8e0687d788f with scrape type 2
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e420c982-5771-543e-80ec-a8e0687d788f, identifier: HJ75824
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_301d8a986ec357f69870375b373fecd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [auto1.es] INFO: Found listing with ID: UM01301
2026-04-27 08:00:14 [auto1.es] INFO: Scrape type for UM01301: 1
2026-04-27 08:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824
2026-04-27 08:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824
2026-04-27 08:00:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824 to the API
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:28:42Z',
'fuel_type': 'diesel',
'id': 'e420c982-5771-543e-80ec-a8e0687d788f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ75824',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 222401,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-02-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'T BlueTEC AMG Line',
'year': 2016}
2026-04-27 08:00:14 [auto1.es] INFO: Saving data for HJ75824: {'auction_closing_time': 1777303722.0, 'created_time': 1777020556.288205, 'has_photos': True, 'last_price_update_time': 1777276814.361798}
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048981bd0>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_75fc3b44e8a9a0293fb0df0f89dc5e54.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048608150>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_50a0759e95dcc60531ff21818da9df31.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5d90>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_08fe630efc1cd065396a7da85ddcd47a.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a55e50>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_fb6296c0eb3b531e65b44122b25c16c5.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049710b50>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_4c257906bf4fc7e5654d195098ceaf2d.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04860a6d0>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b3c570efcb37c734bb2793761e15a7f5.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012
2026-04-27 08:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f40dd9-f338-53dc-a570-18783f81aae3 with scrape type 1
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg not downloaded yet
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c2ff52065c6b5dae418eab6f803a826b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_7ed4fd35c57957974ef1f9ff718c0627.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_06de05c4af1ab7c7f84c6129783fb966.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_c0ea2eda80241017ceff3f322e9c8e3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_ea61dc83ac4e37ac73ac7876245eb8d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55e7492139f917dea4d57d9d5f41129b.jpg not downloaded yet
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_2456829e3cbc981d538b6d430ad946cf.jpg not downloaded yet
2026-04-27 08:00:14 [auto1.es] INFO: Found listing with ID: RC61161
2026-04-27 08:00:14 [auto1.es] INFO: Scrape type for RC61161: 2
2026-04-27 08:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 119b80e5-492e-51a0-8b40-f72c7a5df179 with identifier: RC61161
2026-04-27 08:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 119b80e5-492e-51a0-8b40-f72c7a5df179 with scrape type 2
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 119b80e5-492e-51a0-8b40-f72c7a5df179 with scrape type 2
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 119b80e5-492e-51a0-8b40-f72c7a5df179, identifier: RC61161
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL57262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_d72222136bcc63d8728d43987413369a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [auto1.es] INFO: Found listing with ID: HF92394
2026-04-27 08:00:14 [auto1.es] INFO: Scrape type for HF92394: 2
2026-04-27 08:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394
2026-04-27 08:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799a7b95-9920-5f69-9872-3f8ef8d086ae with scrape type 2
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 799a7b95-9920-5f69-9872-3f8ef8d086ae with scrape type 2
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 799a7b95-9920-5f69-9872-3f8ef8d086ae, identifier: HF92394
2026-04-27 08:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 119b80e5-492e-51a0-8b40-f72c7a5df179 with identifier: RC61161
2026-04-27 08:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 119b80e5-492e-51a0-8b40-f72c7a5df179 with identifier: RC61161
2026-04-27 08:00:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 119b80e5-492e-51a0-8b40-f72c7a5df179 with identifier: RC61161 to the API
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:20:59Z',
'fuel_type': 'petrol',
'id': '119b80e5-492e-51a0-8b40-f72c7a5df179',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC61161',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Tarraco',
'odometer': 120403,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-03-30',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TSI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2020}
2026-04-27 08:00:15 [auto1.es] INFO: Saving data for RC61161: {'auction_closing_time': 1777303259.0, 'created_time': 1777020769.790857, 'has_photos': True, 'last_price_update_time': 1777276815.245279}
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg not downloaded yet
2026-04-27 08:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4a90>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_7052d47c9419887b7654da78fd2f3586.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484bbad0>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_a9943479f63f4d2568d7dce26219cb89.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394
2026-04-27 08:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394
2026-04-27 08:00:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 799a7b95-9920-5f69-9872-3f8ef8d086ae with identifier: HF92394 to the API
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:18:16Z',
'fuel_type': 'diesel',
'id': '799a7b95-9920-5f69-9872-3f8ef8d086ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF92394',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q5',
'odometer': 252876,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-08-25',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI clean diesel quattro Advanced edition',
'transmission': 'manual',
'trim': 'quattro Advanced edition',
'year': 2015}
2026-04-27 08:00:15 [auto1.es] INFO: Saving data for HF92394: {'auction_closing_time': 1777303096.0, 'created_time': 1777021249.049075, 'has_photos': True, 'last_price_update_time': 1777276815.742189}
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_71fba6a4a5b2272f13b4199fc1611f1e.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_fcee8ac77c547a4540caeeba7ca28057.jpg not downloaded yet
2026-04-27 08:00:15 [auto1.es] INFO: Found listing with ID: RV14480
2026-04-27 08:00:15 [auto1.es] INFO: Scrape type for RV14480: 2
2026-04-27 08:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e6f9e8-fa9c-50af-8a84-796e37997b01 with identifier: RV14480
2026-04-27 08:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e6f9e8-fa9c-50af-8a84-796e37997b01 with scrape type 2
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e6f9e8-fa9c-50af-8a84-796e37997b01 with scrape type 2
2026-04-27 08:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4e6f9e8-fa9c-50af-8a84-796e37997b01, identifier: RV14480
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048989950>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_301d8a986ec357f69870375b373fecd3.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_efbead4a96eb2b3bd2cc684b6447d9c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_f7dfc69393dda456ea83e6d065380f68.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [auto1.es] INFO: Found listing with ID: AP64153
2026-04-27 08:00:15 [auto1.es] INFO: Scrape type for AP64153: 2
2026-04-27 08:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153
2026-04-27 08:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4bc361-0fc9-5c90-ba91-55739842b039 with scrape type 2
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4bc361-0fc9-5c90-ba91-55739842b039 with scrape type 2
2026-04-27 08:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf4bc361-0fc9-5c90-ba91-55739842b039, identifier: AP64153
2026-04-27 08:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4e6f9e8-fa9c-50af-8a84-796e37997b01 with identifier: RV14480
2026-04-27 08:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4e6f9e8-fa9c-50af-8a84-796e37997b01 with identifier: RV14480
2026-04-27 08:00:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4e6f9e8-fa9c-50af-8a84-796e37997b01 with identifier: RV14480 to the API
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-04-27T15:24:57Z',
'fuel_type': 'petrol',
'id': 'f4e6f9e8-fa9c-50af-8a84-796e37997b01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV14480',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 114641,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2009}
2026-04-27 08:00:16 [auto1.es] INFO: Saving data for RV14480: {'auction_closing_time': 1777303497.0, 'created_time': 1777020002.709313, 'has_photos': True, 'last_price_update_time': 1777276816.439323}
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg not downloaded yet
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_34854c571fcb70d777becb844d219113.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_a3213e870cc1a347d37b7cf2056a6b81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153
2026-04-27 08:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153
2026-04-27 08:00:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153 to the API
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:43:11Z',
'fuel_type': 'diesel',
'id': 'cf4bc361-0fc9-5c90-ba91-55739842b039',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP64153',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q3',
'odometer': 67630,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-10-28',
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-04-27 08:00:16 [auto1.es] INFO: Saving data for AP64153: {'auction_closing_time': 1777304591.0, 'created_time': 1777018679.725499, 'has_photos': True, 'last_price_update_time': 1777276816.84435}
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55d763c3a09202af197d0f2e5f401335.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_e83df313391f85d082b6b1cc5100bc12.jpg not downloaded yet
2026-04-27 08:00:16 [auto1.es] INFO: Found listing with ID: RZ01434
2026-04-27 08:00:16 [auto1.es] INFO: Scrape type for RZ01434: 1
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ00848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3e10>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c2ff52065c6b5dae418eab6f803a826b.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e0910>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_7ed4fd35c57957974ef1f9ff718c0627.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a5110>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_06de05c4af1ab7c7f84c6129783fb966.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04838db10>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_c0ea2eda80241017ceff3f322e9c8e3c.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836ad90>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_ea61dc83ac4e37ac73ac7876245eb8d4.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484aafd0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_d72222136bcc63d8728d43987413369a.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_f8ae94a2ad2cc4942e69463f5d27696f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_98629c0ebbddc588bb7f345954f19727.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_6df3b89f71cc25ed6f514562f62722b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_dbd2483cb71ce6d8e7ff9652c51c34bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [auto1.es] INFO: Found listing with ID: XA71436
2026-04-27 08:00:17 [auto1.es] INFO: Scrape type for XA71436: 2
2026-04-27 08:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436
2026-04-27 08:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with scrape type 2
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with scrape type 2
2026-04-27 08:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a, identifier: XA71436
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg not downloaded yet
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA09417> (referer: https://www.auto1.com/v1/car-details-view/EA09417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436
2026-04-27 08:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436
2026-04-27 08:00:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436 to the API
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:24:11Z',
'fuel_type': 'diesel',
'id': '2c99f3d5-b7ec-5e6a-9329-701284a90f9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA71436',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 172022,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-08-04',
'seller_name': None,
'title': 'BMW X1 sDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-04-27 08:00:17 [auto1.es] INFO: Saving data for XA71436: {'auction_closing_time': 1777303451.0, 'created_time': 1777020605.789964, 'has_photos': True, 'last_price_update_time': 1777276817.704179}
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_5081e68546631c8df492eeb79bb28865.jpg not downloaded yet
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_aaee28d2383cb10149ab75afadde158f.jpg not downloaded yet
2026-04-27 08:00:17 [auto1.es] INFO: Found listing with ID: XS51461
2026-04-27 08:00:17 [auto1.es] INFO: Scrape type for XS51461: 2
2026-04-27 08:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461
2026-04-27 08:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with scrape type 2
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with scrape type 2
2026-04-27 08:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649, identifier: XS51461
2026-04-27 08:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ee7d0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_efbead4a96eb2b3bd2cc684b6447d9c2.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e1a10>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_f7dfc69393dda456ea83e6d065380f68.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdc12176-3d0c-5d5f-9181-b7c60781ad54
2026-04-27 08:00:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdc12176-3d0c-5d5f-9181-b7c60781ad54, skipping ID generation
2026-04-27 08:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc12176-3d0c-5d5f-9181-b7c60781ad54 with scrape type 1
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdc12176-3d0c-5d5f-9181-b7c60781ad54 sending to next pipeline
2026-04-27 08:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdc12176-3d0c-5d5f-9181-b7c60781ad54, identifier: CC52810
2026-04-27 08:00:18 [auto1.es] INFO: Found listing with ID: TA57631
2026-04-27 08:00:18 [auto1.es] INFO: Scrape type for TA57631: 1
2026-04-27 08:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461
2026-04-27 08:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461
2026-04-27 08:00:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a26f7ff2-8ea6-50c3-b03c-a75dab6aa649 with identifier: XS51461 to the API
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-04-27T15:02:15Z',
'fuel_type': 'petrol',
'id': 'a26f7ff2-8ea6-50c3-b03c-a75dab6aa649',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS51461',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC40',
'odometer': 95077,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-06-28',
'seller_name': None,
'title': 'Volvo XC40 1.5 T2 Momentum Core 2WD',
'transmission': 'manual',
'trim': 'Momentum Core 2WD',
'year': 2021}
2026-04-27 08:00:18 [auto1.es] INFO: Saving data for XS51461: {'auction_closing_time': 1777302135.0, 'created_time': 1777020167.739468, 'has_photos': True, 'last_price_update_time': 1777276818.346465}
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg not downloaded yet
2026-04-27 08:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdc12176-3d0c-5d5f-9181-b7c60781ad54 with identifier: CC52810
2026-04-27 08:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdc12176-3d0c-5d5f-9181-b7c60781ad54 with identifier: CC52810
2026-04-27 08:00:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdc12176-3d0c-5d5f-9181-b7c60781ad54 with identifier: CC52810 to the API
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_f7dfc69393dda456ea83e6d065380f68.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Esquivias',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:35:31Z',
'fuel_type': 'diesel',
'id': 'bdc12176-3d0c-5d5f-9181-b7c60781ad54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC52810',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Seat',
'model': 'Leon',
'odometer': 157784,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_b293543aa51bb82add9db4610a5b654b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_1ba8de8ad024f2d1a1e70e975dc89b8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_37bbd6fff9dd8992015b958820fbe5d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_4075f5fb1caaaf753ae1590941f3a2a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_a08ed0b5f2c8b0724057b93adf7bd0eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_fb6296c0eb3b531e65b44122b25c16c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_75fc3b44e8a9a0293fb0df0f89dc5e54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_ea61dc83ac4e37ac73ac7876245eb8d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_c0ea2eda80241017ceff3f322e9c8e3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdc12176-3d0c-5d5f-9181-b7c60781ad54/bdc12176-3d0c-5d5f-9181-b7c60781ad54_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/25/7f25b19349cf999edb766a2438b1a66e/pa/CC52810_f7dfc69393dda456ea83e6d065380f68.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2016-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 2.0 TDI X-Perience 4Drive',
'transmission': 'automatic',
'trim': 'X-Perience 4Drive',
'year': 2016}
2026-04-27 08:00:18 [auto1.es] INFO: Saving data for CC52810: {'created_time': 1777276818.719443, 'last_price_update_time': 1777276818.719455, 'has_photos': True, 'auction_closing_time': 1777304131.0}
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048503b50>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_34854c571fcb70d777becb844d219113.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852d050>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_a3213e870cc1a347d37b7cf2056a6b81.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [auto1.es] INFO: Found listing with ID: LG94479
2026-04-27 08:00:18 [auto1.es] INFO: Scrape type for LG94479: 2
2026-04-27 08:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479
2026-04-27 08:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9061b786-b3d5-590a-a274-a01e9e2ca649 with scrape type 2
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9061b786-b3d5-590a-a274-a01e9e2ca649 with scrape type 2
2026-04-27 08:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9061b786-b3d5-590a-a274-a01e9e2ca649, identifier: LG94479
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55e7492139f917dea4d57d9d5f41129b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_fcee8ac77c547a4540caeeba7ca28057.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_71fba6a4a5b2272f13b4199fc1611f1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_2456829e3cbc981d538b6d430ad946cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [auto1.es] INFO: Found listing with ID: US62841
2026-04-27 08:00:18 [auto1.es] INFO: Scrape type for US62841: 2
2026-04-27 08:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9926bf7c-dd9b-5dad-b02a-2496347d50ca with identifier: US62841
2026-04-27 08:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9926bf7c-dd9b-5dad-b02a-2496347d50ca with scrape type 2
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9926bf7c-dd9b-5dad-b02a-2496347d50ca with scrape type 2
2026-04-27 08:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9926bf7c-dd9b-5dad-b02a-2496347d50ca, identifier: US62841
2026-04-27 08:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479
2026-04-27 08:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479
2026-04-27 08:00:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9061b786-b3d5-590a-a274-a01e9e2ca649 with identifier: LG94479 to the API
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:29:42Z',
'fuel_type': 'petrol',
'id': '9061b786-b3d5-590a-a274-a01e9e2ca649',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG94479',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Dacia',
'model': 'Dokker',
'odometer': 70494,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-01-23',
'seller_name': None,
'title': 'Dacia Dokker 1.3 TCe SL Xplore',
'transmission': 'manual',
'trim': 'SL Xplore',
'year': 2020}
2026-04-27 08:00:19 [auto1.es] INFO: Saving data for LG94479: {'auction_closing_time': 1777303782.0, 'created_time': 1777018785.609783, 'has_photos': True, 'last_price_update_time': 1777276819.324162}
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg not downloaded yet
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV61341> (referer: https://www.auto1.com/v1/car-details-view/PV61341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ50966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885ac10>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_f8ae94a2ad2cc4942e69463f5d27696f.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048872f90>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_98629c0ebbddc588bb7f345954f19727.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0480e85d0>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_6df3b89f71cc25ed6f514562f62722b0.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824d910>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_dbd2483cb71ce6d8e7ff9652c51c34bf.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf with identifier: EA09417
2026-04-27 08:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf with scrape type 1
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_727b7d61b0dd82917e3b77cab9849e8b.jpg not downloaded yet
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_3b56b4b9efbfbb2ae3d234f1475ac40b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9926bf7c-dd9b-5dad-b02a-2496347d50ca with identifier: US62841
2026-04-27 08:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9926bf7c-dd9b-5dad-b02a-2496347d50ca with identifier: US62841
2026-04-27 08:00:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9926bf7c-dd9b-5dad-b02a-2496347d50ca with identifier: US62841 to the API
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:23:02Z',
'fuel_type': 'diesel',
'id': '9926bf7c-dd9b-5dad-b02a-2496347d50ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US62841',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Avensis',
'odometer': 149311,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-04-07',
'seller_name': None,
'title': 'Toyota Avensis 2.0 D-4D Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2013}
2026-04-27 08:00:19 [auto1.es] INFO: Saving data for US62841: {'auction_closing_time': 1777303382.0, 'created_time': 1776940916.700485, 'has_photos': True, 'last_price_update_time': 1777276819.814843}
2026-04-27 08:00:19 [auto1.es] INFO: Found listing with ID: LP80713
2026-04-27 08:00:19 [auto1.es] INFO: Scrape type for LP80713: 1
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [auto1.es] INFO: Found listing with ID: RD88147
2026-04-27 08:00:19 [auto1.es] INFO: Scrape type for RD88147: 1
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg not downloaded yet
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_461323fc44b3c8fbf05a57614a7d556a.jpg not downloaded yet
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485eecd0>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:19 [auto1.es] INFO: Found listing with ID: JK50227
2026-04-27 08:00:19 [auto1.es] INFO: Scrape type for JK50227: 2
2026-04-27 08:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed6414d4-c875-52bd-8299-c5ff33467194 with identifier: JK50227
2026-04-27 08:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed6414d4-c875-52bd-8299-c5ff33467194 with scrape type 2
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed6414d4-c875-52bd-8299-c5ff33467194 with scrape type 2
2026-04-27 08:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ed6414d4-c875-52bd-8299-c5ff33467194, identifier: JK50227
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852fa10>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55e7492139f917dea4d57d9d5f41129b.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42050>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048758310>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_fcee8ac77c547a4540caeeba7ca28057.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048494f10>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_71fba6a4a5b2272f13b4199fc1611f1e.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837ea90>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_2456829e3cbc981d538b6d430ad946cf.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4c8085-c5d5-5b77-bf32-62777e08b144 with identifier: PV61341
2026-04-27 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4c8085-c5d5-5b77-bf32-62777e08b144 with scrape type 1
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_311b825dc6ea381fa75db7518f94bbe9.jpg not downloaded yet
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b9bcaea777a5a990a056ffed3e6a62bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_1d7c4a7c8a1f3ff10838f6143c3fc81f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [auto1.es] INFO: Found listing with ID: LR89235
2026-04-27 08:00:20 [auto1.es] INFO: Scrape type for LR89235: 1
2026-04-27 08:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ed6414d4-c875-52bd-8299-c5ff33467194 with identifier: JK50227
2026-04-27 08:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ed6414d4-c875-52bd-8299-c5ff33467194 with identifier: JK50227
2026-04-27 08:00:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ed6414d4-c875-52bd-8299-c5ff33467194 with identifier: JK50227 to the API
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-04-27T15:33:24Z',
'fuel_type': 'diesel',
'id': 'ed6414d4-c875-52bd-8299-c5ff33467194',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK50227',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 40729,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-06-29',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2017}
2026-04-27 08:00:20 [auto1.es] INFO: Saving data for JK50227: {'auction_closing_time': 1777304004.0, 'created_time': 1777020376.036347, 'has_photos': True, 'last_price_update_time': 1777276820.585039}
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_8c1b147ce6c6d70ba273cc10bd3a6939.jpg not downloaded yet
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_5081e68546631c8df492eeb79bb28865.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_aaee28d2383cb10149ab75afadde158f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [auto1.es] INFO: Found listing with ID: FJ96130
2026-04-27 08:00:20 [auto1.es] INFO: Scrape type for FJ96130: 2
2026-04-27 08:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c72cc8-c6a9-5725-bba6-c02089d45c45 with identifier: FJ96130
2026-04-27 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c72cc8-c6a9-5725-bba6-c02089d45c45 with scrape type 2
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c72cc8-c6a9-5725-bba6-c02089d45c45 with scrape type 2
2026-04-27 08:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 18c72cc8-c6a9-5725-bba6-c02089d45c45, identifier: FJ96130
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_161ce003c1ab8cf0ae8ea6a7615e29a6.jpg not downloaded yet
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872c250>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_3b56b4b9efbfbb2ae3d234f1475ac40b.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d2210>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_e83df313391f85d082b6b1cc5100bc12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55d763c3a09202af197d0f2e5f401335.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [auto1.es] INFO: Found listing with ID: NT68231
2026-04-27 08:00:20 [auto1.es] INFO: Scrape type for NT68231: 2
2026-04-27 08:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4 with identifier: NT68231
2026-04-27 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4 with scrape type 2
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4 with scrape type 2
2026-04-27 08:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4, identifier: NT68231
2026-04-27 08:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 18c72cc8-c6a9-5725-bba6-c02089d45c45 with identifier: FJ96130
2026-04-27 08:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 18c72cc8-c6a9-5725-bba6-c02089d45c45 with identifier: FJ96130
2026-04-27 08:00:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 18c72cc8-c6a9-5725-bba6-c02089d45c45 with identifier: FJ96130 to the API
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:24:54Z',
'fuel_type': 'diesel',
'id': '18c72cc8-c6a9-5725-bba6-c02089d45c45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ96130',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '308',
'odometer': 154508,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-06-19',
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-04-27 08:00:21 [auto1.es] INFO: Saving data for FJ96130: {'auction_closing_time': 1777303494.0, 'created_time': 1777019842.954037, 'has_photos': True, 'last_price_update_time': 1777276821.359965}
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_28340bbfc4435504b7ca335d8b37344d.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4 with identifier: NT68231
2026-04-27 08:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4 with identifier: NT68231
2026-04-27 08:00:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4 with identifier: NT68231 to the API
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:48:13Z',
'fuel_type': 'diesel',
'id': '8e313e2a-4b2e-5555-a1e2-47d8d4af3bb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT68231',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'RCZ',
'odometer': 118289,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-10-29',
'seller_name': None,
'title': 'Peugeot RCZ 2.0 HDi Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-04-27 08:00:21 [auto1.es] INFO: Saving data for NT68231: {'auction_closing_time': 1777304893.0, 'created_time': 1777021141.720738, 'has_photos': True, 'last_price_update_time': 1777276821.715334}
2026-04-27 08:00:21 [auto1.es] INFO: Found listing with ID: AF99504
2026-04-27 08:00:21 [auto1.es] INFO: Scrape type for AF99504: 2
2026-04-27 08:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504
2026-04-27 08:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d838d0-91ba-5db9-a2f7-c31838eba90f with scrape type 2
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73d838d0-91ba-5db9-a2f7-c31838eba90f with scrape type 2
2026-04-27 08:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73d838d0-91ba-5db9-a2f7-c31838eba90f, identifier: AF99504
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_246639902f6e1d4af5a1ceb27f140a12.jpg not downloaded yet
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM01301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485fde50>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b9bcaea777a5a990a056ffed3e6a62bc.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048478fd0>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_1d7c4a7c8a1f3ff10838f6143c3fc81f.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:22 [auto1.es] INFO: Found listing with ID: HA36356
2026-04-27 08:00:22 [auto1.es] INFO: Scrape type for HA36356: 1
2026-04-27 08:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504
2026-04-27 08:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504
2026-04-27 08:00:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504 to the API
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:54:55Z',
'fuel_type': 'petrol',
'id': '73d838d0-91ba-5db9-a2f7-c31838eba90f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF99504',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 28119,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-03-02',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2023}
2026-04-27 08:00:22 [auto1.es] INFO: Saving data for AF99504: {'auction_closing_time': 1777305295.0, 'created_time': 1777021007.611501, 'has_photos': True, 'last_price_update_time': 1777276822.494964}
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg not downloaded yet
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_078ef81f72d5f363b1a8bc9fadb6e9e0.jpg not downloaded yet
2026-04-27 08:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048697050>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235b10>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_5081e68546631c8df492eeb79bb28865.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048640cd0>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_aaee28d2383cb10149ab75afadde158f.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_8c1b147ce6c6d70ba273cc10bd3a6939.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_461323fc44b3c8fbf05a57614a7d556a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [auto1.es] INFO: Found listing with ID: HE42254
2026-04-27 08:00:22 [auto1.es] INFO: Scrape type for HE42254: 2
2026-04-27 08:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254
2026-04-27 08:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e997dbe8-3316-5a84-ba7f-f81f60660100 with scrape type 2
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e997dbe8-3316-5a84-ba7f-f81f60660100 with scrape type 2
2026-04-27 08:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e997dbe8-3316-5a84-ba7f-f81f60660100, identifier: HE42254
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_94844cec1057e8e084f997ef90d5fcfb.jpg not downloaded yet
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048425250>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b0fd0>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_e83df313391f85d082b6b1cc5100bc12.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53
2026-04-27 08:00:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8a1c3d5-2cc3-5787-bf85-5046b385ef53, skipping ID generation
2026-04-27 08:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with scrape type 1
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8a1c3d5-2cc3-5787-bf85-5046b385ef53 sending to next pipeline
2026-04-27 08:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8a1c3d5-2cc3-5787-bf85-5046b385ef53, identifier: CT91769
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048654090>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55d763c3a09202af197d0f2e5f401335.jpg saved to cache
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af46a086-93d7-5ac9-b25f-351bf03ef09d
2026-04-27 08:00:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af46a086-93d7-5ac9-b25f-351bf03ef09d, skipping ID generation
2026-04-27 08:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af46a086-93d7-5ac9-b25f-351bf03ef09d with scrape type 1
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af46a086-93d7-5ac9-b25f-351bf03ef09d sending to next pipeline
2026-04-27 08:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af46a086-93d7-5ac9-b25f-351bf03ef09d, identifier: XX98366
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_311b825dc6ea381fa75db7518f94bbe9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [auto1.es] INFO: Found listing with ID: NV07179
2026-04-27 08:00:23 [auto1.es] INFO: Scrape type for NV07179: 2
2026-04-27 08:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe5c2be-1ae7-5fec-94bc-35929463d5da with identifier: NV07179
2026-04-27 08:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe5c2be-1ae7-5fec-94bc-35929463d5da with scrape type 2
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fe5c2be-1ae7-5fec-94bc-35929463d5da with scrape type 2
2026-04-27 08:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6fe5c2be-1ae7-5fec-94bc-35929463d5da, identifier: NV07179
2026-04-27 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254
2026-04-27 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254
2026-04-27 08:00:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e997dbe8-3316-5a84-ba7f-f81f60660100 with identifier: HE42254 to the API
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:17:24Z',
'fuel_type': 'petrol',
'id': 'e997dbe8-3316-5a84-ba7f-f81f60660100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE42254',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 31461,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-11-29',
'seller_name': None,
'title': 'Audi A1 Sportback 35 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-04-27 08:00:23 [auto1.es] INFO: Saving data for HE42254: {'auction_closing_time': 1777303044.0, 'created_time': 1777020751.952985, 'has_photos': True, 'last_price_update_time': 1777276823.565479}
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_ba974af8187f620671c1df050b38bf34.jpg not downloaded yet
2026-04-27 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769
2026-04-27 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769
2026-04-27 08:00:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8a1c3d5-2cc3-5787-bf85-5046b385ef53 with identifier: CT91769 to the API
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_e83df313391f85d082b6b1cc5100bc12.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Esquivias',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:06:17Z',
'fuel_type': 'diesel',
'id': 'c8a1c3d5-2cc3-5787-bf85-5046b385ef53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT91769',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'BMW',
'model': '3er',
'odometer': 264811,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_50a0759e95dcc60531ff21818da9df31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_3b56b4b9efbfbb2ae3d234f1475ac40b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_301d8a986ec357f69870375b373fecd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_f8ae94a2ad2cc4942e69463f5d27696f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_a3213e870cc1a347d37b7cf2056a6b81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_6df3b89f71cc25ed6f514562f62722b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_2456829e3cbc981d538b6d430ad946cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_fcee8ac77c547a4540caeeba7ca28057.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_e83df313391f85d082b6b1cc5100bc12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8a1c3d5-2cc3-5787-bf85-5046b385ef53/c8a1c3d5-2cc3-5787-bf85-5046b385ef53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/63/6863ad7cbc6bac291585bac793432b8f/pa/CT91769_aaee28d2383cb10149ab75afadde158f.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2014-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 08:00:23 [auto1.es] INFO: Saving data for CT91769: {'created_time': 1777276823.948018, 'last_price_update_time': 1777276823.948034, 'has_photos': True, 'auction_closing_time': 1777302377.0}
2026-04-27 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366
2026-04-27 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366
2026-04-27 08:00:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366 to the API
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55d763c3a09202af197d0f2e5f401335.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Madrid',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 235,
'expiration_date': '2026-04-27T15:28:44Z',
'fuel_type': 'diesel',
'id': 'af46a086-93d7-5ac9-b25f-351bf03ef09d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX98366',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Volvo',
'model': 'XC90',
'odometer': 211338,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_08fe630efc1cd065396a7da85ddcd47a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_1d7c4a7c8a1f3ff10838f6143c3fc81f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_7ed4fd35c57957974ef1f9ff718c0627.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_34854c571fcb70d777becb844d219113.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_efbead4a96eb2b3bd2cc684b6447d9c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_98629c0ebbddc588bb7f345954f19727.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55e7492139f917dea4d57d9d5f41129b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_71fba6a4a5b2272f13b4199fc1611f1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_55d763c3a09202af197d0f2e5f401335.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af46a086-93d7-5ac9-b25f-351bf03ef09d/af46a086-93d7-5ac9-b25f-351bf03ef09d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/15/f1155f1ea0441262c6f7dc3eb0df0162/pa/XX98366_5081e68546631c8df492eeb79bb28865.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2016-10-10',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2016}
2026-04-27 08:00:24 [auto1.es] INFO: Saving data for XX98366: {'created_time': 1777276824.377065, 'last_price_update_time': 1777276824.377075, 'has_photos': True, 'auction_closing_time': 1777303724.0}
2026-04-27 08:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6fe5c2be-1ae7-5fec-94bc-35929463d5da with identifier: NV07179
2026-04-27 08:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6fe5c2be-1ae7-5fec-94bc-35929463d5da with identifier: NV07179
2026-04-27 08:00:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6fe5c2be-1ae7-5fec-94bc-35929463d5da with identifier: NV07179 to the API
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:15:17Z',
'fuel_type': 'diesel',
'id': '6fe5c2be-1ae7-5fec-94bc-35929463d5da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV07179',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q3',
'odometer': 92024,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-10-18',
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-04-27 08:00:24 [auto1.es] INFO: Saving data for NV07179: {'auction_closing_time': 1777302917.0, 'created_time': 1777019326.290635, 'has_photos': True, 'last_price_update_time': 1777276824.677118}
2026-04-27 08:00:24 [auto1.es] INFO: Found listing with ID: AB95779
2026-04-27 08:00:24 [auto1.es] INFO: Scrape type for AB95779: 2
2026-04-27 08:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62 with identifier: AB95779
2026-04-27 08:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62 with scrape type 2
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62 with scrape type 2
2026-04-27 08:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62, identifier: AB95779
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7895eb2a417a6a6e8252f8912ced3d05.jpg not downloaded yet
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_28340bbfc4435504b7ca335d8b37344d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [auto1.es] INFO: Found listing with ID: HP31470
2026-04-27 08:00:24 [auto1.es] INFO: Scrape type for HP31470: 1
2026-04-27 08:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62 with identifier: AB95779
2026-04-27 08:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62 with identifier: AB95779
2026-04-27 08:00:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4aa5f7cd-7eae-5b68-8f8b-bec15e641c62 with identifier: AB95779 to the API
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:07:29Z',
'fuel_type': 'diesel',
'id': '4aa5f7cd-7eae-5b68-8f8b-bec15e641c62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB95779',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 144096,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-09-06',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 ed4 SE Dynamic',
'transmission': 'manual',
'trim': 'SE Dynamic',
'year': 2017}
2026-04-27 08:00:25 [auto1.es] INFO: Saving data for AB95779: {'auction_closing_time': 1777302449.0, 'created_time': 1777021342.211133, 'has_photos': True, 'last_price_update_time': 1777276825.14333}
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_d118bfc0f476db3317b84b85f4603816.jpg not downloaded yet
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b2bd0>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_8c1b147ce6c6d70ba273cc10bd3a6939.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048160810>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_461323fc44b3c8fbf05a57614a7d556a.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:25 [auto1.es] INFO: Found listing with ID: PK37230
2026-04-27 08:00:25 [auto1.es] INFO: Scrape type for PK37230: 1
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_b56e0279bce59e821a670c4c41478378.jpg not downloaded yet
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ec390>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048870410>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_311b825dc6ea381fa75db7518f94bbe9.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880fcd0>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_078ef81f72d5f363b1a8bc9fadb6e9e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_246639902f6e1d4af5a1ceb27f140a12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:25 [auto1.es] INFO: Found listing with ID: EJ63099
2026-04-27 08:00:25 [auto1.es] INFO: Scrape type for EJ63099: 2
2026-04-27 08:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0daabd-306b-56a0-aead-113716fe1a3e with identifier: EJ63099
2026-04-27 08:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0daabd-306b-56a0-aead-113716fe1a3e with scrape type 2
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f0daabd-306b-56a0-aead-113716fe1a3e with scrape type 2
2026-04-27 08:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f0daabd-306b-56a0-aead-113716fe1a3e, identifier: EJ63099
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_7818f276ba205c3593e7984e30b3b124.jpg not downloaded yet
2026-04-27 08:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f0daabd-306b-56a0-aead-113716fe1a3e with identifier: EJ63099
2026-04-27 08:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f0daabd-306b-56a0-aead-113716fe1a3e with identifier: EJ63099
2026-04-27 08:00:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f0daabd-306b-56a0-aead-113716fe1a3e with identifier: EJ63099 to the API
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:00:21Z',
'fuel_type': 'diesel',
'id': '6f0daabd-306b-56a0-aead-113716fe1a3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ63099',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'C-Max',
'odometer': 120913,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-02-13',
'seller_name': None,
'title': 'Ford C-Max 1.5 TDCi Titanium X',
'transmission': 'automatic',
'trim': 'Titanium X',
'year': 2018}
2026-04-27 08:00:25 [auto1.es] INFO: Saving data for EJ63099: {'auction_closing_time': 1777302021.0, 'created_time': 1777018171.978419, 'has_photos': True, 'last_price_update_time': 1777276825.852012}
2026-04-27 08:00:25 [auto1.es] INFO: Found listing with ID: UT27330
2026-04-27 08:00:25 [auto1.es] INFO: Scrape type for UT27330: 2
2026-04-27 08:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52576610-eb8c-59b3-a253-c2808ebafb1e with identifier: UT27330
2026-04-27 08:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52576610-eb8c-59b3-a253-c2808ebafb1e with scrape type 2
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52576610-eb8c-59b3-a253-c2808ebafb1e with scrape type 2
2026-04-27 08:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52576610-eb8c-59b3-a253-c2808ebafb1e, identifier: UT27330
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_2d62dfb033da6e0e46f28765a0e4b0ee.jpg not downloaded yet
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483834d0>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_28340bbfc4435504b7ca335d8b37344d.jpg saved to cache
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_ba974af8187f620671c1df050b38bf34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:26 [auto1.es] INFO: Found listing with ID: BH68566
2026-04-27 08:00:26 [auto1.es] INFO: Scrape type for BH68566: 2
2026-04-27 08:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc with identifier: BH68566
2026-04-27 08:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc with scrape type 2
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc with scrape type 2
2026-04-27 08:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc, identifier: BH68566
2026-04-27 08:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52576610-eb8c-59b3-a253-c2808ebafb1e with identifier: UT27330
2026-04-27 08:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52576610-eb8c-59b3-a253-c2808ebafb1e with identifier: UT27330
2026-04-27 08:00:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52576610-eb8c-59b3-a253-c2808ebafb1e with identifier: UT27330 to the API
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:08:40Z',
'fuel_type': 'petrol',
'id': '52576610-eb8c-59b3-a253-c2808ebafb1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT27330',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 191673,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-10-05',
'seller_name': None,
'title': 'Seat Leon 1.5 TSI ACT FR Fast Lane Plus',
'transmission': 'manual',
'trim': 'FR Fast Lane Plus',
'year': 2020}
2026-04-27 08:00:26 [auto1.es] INFO: Saving data for UT27330: {'auction_closing_time': 1777302520.0, 'created_time': 1777021140.966634, 'has_photos': True, 'last_price_update_time': 1777276826.406147}
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_6dbab68557a37fce0754c7c630b35387.jpg not downloaded yet
2026-04-27 08:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc with identifier: BH68566
2026-04-27 08:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc with identifier: BH68566
2026-04-27 08:00:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d12c909-6232-5fe7-bf7f-50a0d94ad1cc with identifier: BH68566 to the API
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-04-27T15:01:49Z',
'fuel_type': 'diesel',
'id': '2d12c909-6232-5fe7-bf7f-50a0d94ad1cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH68566',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Espace',
'odometer': 143246,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-03-20',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-04-27 08:00:26 [auto1.es] INFO: Saving data for BH68566: {'auction_closing_time': 1777302109.0, 'created_time': 1777021142.338814, 'has_photos': True, 'last_price_update_time': 1777276826.806061}
2026-04-27 08:00:26 [auto1.es] INFO: Found listing with ID: HA89613
2026-04-27 08:00:26 [auto1.es] INFO: Scrape type for HA89613: 1
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7ac2e810baff08950289eaa2bb0a5d29.jpg not downloaded yet
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3f590>
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_078ef81f72d5f363b1a8bc9fadb6e9e0.jpg saved to cache
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b490>
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_246639902f6e1d4af5a1ceb27f140a12.jpg saved to cache
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f1c50>
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg saved to cache
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_d118bfc0f476db3317b84b85f4603816.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:26 [auto1.es] INFO: Found listing with ID: FX14772
2026-04-27 08:00:26 [auto1.es] INFO: Scrape type for FX14772: 2
2026-04-27 08:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772
2026-04-27 08:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e33d0c71-b0b6-506d-ae87-2d42667414b1 with scrape type 2
2026-04-27 08:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e33d0c71-b0b6-506d-ae87-2d42667414b1 with scrape type 2
2026-04-27 08:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e33d0c71-b0b6-506d-ae87-2d42667414b1, identifier: FX14772
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_3e6da0c1d2444b823aaee1f4ed96dfb0.jpg not downloaded yet
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a0250>
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg saved to cache
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772
2026-04-27 08:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772
2026-04-27 08:00:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772 to the API
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:37:04Z',
'fuel_type': 'diesel',
'id': 'e33d0c71-b0b6-506d-ae87-2d42667414b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX14772',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Jumper',
'odometer': 125678,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-12-29',
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H1',
'transmission': 'manual',
'trim': '33 L2H1',
'year': 2020}
2026-04-27 08:00:27 [auto1.es] INFO: Saving data for FX14772: {'auction_closing_time': 1777304224.0, 'created_time': 1777021238.653546, 'has_photos': True, 'last_price_update_time': 1777276827.410205}
2026-04-27 08:00:27 [auto1.es] INFO: Found listing with ID: WC06824
2026-04-27 08:00:27 [auto1.es] INFO: Scrape type for WC06824: 2
2026-04-27 08:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cde8d98-972c-56b8-bbda-0fa6ce628317 with identifier: WC06824
2026-04-27 08:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cde8d98-972c-56b8-bbda-0fa6ce628317 with scrape type 2
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cde8d98-972c-56b8-bbda-0fa6ce628317 with scrape type 2
2026-04-27 08:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2cde8d98-972c-56b8-bbda-0fa6ce628317, identifier: WC06824
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_08066bcd806e05863d83571696703e21.jpg not downloaded yet
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048604f50>
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_ba974af8187f620671c1df050b38bf34.jpg saved to cache
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_7818f276ba205c3593e7984e30b3b124.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_b56e0279bce59e821a670c4c41478378.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:27 [auto1.es] INFO: Found listing with ID: KE66826
2026-04-27 08:00:27 [auto1.es] INFO: Scrape type for KE66826: 0
2026-04-27 08:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2cde8d98-972c-56b8-bbda-0fa6ce628317 with identifier: WC06824
2026-04-27 08:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2cde8d98-972c-56b8-bbda-0fa6ce628317 with identifier: WC06824
2026-04-27 08:00:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2cde8d98-972c-56b8-bbda-0fa6ce628317 with identifier: WC06824 to the API
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:23:24Z',
'fuel_type': 'diesel',
'id': '2cde8d98-972c-56b8-bbda-0fa6ce628317',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC06824',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 55756,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-10-14',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-04-27 08:00:27 [auto1.es] INFO: Saving data for WC06824: {'auction_closing_time': 1777303404.0, 'created_time': 1777020904.110671, 'has_photos': True, 'last_price_update_time': 1777276827.92023}
2026-04-27 08:00:27 [auto1.es] INFO: Found listing with ID: VN13138
2026-04-27 08:00:27 [auto1.es] INFO: Scrape type for VN13138: 2
2026-04-27 08:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138
2026-04-27 08:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b48a987-fb35-560f-b40b-f47d46ab8def with scrape type 2
2026-04-27 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b48a987-fb35-560f-b40b-f47d46ab8def with scrape type 2
2026-04-27 08:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b48a987-fb35-560f-b40b-f47d46ab8def, identifier: VN13138
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_cc2d1289c51cff266af09042a762b9b5.jpg not downloaded yet
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048167390>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_d118bfc0f476db3317b84b85f4603816.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_6dbab68557a37fce0754c7c630b35387.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138
2026-04-27 08:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138
2026-04-27 08:00:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b48a987-fb35-560f-b40b-f47d46ab8def with identifier: VN13138 to the API
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:20:41Z',
'fuel_type': 'diesel',
'id': '6b48a987-fb35-560f-b40b-f47d46ab8def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN13138',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 189909,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-14',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Sport BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport BlueMotion Tech',
'year': 2016}
2026-04-27 08:00:28 [auto1.es] INFO: Saving data for VN13138: {'auction_closing_time': 1777303241.0, 'created_time': 1777020722.310484, 'has_photos': True, 'last_price_update_time': 1777276828.404258}
2026-04-27 08:00:28 [auto1.es] INFO: Found listing with ID: XL99979
2026-04-27 08:00:28 [auto1.es] INFO: Scrape type for XL99979: 2
2026-04-27 08:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d03b2294-6721-5eee-8988-5b7ff8560ecd with identifier: XL99979
2026-04-27 08:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d03b2294-6721-5eee-8988-5b7ff8560ecd with scrape type 2
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d03b2294-6721-5eee-8988-5b7ff8560ecd with scrape type 2
2026-04-27 08:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d03b2294-6721-5eee-8988-5b7ff8560ecd, identifier: XL99979
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048930790>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_7818f276ba205c3593e7984e30b3b124.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048876310>
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_b56e0279bce59e821a670c4c41478378.jpg saved to cache
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_3e6da0c1d2444b823aaee1f4ed96dfb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d03b2294-6721-5eee-8988-5b7ff8560ecd with identifier: XL99979
2026-04-27 08:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d03b2294-6721-5eee-8988-5b7ff8560ecd with identifier: XL99979
2026-04-27 08:00:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d03b2294-6721-5eee-8988-5b7ff8560ecd with identifier: XL99979 to the API
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:42:31Z',
'fuel_type': 'petrol',
'id': 'd03b2294-6721-5eee-8988-5b7ff8560ecd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL99979',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 36670,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2024-05-30',
'seller_name': None,
'title': 'Skoda Kodiaq 1.5 TSI ACT Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2024}
2026-04-27 08:00:28 [auto1.es] INFO: Saving data for XL99979: {'auction_closing_time': 1777304551.0, 'created_time': 1777019931.579864, 'has_photos': True, 'last_price_update_time': 1777276828.910088}
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7ac2e810baff08950289eaa2bb0a5d29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:28 [auto1.es] INFO: Found listing with ID: NZ61100
2026-04-27 08:00:28 [auto1.es] INFO: Scrape type for NZ61100: 2
2026-04-27 08:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100
2026-04-27 08:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e7a164-81ed-5170-9c6e-530bda423157 with scrape type 2
2026-04-27 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01e7a164-81ed-5170-9c6e-530bda423157 with scrape type 2
2026-04-27 08:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01e7a164-81ed-5170-9c6e-530bda423157, identifier: NZ61100
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3f50>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_6dbab68557a37fce0754c7c630b35387.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100
2026-04-27 08:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100
2026-04-27 08:00:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100 to the API
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:53:10Z',
'fuel_type': 'petrol',
'id': '01e7a164-81ed-5170-9c6e-530bda423157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ61100',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X3',
'odometer': 62325,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-07-26',
'seller_name': None,
'title': 'BMW X3 xDrive 20i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-04-27 08:00:29 [auto1.es] INFO: Saving data for NZ61100: {'auction_closing_time': 1777305190.0, 'created_time': 1777020872.754987, 'has_photos': True, 'last_price_update_time': 1777276829.348356}
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_08066bcd806e05863d83571696703e21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [auto1.es] INFO: Found listing with ID: YT85498
2026-04-27 08:00:29 [auto1.es] INFO: Scrape type for YT85498: 1
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fc8d0>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_3e6da0c1d2444b823aaee1f4ed96dfb0.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_cc2d1289c51cff266af09042a762b9b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [auto1.es] INFO: Found listing with ID: TC70621
2026-04-27 08:00:29 [auto1.es] INFO: Scrape type for TC70621: 2
2026-04-27 08:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621
2026-04-27 08:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with scrape type 2
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with scrape type 2
2026-04-27 08:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa2f0120-01b1-52d6-a2b4-91a67bf87e02, identifier: TC70621
2026-04-27 08:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621
2026-04-27 08:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621
2026-04-27 08:00:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621 to the API
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:04:33Z',
'fuel_type': 'petrol',
'id': 'fa2f0120-01b1-52d6-a2b4-91a67bf87e02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC70621',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 89780,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-08-09',
'seller_name': None,
'title': 'Renault Grand Scenic 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-04-27 08:00:29 [auto1.es] INFO: Saving data for TC70621: {'auction_closing_time': 1777302273.0, 'created_time': 1777021250.362566, 'has_photos': True, 'last_price_update_time': 1777276829.830888}
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048875c90>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7ac2e810baff08950289eaa2bb0a5d29.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:29 [auto1.es] INFO: Found listing with ID: PU00730
2026-04-27 08:00:29 [auto1.es] INFO: Scrape type for PU00730: 2
2026-04-27 08:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2be253f-5670-5e35-bee5-49361ecd64dc with identifier: PU00730
2026-04-27 08:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2be253f-5670-5e35-bee5-49361ecd64dc with scrape type 2
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2be253f-5670-5e35-bee5-49361ecd64dc with scrape type 2
2026-04-27 08:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2be253f-5670-5e35-bee5-49361ecd64dc, identifier: PU00730
2026-04-27 08:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2be253f-5670-5e35-bee5-49361ecd64dc with identifier: PU00730
2026-04-27 08:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2be253f-5670-5e35-bee5-49361ecd64dc with identifier: PU00730
2026-04-27 08:00:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2be253f-5670-5e35-bee5-49361ecd64dc with identifier: PU00730 to the API
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 235,
'expiration_date': '2026-04-27T15:27:19Z',
'fuel_type': 'diesel',
'id': 'f2be253f-5670-5e35-bee5-49361ecd64dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU00730',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 220112,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-02-22',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 350 CDI Standard',
'transmission': 'automatic',
'trim': 'Standard',
'year': 2011}
2026-04-27 08:00:30 [auto1.es] INFO: Saving data for PU00730: {'auction_closing_time': 1777303639.0, 'created_time': 1777021211.333494, 'has_photos': True, 'last_price_update_time': 1777276830.32666}
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_2d62dfb033da6e0e46f28765a0e4b0ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [auto1.es] INFO: Found listing with ID: JR29098
2026-04-27 08:00:30 [auto1.es] INFO: Scrape type for JR29098: 2
2026-04-27 08:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42d081b-5626-586c-a442-9bef8fdf4a74 with identifier: JR29098
2026-04-27 08:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42d081b-5626-586c-a442-9bef8fdf4a74 with scrape type 2
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42d081b-5626-586c-a442-9bef8fdf4a74 with scrape type 2
2026-04-27 08:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b42d081b-5626-586c-a442-9bef8fdf4a74, identifier: JR29098
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ00848> (referer: https://www.auto1.com/v1/car-details-view/RJ00848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048607b90>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_08066bcd806e05863d83571696703e21.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ee750>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_cc2d1289c51cff266af09042a762b9b5.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b42d081b-5626-586c-a442-9bef8fdf4a74 with identifier: JR29098
2026-04-27 08:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b42d081b-5626-586c-a442-9bef8fdf4a74 with identifier: JR29098
2026-04-27 08:00:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b42d081b-5626-586c-a442-9bef8fdf4a74 with identifier: JR29098 to the API
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:49:20Z',
'fuel_type': 'diesel',
'id': 'b42d081b-5626-586c-a442-9bef8fdf4a74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR29098',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 107740,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-12-02',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
'transmission': 'manual',
'trim': 'Allure L1',
'year': 2020}
2026-04-27 08:00:31 [auto1.es] INFO: Saving data for JR29098: {'auction_closing_time': 1777304960.0, 'created_time': 1777021229.665536, 'has_photos': True, 'last_price_update_time': 1777276831.543342}
2026-04-27 08:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA57631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:31 [auto1.es] INFO: Found listing with ID: AK39798
2026-04-27 08:00:31 [auto1.es] INFO: Scrape type for AK39798: 2
2026-04-27 08:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5882033c-b0fe-5b39-b51a-95bbf37864ed with identifier: AK39798
2026-04-27 08:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5882033c-b0fe-5b39-b51a-95bbf37864ed with scrape type 2
2026-04-27 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5882033c-b0fe-5b39-b51a-95bbf37864ed with scrape type 2
2026-04-27 08:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5882033c-b0fe-5b39-b51a-95bbf37864ed, identifier: AK39798
2026-04-27 08:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5882033c-b0fe-5b39-b51a-95bbf37864ed with identifier: AK39798
2026-04-27 08:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5882033c-b0fe-5b39-b51a-95bbf37864ed with identifier: AK39798
2026-04-27 08:00:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5882033c-b0fe-5b39-b51a-95bbf37864ed with identifier: AK39798 to the API
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-04-27T15:16:48Z',
'fuel_type': 'diesel',
'id': '5882033c-b0fe-5b39-b51a-95bbf37864ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK39798',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'CLC-Klasse',
'odometer': 77763,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-07-26',
'seller_name': None,
'title': 'Mercedes-Benz CLC-Klasse CLC 200 CDI',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-04-27 08:00:33 [auto1.es] INFO: Saving data for AK39798: {'auction_closing_time': 1777303008.0, 'created_time': 1777020770.411866, 'has_photos': True, 'last_price_update_time': 1777276833.032374}
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ01434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [auto1.es] INFO: Found listing with ID: MS01724
2026-04-27 08:00:33 [auto1.es] INFO: Scrape type for MS01724: 1
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048874250>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_2d62dfb033da6e0e46f28765a0e4b0ee.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f5c1371-dc24-55a4-86f6-427ee840293c with identifier: RJ00848
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5c1371-dc24-55a4-86f6-427ee840293c with scrape type 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_b963b89b9f2f79492feec329a0a23a52.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.es] INFO: Found listing with ID: TW01400
2026-04-27 08:00:33 [auto1.es] INFO: Scrape type for TW01400: 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_5e09ff3099be79df66c34e06db95f675.jpg not downloaded yet
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7895eb2a417a6a6e8252f8912ced3d05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [auto1.es] INFO: Found listing with ID: VH67145
2026-04-27 08:00:33 [auto1.es] INFO: Scrape type for VH67145: 2
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b29b3eba-8a51-53ef-b553-ab27a0047b72 with scrape type 2
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b29b3eba-8a51-53ef-b553-ab27a0047b72 with scrape type 2
2026-04-27 08:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b29b3eba-8a51-53ef-b553-ab27a0047b72, identifier: VH67145
2026-04-27 08:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145
2026-04-27 08:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145
2026-04-27 08:00:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b29b3eba-8a51-53ef-b553-ab27a0047b72 with identifier: VH67145 to the API
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:46:55Z',
'fuel_type': 'diesel',
'id': 'b29b3eba-8a51-53ef-b553-ab27a0047b72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH67145',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 54622,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-05-06',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI advanced',
'transmission': 'automatic',
'trim': 'advanced',
'year': 2021}
2026-04-27 08:00:33 [auto1.es] INFO: Saving data for VH67145: {'auction_closing_time': 1777304815.0, 'created_time': 1777021248.419557, 'has_photos': True, 'last_price_update_time': 1777276833.584}
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_fec94f925eecfe392c90312995e2e943.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.es] INFO: Found listing with ID: UE59735
2026-04-27 08:00:33 [auto1.es] INFO: Scrape type for UE59735: 1
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_161ce003c1ab8cf0ae8ea6a7615e29a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_94844cec1057e8e084f997ef90d5fcfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_7e51e94b629e8c2bf5a4deb5173e57eb.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.es] INFO: Found listing with ID: UJ65320
2026-04-27 08:00:33 [auto1.es] INFO: Scrape type for UJ65320: 1
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048932d10>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7895eb2a417a6a6e8252f8912ced3d05.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_e57ecc7b2c054dd2a06968d3bccbe954.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.es] INFO: Found listing with ID: MF93067
2026-04-27 08:00:33 [auto1.es] INFO: Scrape type for MF93067: 2
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 457eec5f-69d1-51ae-a73e-559f60812921 with identifier: MF93067
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 457eec5f-69d1-51ae-a73e-559f60812921 with scrape type 2
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 457eec5f-69d1-51ae-a73e-559f60812921 with scrape type 2
2026-04-27 08:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 457eec5f-69d1-51ae-a73e-559f60812921, identifier: MF93067
2026-04-27 08:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 457eec5f-69d1-51ae-a73e-559f60812921 with identifier: MF93067
2026-04-27 08:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 457eec5f-69d1-51ae-a73e-559f60812921 with identifier: MF93067
2026-04-27 08:00:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 457eec5f-69d1-51ae-a73e-559f60812921 with identifier: MF93067 to the API
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:12:49Z',
'fuel_type': 'diesel',
'id': '457eec5f-69d1-51ae-a73e-559f60812921',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF93067',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 233320,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-05-09',
'seller_name': None,
'title': 'BMW 1er 116d M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2018}
2026-04-27 08:00:34 [auto1.es] INFO: Saving data for MF93067: {'auction_closing_time': 1777302769.0, 'created_time': 1777020900.19201, 'has_photos': True, 'last_price_update_time': 1777276834.152246}
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_30f6bd111add072105eb2a3eb3d56224.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.es] INFO: Found listing with ID: RL65446
2026-04-27 08:00:34 [auto1.es] INFO: Scrape type for RL65446: 2
2026-04-27 08:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b48e7ff-79fa-53e4-b876-5a86c8d14d43 with identifier: RL65446
2026-04-27 08:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b48e7ff-79fa-53e4-b876-5a86c8d14d43 with scrape type 2
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b48e7ff-79fa-53e4-b876-5a86c8d14d43 with scrape type 2
2026-04-27 08:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b48e7ff-79fa-53e4-b876-5a86c8d14d43, identifier: RL65446
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_5e09ff3099be79df66c34e06db95f675.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_fec94f925eecfe392c90312995e2e943.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [scrapy.extensions.logstats] INFO: Crawled 323 pages (at 42 pages/min), scraped 410 items (at 69 items/min)
2026-04-27 08:00:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b48e7ff-79fa-53e4-b876-5a86c8d14d43 with identifier: RL65446
2026-04-27 08:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b48e7ff-79fa-53e4-b876-5a86c8d14d43 with identifier: RL65446
2026-04-27 08:00:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b48e7ff-79fa-53e4-b876-5a86c8d14d43 with identifier: RL65446 to the API
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:09:24Z',
'fuel_type': 'diesel',
'id': '2b48e7ff-79fa-53e4-b876-5a86c8d14d43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL65446',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 56730,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-06-07',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2022}
2026-04-27 08:00:34 [auto1.es] INFO: Saving data for RL65446: {'auction_closing_time': 1777302564.0, 'created_time': 1777021132.218035, 'has_photos': True, 'last_price_update_time': 1777276834.585968}
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_f3827911a40435d80b0bc97bca806911.jpg not downloaded yet
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048166050>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_161ce003c1ab8cf0ae8ea6a7615e29a6.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488410d0>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_94844cec1057e8e084f997ef90d5fcfb.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b4c8085-c5d5-5b77-bf32-62777e08b144
2026-04-27 08:00:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b4c8085-c5d5-5b77-bf32-62777e08b144, skipping ID generation
2026-04-27 08:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4c8085-c5d5-5b77-bf32-62777e08b144 with scrape type 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b4c8085-c5d5-5b77-bf32-62777e08b144 sending to next pipeline
2026-04-27 08:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b4c8085-c5d5-5b77-bf32-62777e08b144, identifier: PV61341
2026-04-27 08:00:34 [auto1.es] INFO: Found listing with ID: SF41983
2026-04-27 08:00:34 [auto1.es] INFO: Scrape type for SF41983: 1
2026-04-27 08:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b4c8085-c5d5-5b77-bf32-62777e08b144 with identifier: PV61341
2026-04-27 08:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b4c8085-c5d5-5b77-bf32-62777e08b144 with identifier: PV61341
2026-04-27 08:00:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b4c8085-c5d5-5b77-bf32-62777e08b144 with identifier: PV61341 to the API
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_94844cec1057e8e084f997ef90d5fcfb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'city': 'Esquivias',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:57:27Z',
'fuel_type': 'petrol',
'id': '9b4c8085-c5d5-5b77-bf32-62777e08b144',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV61341',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Mazda',
'model': '2',
'odometer': 75643,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_311b825dc6ea381fa75db7518f94bbe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_161ce003c1ab8cf0ae8ea6a7615e29a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_246639902f6e1d4af5a1ceb27f140a12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_94844cec1057e8e084f997ef90d5fcfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7895eb2a417a6a6e8252f8912ced3d05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_b56e0279bce59e821a670c4c41478378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_2d62dfb033da6e0e46f28765a0e4b0ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_7ac2e810baff08950289eaa2bb0a5d29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_08066bcd806e05863d83571696703e21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b4c8085-c5d5-5b77-bf32-62777e08b144/9b4c8085-c5d5-5b77-bf32-62777e08b144_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/3d/083db813be20ce4ff4c48bcfc3a86555/pa/PV61341_cc2d1289c51cff266af09042a762b9b5.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2022-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda 2 1.5 e-Skyactiv-G Mild-Hybrid Homura',
'transmission': 'manual',
'trim': 'Homura',
'year': 2022}
2026-04-27 08:00:35 [auto1.es] INFO: Saving data for PV61341: {'created_time': 1777276835.119306, 'last_price_update_time': 1777276835.119315, 'has_photos': True, 'auction_closing_time': 1777305447.0}
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_11cc8d1e2424dab1a4f38163f66eddca.jpg not downloaded yet
2026-04-27 08:00:35 [auto1.es] INFO: Found listing with ID: EN73965
2026-04-27 08:00:35 [auto1.es] INFO: Scrape type for EN73965: 2
2026-04-27 08:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965
2026-04-27 08:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with scrape type 2
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with scrape type 2
2026-04-27 08:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 902ca510-e4bd-5813-b13a-8a9dc35c39b4, identifier: EN73965
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS59468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ50966> (referer: https://www.auto1.com/v1/car-details-view/KJ50966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a0f90>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_5e09ff3099be79df66c34e06db95f675.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209510>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_fec94f925eecfe392c90312995e2e943.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965
2026-04-27 08:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965
2026-04-27 08:00:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965 to the API
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:47:26Z',
'fuel_type': 'diesel',
'id': '902ca510-e4bd-5813-b13a-8a9dc35c39b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN73965',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 88128,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-10-03',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-04-27 08:00:35 [auto1.es] INFO: Saving data for EN73965: {'auction_closing_time': 1777304846.0, 'created_time': 1777021145.454679, 'has_photos': True, 'last_price_update_time': 1777276835.657259}
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_2b01bb03403dbc386054d10bf8a0a26a.jpg not downloaded yet
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [auto1.es] INFO: Found listing with ID: UT30126
2026-04-27 08:00:35 [auto1.es] INFO: Scrape type for UT30126: 2
2026-04-27 08:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e07747a0-073d-5a50-8d4e-0acab90789bd with identifier: UT30126
2026-04-27 08:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e07747a0-073d-5a50-8d4e-0acab90789bd with scrape type 2
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e07747a0-073d-5a50-8d4e-0acab90789bd with scrape type 2
2026-04-27 08:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e07747a0-073d-5a50-8d4e-0acab90789bd, identifier: UT30126
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_e57ecc7b2c054dd2a06968d3bccbe954.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_30f6bd111add072105eb2a3eb3d56224.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e07747a0-073d-5a50-8d4e-0acab90789bd with identifier: UT30126
2026-04-27 08:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e07747a0-073d-5a50-8d4e-0acab90789bd with identifier: UT30126
2026-04-27 08:00:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e07747a0-073d-5a50-8d4e-0acab90789bd with identifier: UT30126 to the API
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:13:08Z',
'fuel_type': 'diesel',
'id': 'e07747a0-073d-5a50-8d4e-0acab90789bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT30126',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 72853,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-10-15',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-04-27 08:00:36 [auto1.es] INFO: Saving data for UT30126: {'auction_closing_time': 1777302788.0, 'created_time': 1777021238.067474, 'has_photos': True, 'last_price_update_time': 1777276836.121996}
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_97ac97e4a6227672b4b4a9e7b21d988c.jpg not downloaded yet
2026-04-27 08:00:36 [auto1.es] INFO: Found listing with ID: CM66280
2026-04-27 08:00:36 [auto1.es] INFO: Scrape type for CM66280: 1
2026-04-27 08:00:36 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2023 | hits on page: 40
2026-04-27 08:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38796b1-16ab-5498-beb2-1e7196c5043f with identifier: KJ50966
2026-04-27 08:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38796b1-16ab-5498-beb2-1e7196c5043f with scrape type 1
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_d1d6eae9461f57901ed1b31f29e0b87a.jpg not downloaded yet
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_11cc8d1e2424dab1a4f38163f66eddca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_f3827911a40435d80b0bc97bca806911.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [auto1.es] INFO: Found listing with ID: ZJ02934
2026-04-27 08:00:36 [auto1.es] INFO: Scrape type for ZJ02934: 1
2026-04-27 08:00:36 [auto1.es] INFO: Found listing with ID: JT96538
2026-04-27 08:00:36 [auto1.es] INFO: Scrape type for JT96538: 1
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_15f2e538fece86bc95d0eb21cf113ecc.jpg not downloaded yet
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852eb50>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_e57ecc7b2c054dd2a06968d3bccbe954.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482379d0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_30f6bd111add072105eb2a3eb3d56224.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:36 [auto1.es] INFO: Found listing with ID: ZP51440
2026-04-27 08:00:36 [auto1.es] INFO: Scrape type for ZP51440: 2
2026-04-27 08:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440
2026-04-27 08:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with scrape type 2
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with scrape type 2
2026-04-27 08:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675, identifier: ZP51440
2026-04-27 08:00:36 [auto1.es] INFO: Found listing with ID: WJ78547
2026-04-27 08:00:36 [auto1.es] INFO: Scrape type for WJ78547: 1
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_4a046fb7c15bc23d5fecc3a7963ca69c.jpg not downloaded yet
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_2b01bb03403dbc386054d10bf8a0a26a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440
2026-04-27 08:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440
2026-04-27 08:00:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675 with identifier: ZP51440 to the API
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-04-27T15:44:15Z',
'fuel_type': 'petrol',
'id': 'cb79ba9f-7917-5cf2-a7f6-2f57c6cfe675',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP51440',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Mondeo',
'odometer': 236112,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-17',
'seller_name': None,
'title': 'Ford Mondeo 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2019}
2026-04-27 08:00:36 [auto1.es] INFO: Saving data for ZP51440: {'auction_closing_time': 1777304655.0, 'created_time': 1777021140.260237, 'has_photos': True, 'last_price_update_time': 1777276836.884995}
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048208ed0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_11cc8d1e2424dab1a4f38163f66eddca.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048382990>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_f3827911a40435d80b0bc97bca806911.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:36 [auto1.es] INFO: Found listing with ID: FF11655
2026-04-27 08:00:36 [auto1.es] INFO: Scrape type for FF11655: 2
2026-04-27 08:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d184cfb2-9ff7-554a-b74d-3103d2b09312 with identifier: FF11655
2026-04-27 08:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d184cfb2-9ff7-554a-b74d-3103d2b09312 with scrape type 2
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d184cfb2-9ff7-554a-b74d-3103d2b09312 with scrape type 2
2026-04-27 08:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d184cfb2-9ff7-554a-b74d-3103d2b09312, identifier: FF11655
2026-04-27 08:00:37 [auto1.es] INFO: Found listing with ID: CN88860
2026-04-27 08:00:37 [auto1.es] INFO: Scrape type for CN88860: 1
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_06a21b2bb387f43f40d2ed5645e6eb46.jpg not downloaded yet
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_d1d6eae9461f57901ed1b31f29e0b87a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d184cfb2-9ff7-554a-b74d-3103d2b09312 with identifier: FF11655
2026-04-27 08:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d184cfb2-9ff7-554a-b74d-3103d2b09312 with identifier: FF11655
2026-04-27 08:00:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d184cfb2-9ff7-554a-b74d-3103d2b09312 with identifier: FF11655 to the API
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:56:12Z',
'fuel_type': 'diesel',
'id': 'd184cfb2-9ff7-554a-b74d-3103d2b09312',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF11655',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 135894,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-05-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport BlueMotion Tech',
'year': 2017}
2026-04-27 08:00:37 [auto1.es] INFO: Saving data for FF11655: {'auction_closing_time': 1777305372.0, 'created_time': 1777021088.012315, 'has_photos': True, 'last_price_update_time': 1777276837.455011}
2026-04-27 08:00:37 [auto1.es] INFO: Found listing with ID: TV15408
2026-04-27 08:00:37 [auto1.es] INFO: Scrape type for TV15408: 2
2026-04-27 08:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408
2026-04-27 08:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with scrape type 2
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with scrape type 2
2026-04-27 08:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9, identifier: TV15408
2026-04-27 08:00:37 [auto1.es] INFO: Found listing with ID: JR98730
2026-04-27 08:00:37 [auto1.es] INFO: Scrape type for JR98730: 1
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_ec53a84804151664859601591b2df987.jpg not downloaded yet
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD88147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c3690>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_2b01bb03403dbc386054d10bf8a0a26a.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408
2026-04-27 08:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408
2026-04-27 08:00:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408 to the API
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:12:04Z',
'fuel_type': 'diesel',
'id': 'a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV15408',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 108419,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-10-26',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI R-Line BlueMotion Tech',
'transmission': 'automatic',
'trim': 'R-Line BlueMotion Tech',
'year': 2017}
2026-04-27 08:00:37 [auto1.es] INFO: Saving data for TV15408: {'auction_closing_time': 1777302724.0, 'created_time': 1777020808.718244, 'has_photos': True, 'last_price_update_time': 1777276837.97195}
2026-04-27 08:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_15f2e538fece86bc95d0eb21cf113ecc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [auto1.es] INFO: Found listing with ID: PB96723
2026-04-27 08:00:38 [auto1.es] INFO: Scrape type for PB96723: 1
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_20c9d8eb3cdde7175e38194aa3fe9bef.jpg not downloaded yet
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7ed0>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_d1d6eae9461f57901ed1b31f29e0b87a.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:00:38 [auto1.es] INFO: Found listing with ID: TZ18382
2026-04-27 08:00:38 [auto1.es] INFO: Scrape type for TZ18382: 1
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_06a21b2bb387f43f40d2ed5645e6eb46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [auto1.es] INFO: Found listing with ID: GA13163
2026-04-27 08:00:38 [auto1.es] INFO: Scrape type for GA13163: 1
2026-04-27 08:00:38 [auto1.es] INFO: Found listing with ID: HW33983
2026-04-27 08:00:38 [auto1.es] INFO: Scrape type for HW33983: 2
2026-04-27 08:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6807f093-3864-5f0d-86d5-3b17c5c24bc8 with identifier: HW33983
2026-04-27 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6807f093-3864-5f0d-86d5-3b17c5c24bc8 with scrape type 2
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6807f093-3864-5f0d-86d5-3b17c5c24bc8 with scrape type 2
2026-04-27 08:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6807f093-3864-5f0d-86d5-3b17c5c24bc8, identifier: HW33983
2026-04-27 08:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6807f093-3864-5f0d-86d5-3b17c5c24bc8 with identifier: HW33983
2026-04-27 08:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6807f093-3864-5f0d-86d5-3b17c5c24bc8 with identifier: HW33983
2026-04-27 08:00:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6807f093-3864-5f0d-86d5-3b17c5c24bc8 with identifier: HW33983 to the API
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 420,
'expiration_date': '2026-04-27T15:08:13Z',
'fuel_type': 'petrol',
'id': '6807f093-3864-5f0d-86d5-3b17c5c24bc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW33983',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 89175,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-09-29',
'seller_name': None,
'title': 'BMW 3er M3',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 08:00:38 [auto1.es] INFO: Saving data for HW33983: {'auction_closing_time': 1777302493.0, 'created_time': 1777018388.476797, 'has_photos': True, 'last_price_update_time': 1777276838.598862}
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841d650>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_15f2e538fece86bc95d0eb21cf113ecc.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:00:38 [auto1.es] INFO: Found listing with ID: WF92409
2026-04-27 08:00:38 [auto1.es] INFO: Scrape type for WF92409: 2
2026-04-27 08:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4181cfe5-deb3-52ce-92cc-5fb8bda2232a with identifier: WF92409
2026-04-27 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4181cfe5-deb3-52ce-92cc-5fb8bda2232a with scrape type 2
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4181cfe5-deb3-52ce-92cc-5fb8bda2232a with scrape type 2
2026-04-27 08:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4181cfe5-deb3-52ce-92cc-5fb8bda2232a, identifier: WF92409
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_ec53a84804151664859601591b2df987.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4181cfe5-deb3-52ce-92cc-5fb8bda2232a with identifier: WF92409
2026-04-27 08:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4181cfe5-deb3-52ce-92cc-5fb8bda2232a with identifier: WF92409
2026-04-27 08:00:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4181cfe5-deb3-52ce-92cc-5fb8bda2232a with identifier: WF92409 to the API
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:52:31Z',
'fuel_type': 'petrol',
'id': '4181cfe5-deb3-52ce-92cc-5fb8bda2232a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF92409',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Tarraco',
'odometer': 16845,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-11-16',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2021}
2026-04-27 08:00:39 [auto1.es] INFO: Saving data for WF92409: {'auction_closing_time': 1777305151.0, 'created_time': 1777019553.203564, 'has_photos': True, 'last_price_update_time': 1777276839.185992}
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR89235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: YD43230
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for YD43230: 1
2026-04-27 08:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM01301> (referer: https://www.auto1.com/v1/car-details-view/UM01301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04847af10>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_06a21b2bb387f43f40d2ed5645e6eb46.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: KN47559
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for KN47559: 1
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a35c10>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_ec53a84804151664859601591b2df987.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: VZ06023
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for VZ06023: 1
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: NP78962
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for NP78962: 1
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: FV18346
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for FV18346: 1
2026-04-27 08:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1cb47e0-d618-553a-94a0-b003a89ad31d with identifier: UM01301
2026-04-27 08:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1cb47e0-d618-553a-94a0-b003a89ad31d with scrape type 1
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_150f5904bf1feeed03638890580f3d37.jpg not downloaded yet
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: XK70261
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for XK70261: 1
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_869b8a365a9b4a4711bed5124a5b4db0.jpg not downloaded yet
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: DB51566
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for DB51566: 2
2026-04-27 08:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566
2026-04-27 08:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf8d8be-0161-5a79-9163-550011ebadd8 with scrape type 2
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bf8d8be-0161-5a79-9163-550011ebadd8 with scrape type 2
2026-04-27 08:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5bf8d8be-0161-5a79-9163-550011ebadd8, identifier: DB51566
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9688474407d806b803973c325c24a581.jpg not downloaded yet
2026-04-27 08:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566
2026-04-27 08:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566
2026-04-27 08:00:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566 to the API
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-04-27T15:26:54Z',
'fuel_type': 'diesel',
'id': '5bf8d8be-0161-5a79-9163-550011ebadd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB51566',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Mondeo',
'odometer': 201005,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-10-30',
'seller_name': None,
'title': 'Ford Mondeo 2.2 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2005}
2026-04-27 08:00:39 [auto1.es] INFO: Saving data for DB51566: {'auction_closing_time': 1777303614.0, 'created_time': 1772028033.959488, 'has_photos': False, 'last_price_update_time': 1777276839.947335}
2026-04-27 08:00:39 [auto1.es] INFO: Found listing with ID: YH13326
2026-04-27 08:00:39 [auto1.es] INFO: Scrape type for YH13326: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_e9cabc04a12acddc52db52dca9f3d7b2.jpg not downloaded yet
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: GW09486
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for GW09486: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9b946de3370e36583cccbc122b8e46a3.jpg not downloaded yet
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: KN83337
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for KN83337: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_4be4040ffbcdd18cad0b2d081a478e7f.jpg not downloaded yet
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: ES03046
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for ES03046: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_1d5cac7394de1d8d93bda3927381427c.jpg not downloaded yet
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: PY72211
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for PY72211: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_14141a25f7f1ac945a7de75fdf4134aa.jpg not downloaded yet
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: TC59255
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for TC59255: 2
2026-04-27 08:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1202f7-e537-5475-9f81-873871268d8d with identifier: TC59255
2026-04-27 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1202f7-e537-5475-9f81-873871268d8d with scrape type 2
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1202f7-e537-5475-9f81-873871268d8d with scrape type 2
2026-04-27 08:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a1202f7-e537-5475-9f81-873871268d8d, identifier: TC59255
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_04b2607ea1e045ed482fe698744ed030.jpg not downloaded yet
2026-04-27 08:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a1202f7-e537-5475-9f81-873871268d8d with identifier: TC59255
2026-04-27 08:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a1202f7-e537-5475-9f81-873871268d8d with identifier: TC59255
2026-04-27 08:00:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a1202f7-e537-5475-9f81-873871268d8d with identifier: TC59255 to the API
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:00:57Z',
'fuel_type': 'diesel',
'id': '5a1202f7-e537-5475-9f81-873871268d8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC59255',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 53809,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-07-23',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Contrlol M',
'transmission': 'manual',
'trim': 'Contrlol M',
'year': 2019}
2026-04-27 08:00:40 [auto1.es] INFO: Saving data for TC59255: {'auction_closing_time': 1777302057.0, 'created_time': 1777020595.079372, 'has_photos': True, 'last_price_update_time': 1777276840.601118}
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: VE34286
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for VE34286: 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_ebec90741e0dfa32af051faba8f6a611.jpg not downloaded yet
2026-04-27 08:00:40 [auto1.es] INFO: Found listing with ID: KF06384
2026-04-27 08:00:40 [auto1.es] INFO: Scrape type for KF06384: 2
2026-04-27 08:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39356074-682b-59a4-b716-17e9cd42d52a with identifier: KF06384
2026-04-27 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39356074-682b-59a4-b716-17e9cd42d52a with scrape type 2
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39356074-682b-59a4-b716-17e9cd42d52a with scrape type 2
2026-04-27 08:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39356074-682b-59a4-b716-17e9cd42d52a, identifier: KF06384
2026-04-27 08:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39356074-682b-59a4-b716-17e9cd42d52a with identifier: KF06384
2026-04-27 08:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39356074-682b-59a4-b716-17e9cd42d52a with identifier: KF06384
2026-04-27 08:00:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39356074-682b-59a4-b716-17e9cd42d52a with identifier: KF06384 to the API
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:31:04Z',
'fuel_type': 'diesel',
'id': '39356074-682b-59a4-b716-17e9cd42d52a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF06384',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C3',
'odometer': 212136,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-10-29',
'seller_name': None,
'title': 'Citroen C3 1.5 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-04-27 08:00:41 [auto1.es] INFO: Saving data for KF06384: {'auction_closing_time': 1777303864.0, 'created_time': 1777018534.818696, 'has_photos': True, 'last_price_update_time': 1777276841.165579}
2026-04-27 08:00:41 [auto1.es] INFO: Found listing with ID: DX00170
2026-04-27 08:00:41 [auto1.es] INFO: Scrape type for DX00170: 2
2026-04-27 08:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b778ffd-1d32-5237-8bb6-8570ac48ca03 with identifier: DX00170
2026-04-27 08:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b778ffd-1d32-5237-8bb6-8570ac48ca03 with scrape type 2
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b778ffd-1d32-5237-8bb6-8570ac48ca03 with scrape type 2
2026-04-27 08:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b778ffd-1d32-5237-8bb6-8570ac48ca03, identifier: DX00170
2026-04-27 08:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b778ffd-1d32-5237-8bb6-8570ac48ca03 with identifier: DX00170
2026-04-27 08:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b778ffd-1d32-5237-8bb6-8570ac48ca03 with identifier: DX00170
2026-04-27 08:00:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b778ffd-1d32-5237-8bb6-8570ac48ca03 with identifier: DX00170 to the API
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:29:26Z',
'fuel_type': 'diesel',
'id': '4b778ffd-1d32-5237-8bb6-8570ac48ca03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX00170',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 150339,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-02-03',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Life Pack M',
'transmission': 'manual',
'trim': 'Life Pack M',
'year': 2021}
2026-04-27 08:00:41 [auto1.es] INFO: Saving data for DX00170: {'auction_closing_time': 1777303766.0, 'created_time': 1777019137.109012, 'has_photos': True, 'last_price_update_time': 1777276841.59941}
2026-04-27 08:00:41 [auto1.es] INFO: Found listing with ID: TW64500
2026-04-27 08:00:41 [auto1.es] INFO: Scrape type for TW64500: 1
2026-04-27 08:00:41 [auto1.es] INFO: Found listing with ID: JE56649
2026-04-27 08:00:41 [auto1.es] INFO: Scrape type for JE56649: 2
2026-04-27 08:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb8a335-bd0b-5891-9313-54e7eee5f841 with identifier: JE56649
2026-04-27 08:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb8a335-bd0b-5891-9313-54e7eee5f841 with scrape type 2
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cb8a335-bd0b-5891-9313-54e7eee5f841 with scrape type 2
2026-04-27 08:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1cb8a335-bd0b-5891-9313-54e7eee5f841, identifier: JE56649
2026-04-27 08:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1cb8a335-bd0b-5891-9313-54e7eee5f841 with identifier: JE56649
2026-04-27 08:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1cb8a335-bd0b-5891-9313-54e7eee5f841 with identifier: JE56649
2026-04-27 08:00:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1cb8a335-bd0b-5891-9313-54e7eee5f841 with identifier: JE56649 to the API
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:54:15Z',
'fuel_type': 'diesel',
'id': '1cb8a335-bd0b-5891-9313-54e7eee5f841',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE56649',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 117963,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-11-30',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Collection',
'transmission': 'automatic',
'trim': 'Collection',
'year': 2007}
2026-04-27 08:00:42 [auto1.es] INFO: Saving data for JE56649: {'auction_closing_time': 1777305255.0, 'created_time': 1777018483.677059, 'has_photos': True, 'last_price_update_time': 1777276842.05531}
2026-04-27 08:00:42 [auto1.es] INFO: Found listing with ID: BZ89279
2026-04-27 08:00:42 [auto1.es] INFO: Scrape type for BZ89279: 1
2026-04-27 08:00:42 [auto1.es] INFO: Found listing with ID: FZ88987
2026-04-27 08:00:42 [auto1.es] INFO: Scrape type for FZ88987: 2
2026-04-27 08:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e with identifier: FZ88987
2026-04-27 08:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e with scrape type 2
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e with scrape type 2
2026-04-27 08:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e, identifier: FZ88987
2026-04-27 08:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e with identifier: FZ88987
2026-04-27 08:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e with identifier: FZ88987
2026-04-27 08:00:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1c89ef7d-d2fb-5ced-b50e-b77a82308e3e with identifier: FZ88987 to the API
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:32:29Z',
'fuel_type': 'diesel',
'id': '1c89ef7d-d2fb-5ced-b50e-b77a82308e3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ88987',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Crafter',
'odometer': 191609,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-09-27',
'seller_name': None,
'title': 'Volkswagen Crafter 2.0 TDI Kasten 30 Trendline mittellang Hochdach '
'FWD',
'transmission': 'manual',
'trim': 'Kasten 30 Trendline mittellang Hochdach FWD',
'year': 2021}
2026-04-27 08:00:42 [auto1.es] INFO: Saving data for FZ88987: {'auction_closing_time': 1777303949.0, 'created_time': 1777019692.72632, 'has_photos': True, 'last_price_update_time': 1777276842.546245}
2026-04-27 08:00:42 [auto1.es] INFO: Found listing with ID: BJ93175
2026-04-27 08:00:42 [auto1.es] INFO: Scrape type for BJ93175: 2
2026-04-27 08:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84cde54d-e813-5537-a8c8-96fa226fb4b4 with identifier: BJ93175
2026-04-27 08:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84cde54d-e813-5537-a8c8-96fa226fb4b4 with scrape type 2
2026-04-27 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84cde54d-e813-5537-a8c8-96fa226fb4b4 with scrape type 2
2026-04-27 08:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 84cde54d-e813-5537-a8c8-96fa226fb4b4, identifier: BJ93175
2026-04-27 08:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 84cde54d-e813-5537-a8c8-96fa226fb4b4 with identifier: BJ93175
2026-04-27 08:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 84cde54d-e813-5537-a8c8-96fa226fb4b4 with identifier: BJ93175
2026-04-27 08:00:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 84cde54d-e813-5537-a8c8-96fa226fb4b4 with identifier: BJ93175 to the API
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:36:12Z',
'fuel_type': 'diesel',
'id': '84cde54d-e813-5537-a8c8-96fa226fb4b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ93175',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C3',
'odometer': 162431,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-02-24',
'seller_name': None,
'title': 'Citroen C3 1.5 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2020}
2026-04-27 08:00:42 [auto1.es] INFO: Saving data for BJ93175: {'auction_closing_time': 1777304172.0, 'created_time': 1777019341.115061, 'has_photos': True, 'last_price_update_time': 1777276842.961534}
2026-04-27 08:00:42 [auto1.es] INFO: Found listing with ID: KG53468
2026-04-27 08:00:42 [auto1.es] INFO: Scrape type for KG53468: 1
2026-04-27 08:00:42 [auto1.es] INFO: Found listing with ID: LZ36819
2026-04-27 08:00:43 [auto1.es] INFO: Scrape type for LZ36819: 2
2026-04-27 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a4f7278-861d-5bd1-9f1e-3b111bb6236f with identifier: LZ36819
2026-04-27 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a4f7278-861d-5bd1-9f1e-3b111bb6236f with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a4f7278-861d-5bd1-9f1e-3b111bb6236f with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a4f7278-861d-5bd1-9f1e-3b111bb6236f, identifier: LZ36819
2026-04-27 08:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a4f7278-861d-5bd1-9f1e-3b111bb6236f with identifier: LZ36819
2026-04-27 08:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a4f7278-861d-5bd1-9f1e-3b111bb6236f with identifier: LZ36819
2026-04-27 08:00:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a4f7278-861d-5bd1-9f1e-3b111bb6236f with identifier: LZ36819 to the API
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:17:29Z',
'fuel_type': 'diesel',
'id': '8a4f7278-861d-5bd1-9f1e-3b111bb6236f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ36819',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 210693,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-02-22',
'seller_name': None,
'title': 'Citroen C4 1.5 Blue-HDi Feel Pack',
'transmission': 'automatic',
'trim': 'Feel Pack',
'year': 2022}
2026-04-27 08:00:43 [auto1.es] INFO: Saving data for LZ36819: {'auction_closing_time': 1777303049.0, 'created_time': 1777019526.489196, 'has_photos': True, 'last_price_update_time': 1777276843.409557}
2026-04-27 08:00:43 [auto1.es] INFO: Found listing with ID: VT16720
2026-04-27 08:00:43 [auto1.es] INFO: Scrape type for VT16720: 2
2026-04-27 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec286944-218f-57a9-bd57-c524a5c12b69 with identifier: VT16720
2026-04-27 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec286944-218f-57a9-bd57-c524a5c12b69 with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec286944-218f-57a9-bd57-c524a5c12b69 with scrape type 2
2026-04-27 08:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec286944-218f-57a9-bd57-c524a5c12b69, identifier: VT16720
2026-04-27 08:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec286944-218f-57a9-bd57-c524a5c12b69 with identifier: VT16720
2026-04-27 08:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec286944-218f-57a9-bd57-c524a5c12b69 with identifier: VT16720
2026-04-27 08:00:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec286944-218f-57a9-bd57-c524a5c12b69 with identifier: VT16720 to the API
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-04-27T15:10:03Z',
'fuel_type': 'hybrid',
'id': 'ec286944-218f-57a9-bd57-c524a5c12b69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT16720',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Niro',
'odometer': 116980,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-04-28',
'seller_name': None,
'title': 'Kia Niro 1.6 Hybrid Drive',
'transmission': 'automatic',
'trim': 'Drive',
'year': 2021}
2026-04-27 08:00:43 [auto1.es] INFO: Saving data for VT16720: {'auction_closing_time': 1777302603.0, 'created_time': 1777019668.821169, 'has_photos': True, 'last_price_update_time': 1777276843.859691}
2026-04-27 08:00:43 [auto1.es] INFO: Found listing with ID: UN56610
2026-04-27 08:00:43 [auto1.es] INFO: Scrape type for UN56610: 1
2026-04-27 08:00:43 [auto1.es] INFO: Found listing with ID: DE43509
2026-04-27 08:00:44 [auto1.es] INFO: Scrape type for DE43509: 2
2026-04-27 08:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ad3663-0ea1-525b-90a5-e3e55b06add1 with identifier: DE43509
2026-04-27 08:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ad3663-0ea1-525b-90a5-e3e55b06add1 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ad3663-0ea1-525b-90a5-e3e55b06add1 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7ad3663-0ea1-525b-90a5-e3e55b06add1, identifier: DE43509
2026-04-27 08:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7ad3663-0ea1-525b-90a5-e3e55b06add1 with identifier: DE43509
2026-04-27 08:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7ad3663-0ea1-525b-90a5-e3e55b06add1 with identifier: DE43509
2026-04-27 08:00:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7ad3663-0ea1-525b-90a5-e3e55b06add1 with identifier: DE43509 to the API
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:07:32Z',
'fuel_type': 'diesel',
'id': 'e7ad3663-0ea1-525b-90a5-e3e55b06add1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE43509',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 161770,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-05-30',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Life Pack M',
'transmission': 'manual',
'trim': 'Life Pack M',
'year': 2021}
2026-04-27 08:00:44 [auto1.es] INFO: Saving data for DE43509: {'auction_closing_time': 1777302452.0, 'created_time': 1777018560.526911, 'has_photos': True, 'last_price_update_time': 1777276844.394655}
2026-04-27 08:00:44 [auto1.es] INFO: Found listing with ID: VM35411
2026-04-27 08:00:44 [auto1.es] INFO: Scrape type for VM35411: 2
2026-04-27 08:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf9559de-011f-5aaf-85b0-76ed52bc6d92 with identifier: VM35411
2026-04-27 08:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf9559de-011f-5aaf-85b0-76ed52bc6d92 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf9559de-011f-5aaf-85b0-76ed52bc6d92 with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf9559de-011f-5aaf-85b0-76ed52bc6d92, identifier: VM35411
2026-04-27 08:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf9559de-011f-5aaf-85b0-76ed52bc6d92 with identifier: VM35411
2026-04-27 08:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf9559de-011f-5aaf-85b0-76ed52bc6d92 with identifier: VM35411
2026-04-27 08:00:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf9559de-011f-5aaf-85b0-76ed52bc6d92 with identifier: VM35411 to the API
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-04-27T15:48:43Z',
'fuel_type': 'diesel',
'id': 'bf9559de-011f-5aaf-85b0-76ed52bc6d92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM35411',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': "cee'd",
'odometer': 177881,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-12-20',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Tech",
'transmission': 'automatic',
'trim': 'Tech',
'year': 2020}
2026-04-27 08:00:44 [auto1.es] INFO: Saving data for VM35411: {'auction_closing_time': 1777304923.0, 'created_time': 1777019621.781353, 'has_photos': True, 'last_price_update_time': 1777276844.810028}
2026-04-27 08:00:44 [auto1.es] INFO: Found listing with ID: HG31601
2026-04-27 08:00:44 [auto1.es] INFO: Scrape type for HG31601: 2
2026-04-27 08:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb86e1f-2200-5300-8a4f-096cee31aced with identifier: HG31601
2026-04-27 08:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb86e1f-2200-5300-8a4f-096cee31aced with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb86e1f-2200-5300-8a4f-096cee31aced with scrape type 2
2026-04-27 08:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: acb86e1f-2200-5300-8a4f-096cee31aced, identifier: HG31601
2026-04-27 08:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: acb86e1f-2200-5300-8a4f-096cee31aced with identifier: HG31601
2026-04-27 08:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: acb86e1f-2200-5300-8a4f-096cee31aced with identifier: HG31601
2026-04-27 08:00:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: acb86e1f-2200-5300-8a4f-096cee31aced with identifier: HG31601 to the API
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:21:48Z',
'fuel_type': 'diesel',
'id': 'acb86e1f-2200-5300-8a4f-096cee31aced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG31601',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 196132,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-07-27',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Life Pack M',
'transmission': 'manual',
'trim': 'Life Pack M',
'year': 2021}
2026-04-27 08:00:45 [auto1.es] INFO: Saving data for HG31601: {'auction_closing_time': 1777303308.0, 'created_time': 1777019512.075159, 'has_photos': True, 'last_price_update_time': 1777276845.210177}
2026-04-27 08:00:45 [auto1.es] INFO: Found listing with ID: BR87747
2026-04-27 08:00:45 [auto1.es] INFO: Scrape type for BR87747: 2
2026-04-27 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb with identifier: BR87747
2026-04-27 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb, identifier: BR87747
2026-04-27 08:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb with identifier: BR87747
2026-04-27 08:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb with identifier: BR87747
2026-04-27 08:00:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb with identifier: BR87747 to the API
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-04-27T15:42:02Z',
'fuel_type': 'diesel',
'id': '1764b6a5-91bb-51b4-8e2b-2f34fc6df9cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR87747',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': "cee'd",
'odometer': 162042,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-02-25',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Tech",
'transmission': 'automatic',
'trim': 'Tech',
'year': 2021}
2026-04-27 08:00:45 [auto1.es] INFO: Saving data for BR87747: {'auction_closing_time': 1777304522.0, 'created_time': 1777019334.11387, 'has_photos': True, 'last_price_update_time': 1777276845.615653}
2026-04-27 08:00:45 [auto1.es] INFO: Found listing with ID: BM51968
2026-04-27 08:00:45 [auto1.es] INFO: Scrape type for BM51968: 1
2026-04-27 08:00:45 [auto1.es] INFO: Found listing with ID: VT79907
2026-04-27 08:00:45 [auto1.es] INFO: Scrape type for VT79907: 2
2026-04-27 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92655b25-edd6-57cc-98fd-1779a5a744ea with identifier: VT79907
2026-04-27 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92655b25-edd6-57cc-98fd-1779a5a744ea with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92655b25-edd6-57cc-98fd-1779a5a744ea with scrape type 2
2026-04-27 08:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92655b25-edd6-57cc-98fd-1779a5a744ea, identifier: VT79907
2026-04-27 08:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92655b25-edd6-57cc-98fd-1779a5a744ea with identifier: VT79907
2026-04-27 08:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92655b25-edd6-57cc-98fd-1779a5a744ea with identifier: VT79907
2026-04-27 08:00:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92655b25-edd6-57cc-98fd-1779a5a744ea with identifier: VT79907 to the API
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-04-27T15:24:37Z',
'fuel_type': 'diesel',
'id': '92655b25-edd6-57cc-98fd-1779a5a744ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT79907',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Iveco',
'model': 'Daily',
'odometer': 114170,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-05-09',
'seller_name': None,
'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520',
'transmission': 'manual',
'trim': 'HKa 35 S V Radstand 3520',
'year': 2022}
2026-04-27 08:00:46 [auto1.es] INFO: Saving data for VT79907: {'auction_closing_time': 1777303477.0, 'created_time': 1777019506.858989, 'has_photos': True, 'last_price_update_time': 1777276846.061458}
2026-04-27 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP31470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL57262> (referer: https://www.auto1.com/v1/car-details-view/BL57262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6306a7e-561f-5118-8faf-f6114a94b4ac with identifier: BL57262
2026-04-27 08:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6306a7e-561f-5118-8faf-f6114a94b4ac with scrape type 1
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6369765027d70e0212dcc1926f4ffd32.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7ab0072247a61b775e648e4622fb0cad.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c0f5c71d56025b5249f7c1201548bb77.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7996f86410e46f0935cc4ed5bdef4fe9.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_81ed8b7e95f0c8cd9df6c8c5d8e0827d.jpg not downloaded yet
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7a89a257d671262d6abbdb3e303fc294.jpg not downloaded yet
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c7102360faa905d418fc1a99eb236d4c.jpg not downloaded yet
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_b877647aacd04b73f9cc91379d999a9b.jpg not downloaded yet
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6ac17b07c2bece42354b98d17efc5a43.jpg not downloaded yet
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_04d6b12b9961e9cbcbff4e625d73ddfd.jpg not downloaded yet
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK37230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF41983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_04d6b12b9961e9cbcbff4e625d73ddfd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6ac17b07c2bece42354b98d17efc5a43.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822a750>
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_04d6b12b9961e9cbcbff4e625d73ddfd.jpg saved to cache
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852c710>
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6ac17b07c2bece42354b98d17efc5a43.jpg saved to cache
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN88860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS59468> (referer: https://www.auto1.com/v1/car-details-view/GS59468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_b877647aacd04b73f9cc91379d999a9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c7102360faa905d418fc1a99eb236d4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468
2026-04-27 08:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3e75947-bb9d-5242-917c-4052e957a17c with scrape type 1
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aee283a0bd14241d3778c918ff11cce8.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_f0606208f381cdfa432b33abea07a4f5.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_4f6fdcbc778e21faec13c1daa97460b7.jpg not downloaded yet
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482284d0>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_b877647aacd04b73f9cc91379d999a9b.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_31079d0006cf741b215624946dacb0fc.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_ad895467b391e5e8320868d73a79d677.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_60223e653f53aebd4e841b35790aea57.jpg not downloaded yet
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822db10>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c7102360faa905d418fc1a99eb236d4c.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aad5985737b7f81838cee9a0af7d998d.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7a89a257d671262d6abbdb3e303fc294.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_1f9b9f019fe6091838be748153a7676e.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_bf4b945fcc868a73abbc90b922411f0c.jpg not downloaded yet
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_91013a00b0396d4807a95b49845e47fd.jpg not downloaded yet
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT85498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e7810>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7a89a257d671262d6abbdb3e303fc294.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_91013a00b0396d4807a95b49845e47fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_bf4b945fcc868a73abbc90b922411f0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048864d50>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_91013a00b0396d4807a95b49845e47fd.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484fbd50>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_bf4b945fcc868a73abbc90b922411f0c.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_60223e653f53aebd4e841b35790aea57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e4350>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_60223e653f53aebd4e841b35790aea57.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA13163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_1f9b9f019fe6091838be748153a7676e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aad5985737b7f81838cee9a0af7d998d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37590>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_1f9b9f019fe6091838be748153a7676e.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff05723bd10>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aad5985737b7f81838cee9a0af7d998d.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_ad895467b391e5e8320868d73a79d677.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_31079d0006cf741b215624946dacb0fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048865e50>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_ad895467b391e5e8320868d73a79d677.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD88147> (referer: https://www.auto1.com/v1/car-details-view/RD88147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488b9f50>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_31079d0006cf741b215624946dacb0fc.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4789e702-65aa-5d6b-b96f-89f3781e6aca with identifier: RD88147
2026-04-27 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4789e702-65aa-5d6b-b96f-89f3781e6aca with scrape type 1
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_b50fddbfe78246199446293f08546d14.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bd0a1b7037c393b729b3039350b9fa32.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_c4922f28b11086a08fbefa6b26504ac6.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_cb9d517c10a400f83aac672b4301fad3.jpg not downloaded yet
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_4f6fdcbc778e21faec13c1daa97460b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_726933a37a542a7fe1c4c5f76a7397c3.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_79fda0e7fcb156e42eaa97bea5fd3073.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_90ab05023cd981757b54b779c740b5fb.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_784b68da5587668de1cce5e057010bba.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bb855f020c19fa1fd0fb0ecd0c765beb.jpg not downloaded yet
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_f0606208f381cdfa432b33abea07a4f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_1a32b5827b518d9783b048c70592deb9.jpg not downloaded yet
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_cb9d517c10a400f83aac672b4301fad3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852dad0>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_4f6fdcbc778e21faec13c1daa97460b7.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048205290>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_f0606208f381cdfa432b33abea07a4f5.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_1a32b5827b518d9783b048c70592deb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820be90>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_cb9d517c10a400f83aac672b4301fad3.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bb855f020c19fa1fd0fb0ecd0c765beb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822d750>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_1a32b5827b518d9783b048c70592deb9.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_90ab05023cd981757b54b779c740b5fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048204ad0>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bb855f020c19fa1fd0fb0ecd0c765beb.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ18382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_79fda0e7fcb156e42eaa97bea5fd3073.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_784b68da5587668de1cce5e057010bba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_726933a37a542a7fe1c4c5f76a7397c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048204950>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_90ab05023cd981757b54b779c740b5fb.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bd0a1b7037c393b729b3039350b9fa32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_c4922f28b11086a08fbefa6b26504ac6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488bb6d0>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_79fda0e7fcb156e42eaa97bea5fd3073.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_b50fddbfe78246199446293f08546d14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_81ed8b7e95f0c8cd9df6c8c5d8e0827d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aee283a0bd14241d3778c918ff11cce8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b990>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_784b68da5587668de1cce5e057010bba.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822d690>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_726933a37a542a7fe1c4c5f76a7397c3.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488edd10>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bd0a1b7037c393b729b3039350b9fa32.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663790>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_c4922f28b11086a08fbefa6b26504ac6.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7996f86410e46f0935cc4ed5bdef4fe9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824ee50>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_b50fddbfe78246199446293f08546d14.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4789e702-65aa-5d6b-b96f-89f3781e6aca
2026-04-27 08:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4789e702-65aa-5d6b-b96f-89f3781e6aca, skipping ID generation
2026-04-27 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4789e702-65aa-5d6b-b96f-89f3781e6aca with scrape type 1
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4789e702-65aa-5d6b-b96f-89f3781e6aca sending to next pipeline
2026-04-27 08:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4789e702-65aa-5d6b-b96f-89f3781e6aca, identifier: RD88147
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0496fbbd0>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_81ed8b7e95f0c8cd9df6c8c5d8e0827d.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841d790>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aee283a0bd14241d3778c918ff11cce8.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3e75947-bb9d-5242-917c-4052e957a17c
2026-04-27 08:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3e75947-bb9d-5242-917c-4052e957a17c, skipping ID generation
2026-04-27 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3e75947-bb9d-5242-917c-4052e957a17c with scrape type 1
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3e75947-bb9d-5242-917c-4052e957a17c sending to next pipeline
2026-04-27 08:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3e75947-bb9d-5242-917c-4052e957a17c, identifier: GS59468
2026-04-27 08:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4789e702-65aa-5d6b-b96f-89f3781e6aca with identifier: RD88147
2026-04-27 08:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4789e702-65aa-5d6b-b96f-89f3781e6aca with identifier: RD88147
2026-04-27 08:00:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4789e702-65aa-5d6b-b96f-89f3781e6aca with identifier: RD88147 to the API
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_b50fddbfe78246199446293f08546d14.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'city': 'Sevilla',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:02:01Z',
'fuel_type': 'diesel',
'id': '4789e702-65aa-5d6b-b96f-89f3781e6aca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD88147',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Audi',
'model': 'A4',
'odometer': 163687,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_b50fddbfe78246199446293f08546d14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bd0a1b7037c393b729b3039350b9fa32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_c4922f28b11086a08fbefa6b26504ac6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_cb9d517c10a400f83aac672b4301fad3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_726933a37a542a7fe1c4c5f76a7397c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_79fda0e7fcb156e42eaa97bea5fd3073.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_90ab05023cd981757b54b779c740b5fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_784b68da5587668de1cce5e057010bba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_bb855f020c19fa1fd0fb0ecd0c765beb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4789e702-65aa-5d6b-b96f-89f3781e6aca/4789e702-65aa-5d6b-b96f-89f3781e6aca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/39/8b39d03be92dfa2e6aa5a49867c4c06e/pa/RD88147_1a32b5827b518d9783b048c70592deb9.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 35 TDI Mild-Hybrid advanced',
'transmission': 'automatic',
'trim': 'advanced',
'year': 2019}
2026-04-27 08:00:59 [auto1.es] INFO: Saving data for RD88147: {'created_time': 1777276859.943811, 'last_price_update_time': 1777276859.943823, 'has_photos': True, 'auction_closing_time': 1777302121.0}
2026-04-27 08:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468
2026-04-27 08:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468
2026-04-27 08:01:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3e75947-bb9d-5242-917c-4052e957a17c with identifier: GS59468 to the API
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aee283a0bd14241d3778c918ff11cce8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Sevilla',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:56:08Z',
'fuel_type': 'diesel',
'id': 'e3e75947-bb9d-5242-917c-4052e957a17c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS59468',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Audi',
'model': 'Q3',
'odometer': 182955,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aee283a0bd14241d3778c918ff11cce8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_f0606208f381cdfa432b33abea07a4f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_4f6fdcbc778e21faec13c1daa97460b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_31079d0006cf741b215624946dacb0fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_ad895467b391e5e8320868d73a79d677.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_60223e653f53aebd4e841b35790aea57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_aad5985737b7f81838cee9a0af7d998d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_1f9b9f019fe6091838be748153a7676e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_bf4b945fcc868a73abbc90b922411f0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3e75947-bb9d-5242-917c-4052e957a17c/e3e75947-bb9d-5242-917c-4052e957a17c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/e2/35e206ed626d1d7db4685bd1746c47a9/pa/GS59468_91013a00b0396d4807a95b49845e47fd.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2015}
2026-04-27 08:01:00 [auto1.es] INFO: Saving data for GS59468: {'created_time': 1777276860.378186, 'last_price_update_time': 1777276860.378196, 'has_photos': True, 'auction_closing_time': 1777305368.0}
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c0f5c71d56025b5249f7c1201548bb77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW01400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM51968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7ab0072247a61b775e648e4622fb0cad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c9350>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7996f86410e46f0935cc4ed5bdef4fe9.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896bf10>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c0f5c71d56025b5249f7c1201548bb77.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6369765027d70e0212dcc1926f4ffd32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c110>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7ab0072247a61b775e648e4622fb0cad.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37890>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6369765027d70e0212dcc1926f4ffd32.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6306a7e-561f-5118-8faf-f6114a94b4ac
2026-04-27 08:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6306a7e-561f-5118-8faf-f6114a94b4ac, skipping ID generation
2026-04-27 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6306a7e-561f-5118-8faf-f6114a94b4ac with scrape type 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6306a7e-561f-5118-8faf-f6114a94b4ac sending to next pipeline
2026-04-27 08:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6306a7e-561f-5118-8faf-f6114a94b4ac, identifier: BL57262
2026-04-27 08:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6306a7e-561f-5118-8faf-f6114a94b4ac with identifier: BL57262
2026-04-27 08:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6306a7e-561f-5118-8faf-f6114a94b4ac with identifier: BL57262
2026-04-27 08:01:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6306a7e-561f-5118-8faf-f6114a94b4ac with identifier: BL57262 to the API
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6369765027d70e0212dcc1926f4ffd32.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Esquivias',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 136,
'expiration_date': '2026-04-27T15:34:42Z',
'fuel_type': 'petrol',
'id': 'd6306a7e-561f-5118-8faf-f6114a94b4ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL57262',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 117562,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6369765027d70e0212dcc1926f4ffd32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7ab0072247a61b775e648e4622fb0cad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c0f5c71d56025b5249f7c1201548bb77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7996f86410e46f0935cc4ed5bdef4fe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_81ed8b7e95f0c8cd9df6c8c5d8e0827d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_7a89a257d671262d6abbdb3e303fc294.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_c7102360faa905d418fc1a99eb236d4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_b877647aacd04b73f9cc91379d999a9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_6ac17b07c2bece42354b98d17efc5a43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6306a7e-561f-5118-8faf-f6114a94b4ac/d6306a7e-561f-5118-8faf-f6114a94b4ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f4/95f43830f6e3d6fe7c2ac4efd80145ae/pa/BL57262_04d6b12b9961e9cbcbff4e625d73ddfd.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2019-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2019}
2026-04-27 08:01:01 [auto1.es] INFO: Saving data for BL57262: {'created_time': 1777276861.396278, 'last_price_update_time': 1777276861.396288, 'has_photos': True, 'auction_closing_time': 1777304082.0}
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP31470> (referer: https://www.auto1.com/v1/car-details-view/HP31470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with scrape type 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK37230> (referer: https://www.auto1.com/v1/car-details-view/PK37230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg not downloaded yet
2026-04-27 08:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with scrape type 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6e1476bf899e86fd079e0093010585be.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_63510785a12782154572a7282b713143.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_e616634164b90f72608e2b1259fc17a9.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_a8702b96a7bbfed6b5b72052f2bebcde.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d32f010bee343ad89b26b0f7eed6ded.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_da111d582a82b09003e124d4a2685fd1.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d51e30db0c74c58a348a536e7462c8a.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_86e7eb71b3e0644904d94ba2251eb6d9.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_7c919085561d18335802fb371fffe0b9.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_99fb7c8c175f64ddae19de99059d607d.jpg not downloaded yet
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662d50>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_86e7eb71b3e0644904d94ba2251eb6d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048257090>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_86e7eb71b3e0644904d94ba2251eb6d9.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_99fb7c8c175f64ddae19de99059d607d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_7c919085561d18335802fb371fffe0b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e1690>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_99fb7c8c175f64ddae19de99059d607d.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a34550>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_7c919085561d18335802fb371fffe0b9.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d51e30db0c74c58a348a536e7462c8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_da111d582a82b09003e124d4a2685fd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD43230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484fb610>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d51e30db0c74c58a348a536e7462c8a.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d32f010bee343ad89b26b0f7eed6ded.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c8910>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_da111d582a82b09003e124d4a2685fd1.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_e616634164b90f72608e2b1259fc17a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2f90>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d32f010bee343ad89b26b0f7eed6ded.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_a8702b96a7bbfed6b5b72052f2bebcde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_63510785a12782154572a7282b713143.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487168d0>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_e616634164b90f72608e2b1259fc17a9.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6e1476bf899e86fd079e0093010585be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT85498> (referer: https://www.auto1.com/v1/car-details-view/YT85498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837e8d0>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_a8702b96a7bbfed6b5b72052f2bebcde.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486aaf50>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_63510785a12782154572a7282b713143.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049712a10>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6e1476bf899e86fd079e0093010585be.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd
2026-04-27 08:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd, skipping ID generation
2026-04-27 08:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with scrape type 1
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd sending to next pipeline
2026-04-27 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd, identifier: PK37230
2026-04-27 08:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230
2026-04-27 08:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230
2026-04-27 08:01:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230 to the API
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6e1476bf899e86fd079e0093010585be.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Granyanella',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '1.8L',
'engine_horse_power': 160,
'expiration_date': '2026-04-27T15:19:30Z',
'fuel_type': 'petrol',
'id': '950d8884-0044-54db-b4ae-b1b2aa5ef9bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK37230',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Audi',
'model': 'A4',
'odometer': 143096,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6e1476bf899e86fd079e0093010585be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_63510785a12782154572a7282b713143.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_e616634164b90f72608e2b1259fc17a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_a8702b96a7bbfed6b5b72052f2bebcde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d32f010bee343ad89b26b0f7eed6ded.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_da111d582a82b09003e124d4a2685fd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_6d51e30db0c74c58a348a536e7462c8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_86e7eb71b3e0644904d94ba2251eb6d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_7c919085561d18335802fb371fffe0b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_950d8884-0044-54db-b4ae-b1b2aa5ef9bd/950d8884-0044-54db-b4ae-b1b2aa5ef9bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/7e/0e7e2ead0d19b98f0958a0c4495f93ca/pa/PK37230_99fb7c8c175f64ddae19de99059d607d.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2009-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 1.8 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 08:01:04 [auto1.es] INFO: Saving data for PK37230: {'created_time': 1777276864.295236, 'last_price_update_time': 1777276864.295247, 'has_photos': True, 'auction_closing_time': 1777303170.0}
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF41983> (referer: https://www.auto1.com/v1/car-details-view/SF41983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498
2026-04-27 08:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with scrape type 1
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_02b8d725cfc75fbbfeba961e3b11d372.jpg not downloaded yet
2026-04-27 08:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_f0652d2cf3e0a7efa22fc3ff260aba35.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_bf5b756791ca89a1ee863f19efaf392e.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_51fef8fb40aa0766b7fbd7347ab51d28.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_b6c4be299b349ea99232a4ed72a47540.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_6d2df2432bd0135a121cbc05efdc791f.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_1b310ce1556374f95c46c5902b31a613.jpg not downloaded yet
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e0950>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_ecf06b95e3ffb280913501e9852820bc.jpg not downloaded yet
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207310>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c207ca-6f50-59ff-bebc-2c1707e51052 with identifier: SF41983
2026-04-27 08:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c207ca-6f50-59ff-bebc-2c1707e51052 with scrape type 1
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_ad4339d1a557121d459bdf9b16e810fe.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_7c19aa444b1a0355d789bbf46586dfbc.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_0f01d91bbf64364d6bb49745fa78674b.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_11684c164cf673fa19f38bdc0e9b83f0.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_11d2ad802648f7233456438ce9d0ffa0.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_1770b05c3caafd3f8d5c7c9967ad2af4.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_68471402f6cf364e68e0a02079ad64e1.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_764366d2542613b602db70881c8fceea.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_b424498eba8433960ec31fc1e7b3f44f.jpg not downloaded yet
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_07bb2fbd7296ae0597e511641d19f25e.jpg not downloaded yet
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834fc90>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048573e90>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_7c19aa444b1a0355d789bbf46586dfbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_8ce4538bd5b0bde2081061e02a1b524c.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_ad4339d1a557121d459bdf9b16e810fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f8dd0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_52e8394c149bf6e96e4f6c2a11063ec0.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_0f01d91bbf64364d6bb49745fa78674b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e8b50>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_7c19aa444b1a0355d789bbf46586dfbc.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a34c50>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_ad4339d1a557121d459bdf9b16e810fe.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_b424498eba8433960ec31fc1e7b3f44f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ65320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ea590>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_0f01d91bbf64364d6bb49745fa78674b.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_764366d2542613b602db70881c8fceea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_52e8394c149bf6e96e4f6c2a11063ec0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a36b10>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_b424498eba8433960ec31fc1e7b3f44f.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_8ce4538bd5b0bde2081061e02a1b524c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_07bb2fbd7296ae0597e511641d19f25e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837c150>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_764366d2542613b602db70881c8fceea.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_11d2ad802648f7233456438ce9d0ffa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048228bd0>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_52e8394c149bf6e96e4f6c2a11063ec0.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048582cd0>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_8ce4538bd5b0bde2081061e02a1b524c.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_1770b05c3caafd3f8d5c7c9967ad2af4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482292d0>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_07bb2fbd7296ae0597e511641d19f25e.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_68471402f6cf364e68e0a02079ad64e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048581610>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_11d2ad802648f7233456438ce9d0ffa0.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862a150>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_1770b05c3caafd3f8d5c7c9967ad2af4.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7e50>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_68471402f6cf364e68e0a02079ad64e1.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30c207ca-6f50-59ff-bebc-2c1707e51052
2026-04-27 08:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30c207ca-6f50-59ff-bebc-2c1707e51052, skipping ID generation
2026-04-27 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c207ca-6f50-59ff-bebc-2c1707e51052 with scrape type 1
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30c207ca-6f50-59ff-bebc-2c1707e51052 sending to next pipeline
2026-04-27 08:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30c207ca-6f50-59ff-bebc-2c1707e51052, identifier: SF41983
2026-04-27 08:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30c207ca-6f50-59ff-bebc-2c1707e51052 with identifier: SF41983
2026-04-27 08:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30c207ca-6f50-59ff-bebc-2c1707e51052 with identifier: SF41983
2026-04-27 08:01:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30c207ca-6f50-59ff-bebc-2c1707e51052 with identifier: SF41983 to the API
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_68471402f6cf364e68e0a02079ad64e1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'city': 'Barcelona',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 210,
'expiration_date': '2026-04-27T15:11:16Z',
'fuel_type': 'petrol',
'id': '30c207ca-6f50-59ff-bebc-2c1707e51052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF41983',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 72057,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_ad4339d1a557121d459bdf9b16e810fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_0f01d91bbf64364d6bb49745fa78674b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_11d2ad802648f7233456438ce9d0ffa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_1770b05c3caafd3f8d5c7c9967ad2af4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_68471402f6cf364e68e0a02079ad64e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_764366d2542613b602db70881c8fceea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_b424498eba8433960ec31fc1e7b3f44f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_07bb2fbd7296ae0597e511641d19f25e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_8ce4538bd5b0bde2081061e02a1b524c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30c207ca-6f50-59ff-bebc-2c1707e51052/30c207ca-6f50-59ff-bebc-2c1707e51052_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/a5/8aa5fdc84c7037d1bf7736a6274abadc/pa/SF41983_52e8394c149bf6e96e4f6c2a11063ec0.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2018-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-04-27 08:01:05 [auto1.es] INFO: Saving data for SF41983: {'created_time': 1777276865.97203, 'last_price_update_time': 1777276865.97204, 'has_photos': True, 'auction_closing_time': 1777302676.0}
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_11684c164cf673fa19f38bdc0e9b83f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_ecf06b95e3ffb280913501e9852820bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_1b310ce1556374f95c46c5902b31a613.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN56610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA13163> (referer: https://www.auto1.com/v1/car-details-view/GA13163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_51fef8fb40aa0766b7fbd7347ab51d28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_f0652d2cf3e0a7efa22fc3ff260aba35.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a374d0>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_11684c164cf673fa19f38bdc0e9b83f0.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_b6c4be299b349ea99232a4ed72a47540.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ea010>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_ecf06b95e3ffb280913501e9852820bc.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6390>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_1b310ce1556374f95c46c5902b31a613.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e3a6255-1205-5494-bdfa-29c8346a9edc with identifier: GA13163
2026-04-27 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3a6255-1205-5494-bdfa-29c8346a9edc with scrape type 1
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_39217d7255f1f69611b7fc44264c973f.jpg not downloaded yet
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_02b8d725cfc75fbbfeba961e3b11d372.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cef8b04716f9580b8bd3e07e91e3b0e9.jpg not downloaded yet
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_bf5b756791ca89a1ee863f19efaf392e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_798f286b70906f0362e5e614e80cfb13.jpg not downloaded yet
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_6d2df2432bd0135a121cbc05efdc791f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ea010>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_51fef8fb40aa0766b7fbd7347ab51d28.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057cd4c90>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_f0652d2cf3e0a7efa22fc3ff260aba35.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048649290>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_b6c4be299b349ea99232a4ed72a47540.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9154a0e9cffd482a1cbc8c6f925d8c91.jpg not downloaded yet
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_39217d7255f1f69611b7fc44264c973f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9976ded3053d94cbb82bafd422d19d76.jpg not downloaded yet
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484fbe10>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_02b8d725cfc75fbbfeba961e3b11d372.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048825d50>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_bf5b756791ca89a1ee863f19efaf392e.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a1090>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_6d2df2432bd0135a121cbc05efdc791f.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473
2026-04-27 08:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea0bdd6c-790a-57c1-9798-6fe63f8d5473, skipping ID generation
2026-04-27 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with scrape type 1
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea0bdd6c-790a-57c1-9798-6fe63f8d5473 sending to next pipeline
2026-04-27 08:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea0bdd6c-790a-57c1-9798-6fe63f8d5473, identifier: YT85498
2026-04-27 08:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498
2026-04-27 08:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498
2026-04-27 08:01:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea0bdd6c-790a-57c1-9798-6fe63f8d5473 with identifier: YT85498 to the API
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_6d2df2432bd0135a121cbc05efdc791f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:41:36Z',
'fuel_type': 'petrol',
'id': 'ea0bdd6c-790a-57c1-9798-6fe63f8d5473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT85498',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 126335,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_02b8d725cfc75fbbfeba961e3b11d372.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_f0652d2cf3e0a7efa22fc3ff260aba35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_bf5b756791ca89a1ee863f19efaf392e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_51fef8fb40aa0766b7fbd7347ab51d28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_b6c4be299b349ea99232a4ed72a47540.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_6d2df2432bd0135a121cbc05efdc791f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_1b310ce1556374f95c46c5902b31a613.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_ecf06b95e3ffb280913501e9852820bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_7c19aa444b1a0355d789bbf46586dfbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ea0bdd6c-790a-57c1-9798-6fe63f8d5473/ea0bdd6c-790a-57c1-9798-6fe63f8d5473_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/53/c8538bed13b7df9eeefda80e9134f31b/pa/YT85498_11684c164cf673fa19f38bdc0e9b83f0.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2018-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2018}
2026-04-27 08:01:07 [auto1.es] INFO: Saving data for YT85498: {'created_time': 1777276867.084708, 'last_price_update_time': 1777276867.084719, 'has_photos': True, 'auction_closing_time': 1777304496.0}
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_798f286b70906f0362e5e614e80cfb13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_3b3554f7dd1c205f630f5f451b93029c.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cef8b04716f9580b8bd3e07e91e3b0e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cbe707def80520fd2bedbde6ff9e5ef2.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG53468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ad590>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37690>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_39217d7255f1f69611b7fc44264c973f.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_f99216f7fd120fc26f04d0ab6e6308e7.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN88860> (referer: https://www.auto1.com/v1/car-details-view/CN88860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ89279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a73d0>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_798f286b70906f0362e5e614e80cfb13.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852e4d0>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488900d0>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cef8b04716f9580b8bd3e07e91e3b0e9.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_87f3731374c3ee1bbb8df576f5cf9e73.jpg not downloaded yet
2026-04-27 08:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9976ded3053d94cbb82bafd422d19d76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_3b3554f7dd1c205f630f5f451b93029c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9154a0e9cffd482a1cbc8c6f925d8c91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048890d10>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_1e1e45df338b80ad878d5ce71df103fe.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f0b722-647d-521d-972f-4ebc94018c13 with identifier: CN88860
2026-04-27 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f0b722-647d-521d-972f-4ebc94018c13 with scrape type 1
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_d6c29f3ea05fda9f82a42ab22094ca29.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_3fbbebaccf7af7b7ba7b980e2d7998b9.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_ba02b6d55f0962a494e2cd207171561a.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_f99216f7fd120fc26f04d0ab6e6308e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_88d5e8c2fcb71d7bde5d23493910cddf.jpg not downloaded yet
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a9510>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9976ded3053d94cbb82bafd422d19d76.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880d610>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_3b3554f7dd1c205f630f5f451b93029c.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048695750>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9154a0e9cffd482a1cbc8c6f925d8c91.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cbe707def80520fd2bedbde6ff9e5ef2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_87f3731374c3ee1bbb8df576f5cf9e73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_993fe228a0f7bac62a35a11623490c03.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_04b2607ea1e045ed482fe698744ed030.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_6afdcddb46a33ccb9dfb12d63c460c7e.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_ebec90741e0dfa32af051faba8f6a611.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880f190>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2
2026-04-27 08:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2, skipping ID generation
2026-04-27 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with scrape type 1
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 sending to next pipeline
2026-04-27 08:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2, identifier: HP31470
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a82090>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_f99216f7fd120fc26f04d0ab6e6308e7.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_11bbd0559f4bb01c4cebe94ef87abae1.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-04-27 08:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-04-27 08:01:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470 to the API
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:20:32Z',
'fuel_type': 'diesel',
'id': '8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP31470',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Audi',
'model': 'Q3',
'odometer': 57625,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_93c62fb9b8ded71ab3ecbdb053736206.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b49a6fed26dc086b86a5ab737e735f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_acb736228a5868f9e2a35d4767f16bba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_2b799fbb471dd1e8abf7fa6b5753a12d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_7e27a4ef92d09b565118b90a663bed31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_4d213828839ac42b246d86bb05e27d73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_f11299ab1bcd1014ccfd112a52f50fb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_5999890793ba5d3c292bf69532eb1b44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6ab4fca5680e856b76e61c7ee73463b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2/8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/db/61dbe8ae17a9925c397f1ffacfbe7398/pa/HP31470_6c4ff7f21367158f03857149d6011f48.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2023-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-04-27 08:01:08 [auto1.es] INFO: Saving data for HP31470: {'created_time': 1777276868.590565, 'last_price_update_time': 1777276868.590576, 'has_photos': True, 'auction_closing_time': 1777303232.0}
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_88d5e8c2fcb71d7bde5d23493910cddf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_ba02b6d55f0962a494e2cd207171561a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_3fbbebaccf7af7b7ba7b980e2d7998b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_32b6b1d595de5b89d3598e2c51528eb1.jpg not downloaded yet
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD43230> (referer: https://www.auto1.com/v1/car-details-view/YD43230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a2cd0>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cbe707def80520fd2bedbde6ff9e5ef2.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846fc50>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_87f3731374c3ee1bbb8df576f5cf9e73.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048874510>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_04b2607ea1e045ed482fe698744ed030.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846df90>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_ebec90741e0dfa32af051faba8f6a611.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_5ea84db86c5c479fcda4c590d66a682b.jpg not downloaded yet
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_993fe228a0f7bac62a35a11623490c03.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ18382> (referer: https://www.auto1.com/v1/car-details-view/TZ18382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048511c10>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_88d5e8c2fcb71d7bde5d23493910cddf.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3250>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_ba02b6d55f0962a494e2cd207171561a.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5d50>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_3fbbebaccf7af7b7ba7b980e2d7998b9.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2cc43c-2ec6-5899-9884-b923f758728f with identifier: YD43230
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2cc43c-2ec6-5899-9884-b923f758728f with scrape type 1
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_8a543db6fb28a500942170dfb086ff79.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_139df53ceeb0d1c29e09d65e4c11633e.jpg not downloaded yet
2026-04-27 08:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_11bbd0559f4bb01c4cebe94ef87abae1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_d6c29f3ea05fda9f82a42ab22094ca29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_6afdcddb46a33ccb9dfb12d63c460c7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_a27c447f2e6bb8ba26c1ef9c74883958.jpg not downloaded yet
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1b10>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_993fe228a0f7bac62a35a11623490c03.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 with identifier: TZ18382
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 with scrape type 1
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_3767b646cc784b93a2fbfec3e6b4f022.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9232f454ac03fd573b9c74c47c18e2a1.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_150f24187cc528475019474d6a900436.jpg not downloaded yet
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_5ea84db86c5c479fcda4c590d66a682b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_aae41336167ed01a2300f7aa70d925d4.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_0346b763ebf78cac32bc3a96de377504.jpg not downloaded yet
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481be050>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_11bbd0559f4bb01c4cebe94ef87abae1.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cb9d0>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_d6c29f3ea05fda9f82a42ab22094ca29.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ae790>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_6afdcddb46a33ccb9dfb12d63c460c7e.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_57c6848c85d1017dff48c06e1a2688a4.jpg not downloaded yet
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_8a543db6fb28a500942170dfb086ff79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_14141a25f7f1ac945a7de75fdf4134aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_32b6b1d595de5b89d3598e2c51528eb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_9eebece9b20edf91d37b81ce63cc95cb.jpg not downloaded yet
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_1e1e45df338b80ad878d5ce71df103fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_08ccf73496244876b06449c1e96b7468.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_1d7b75fce0f4937b2549beec1213848f.jpg not downloaded yet
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824f750>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_5ea84db86c5c479fcda4c590d66a682b.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_25435bf951dd2313e503f1e1c437924f.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_5742e0b2c1133d4c7239f0f55d061912.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_97c9bc9af14104c0a3b635378cbaeb27.jpg not downloaded yet
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_7f002736181ea3a7f9aadd901667b1df.jpg not downloaded yet
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9232f454ac03fd573b9c74c47c18e2a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_43c10fb11937e8ed7637a534a4a9162e.jpg not downloaded yet
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486135d0>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_8a543db6fb28a500942170dfb086ff79.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048339550>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_14141a25f7f1ac945a7de75fdf4134aa.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824fc10>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_32b6b1d595de5b89d3598e2c51528eb1.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834f350>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_1e1e45df338b80ad878d5ce71df103fe.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e3a6255-1205-5494-bdfa-29c8346a9edc
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e3a6255-1205-5494-bdfa-29c8346a9edc, skipping ID generation
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3a6255-1205-5494-bdfa-29c8346a9edc with scrape type 1
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e3a6255-1205-5494-bdfa-29c8346a9edc sending to next pipeline
2026-04-27 08:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e3a6255-1205-5494-bdfa-29c8346a9edc, identifier: GA13163
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ba9e17610e9fd56cad4ea9cc9e63a9e1.jpg not downloaded yet
2026-04-27 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e3a6255-1205-5494-bdfa-29c8346a9edc with identifier: GA13163
2026-04-27 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e3a6255-1205-5494-bdfa-29c8346a9edc with identifier: GA13163
2026-04-27 08:01:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e3a6255-1205-5494-bdfa-29c8346a9edc with identifier: GA13163 to the API
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_1e1e45df338b80ad878d5ce71df103fe.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:25:26Z',
'fuel_type': 'diesel',
'id': '6e3a6255-1205-5494-bdfa-29c8346a9edc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA13163',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X3',
'odometer': 190593,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_39217d7255f1f69611b7fc44264c973f.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cef8b04716f9580b8bd3e07e91e3b0e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_798f286b70906f0362e5e614e80cfb13.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9154a0e9cffd482a1cbc8c6f925d8c91.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_9976ded3053d94cbb82bafd422d19d76.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_3b3554f7dd1c205f630f5f451b93029c.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_cbe707def80520fd2bedbde6ff9e5ef2.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_f99216f7fd120fc26f04d0ab6e6308e7.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_87f3731374c3ee1bbb8df576f5cf9e73.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e3a6255-1205-5494-bdfa-29c8346a9edc/6e3a6255-1205-5494-bdfa-29c8346a9edc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfefc6ecd9faeb8464f5eaf0a60deb52/pa/GA13163_1e1e45df338b80ad878d5ce71df103fe.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-04-27 08:01:10 [auto1.es] INFO: Saving data for GA13163: {'created_time': 1777276870.620973, 'last_price_update_time': 1777276870.620984, 'has_photos': True, 'auction_closing_time': 1777303526.0}
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_aae41336167ed01a2300f7aa70d925d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_57c6848c85d1017dff48c06e1a2688a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9d991fbf0c0504c81c3d03e08f594c1b.jpg not downloaded yet
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_150f24187cc528475019474d6a900436.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_0346b763ebf78cac32bc3a96de377504.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_f4b381b1c43228de6b9e68f38f719b46.jpg not downloaded yet
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880c3d0>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9232f454ac03fd573b9c74c47c18e2a1.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ab4af1e1e851ebf25910c1c67f78f9c7.jpg not downloaded yet
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_97c9bc9af14104c0a3b635378cbaeb27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c42d0>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_aae41336167ed01a2300f7aa70d925d4.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3150>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_57c6848c85d1017dff48c06e1a2688a4.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_43c10fb11937e8ed7637a534a4a9162e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048429090>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_150f24187cc528475019474d6a900436.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ee050>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_0346b763ebf78cac32bc3a96de377504.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837f290>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_97c9bc9af14104c0a3b635378cbaeb27.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ba9e17610e9fd56cad4ea9cc9e63a9e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_f4b381b1c43228de6b9e68f38f719b46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048522750>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_43c10fb11937e8ed7637a534a4a9162e.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_5742e0b2c1133d4c7239f0f55d061912.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_7f002736181ea3a7f9aadd901667b1df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048742910>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ba9e17610e9fd56cad4ea9cc9e63a9e1.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486eec50>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_f4b381b1c43228de6b9e68f38f719b46.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_25435bf951dd2313e503f1e1c437924f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_08ccf73496244876b06449c1e96b7468.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048582610>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_5742e0b2c1133d4c7239f0f55d061912.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fc9d0>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_7f002736181ea3a7f9aadd901667b1df.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_1d7b75fce0f4937b2549beec1213848f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ab4af1e1e851ebf25910c1c67f78f9c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9d991fbf0c0504c81c3d03e08f594c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c6d50>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_25435bf951dd2313e503f1e1c437924f.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_9eebece9b20edf91d37b81ce63cc95cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bcf50>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_08ccf73496244876b06449c1e96b7468.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_3767b646cc784b93a2fbfec3e6b4f022.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a35890>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_1d7b75fce0f4937b2549beec1213848f.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048865590>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ab4af1e1e851ebf25910c1c67f78f9c7.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_139df53ceeb0d1c29e09d65e4c11633e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048897ad0>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9d991fbf0c0504c81c3d03e08f594c1b.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048165950>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_9eebece9b20edf91d37b81ce63cc95cb.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_a27c447f2e6bb8ba26c1ef9c74883958.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048608950>
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_3767b646cc784b93a2fbfec3e6b4f022.jpg saved to cache
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40
2026-04-27 08:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40, skipping ID generation
2026-04-27 08:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 with scrape type 1
2026-04-27 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 sending to next pipeline
2026-04-27 08:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40, identifier: TZ18382
2026-04-27 08:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 with identifier: TZ18382
2026-04-27 08:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 with identifier: TZ18382
2026-04-27 08:01:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40 with identifier: TZ18382 to the API
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_3767b646cc784b93a2fbfec3e6b4f022.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:50:12Z',
'fuel_type': 'petrol',
'id': 'f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ18382',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Arona',
'odometer': 35750,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_3767b646cc784b93a2fbfec3e6b4f022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_150f24187cc528475019474d6a900436.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_0346b763ebf78cac32bc3a96de377504.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_9eebece9b20edf91d37b81ce63cc95cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_1d7b75fce0f4937b2549beec1213848f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_5742e0b2c1133d4c7239f0f55d061912.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_7f002736181ea3a7f9aadd901667b1df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ba9e17610e9fd56cad4ea9cc9e63a9e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_f4b381b1c43228de6b9e68f38f719b46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40/f3e8d7b4-7491-5e3c-b3ba-8ca407b60f40_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/a6/bda6346975d706e01991a62e6521b262/pa/TZ18382_ab4af1e1e851ebf25910c1c67f78f9c7.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-05-08',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2022}
2026-04-27 08:01:12 [auto1.es] INFO: Saving data for TZ18382: {'created_time': 1777276872.381619, 'last_price_update_time': 1777276872.381634, 'has_photos': True, 'auction_closing_time': 1777305012.0}
2026-04-27 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_1d5cac7394de1d8d93bda3927381427c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_4be4040ffbcdd18cad0b2d081a478e7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048608390>
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_139df53ceeb0d1c29e09d65e4c11633e.jpg saved to cache
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30f0b722-647d-521d-972f-4ebc94018c13
2026-04-27 08:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f0b722-647d-521d-972f-4ebc94018c13, skipping ID generation
2026-04-27 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f0b722-647d-521d-972f-4ebc94018c13 with scrape type 1
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f0b722-647d-521d-972f-4ebc94018c13 sending to next pipeline
2026-04-27 08:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30f0b722-647d-521d-972f-4ebc94018c13, identifier: CN88860
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a32d0>
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_a27c447f2e6bb8ba26c1ef9c74883958.jpg saved to cache
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da2cc43c-2ec6-5899-9884-b923f758728f
2026-04-27 08:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da2cc43c-2ec6-5899-9884-b923f758728f, skipping ID generation
2026-04-27 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2cc43c-2ec6-5899-9884-b923f758728f with scrape type 1
2026-04-27 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da2cc43c-2ec6-5899-9884-b923f758728f sending to next pipeline
2026-04-27 08:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da2cc43c-2ec6-5899-9884-b923f758728f, identifier: YD43230
2026-04-27 08:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30f0b722-647d-521d-972f-4ebc94018c13 with identifier: CN88860
2026-04-27 08:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30f0b722-647d-521d-972f-4ebc94018c13 with identifier: CN88860
2026-04-27 08:01:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30f0b722-647d-521d-972f-4ebc94018c13 with identifier: CN88860 to the API
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_139df53ceeb0d1c29e09d65e4c11633e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:30:40Z',
'fuel_type': 'diesel',
'id': '30f0b722-647d-521d-972f-4ebc94018c13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN88860',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '5er',
'odometer': 279472,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_d6c29f3ea05fda9f82a42ab22094ca29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_3fbbebaccf7af7b7ba7b980e2d7998b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_ba02b6d55f0962a494e2cd207171561a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_88d5e8c2fcb71d7bde5d23493910cddf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_993fe228a0f7bac62a35a11623490c03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_6afdcddb46a33ccb9dfb12d63c460c7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_11bbd0559f4bb01c4cebe94ef87abae1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_32b6b1d595de5b89d3598e2c51528eb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_5ea84db86c5c479fcda4c590d66a682b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30f0b722-647d-521d-972f-4ebc94018c13/30f0b722-647d-521d-972f-4ebc94018c13_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/84/ed84d377d35b11e69258f4536fce3dd1/pa/CN88860_139df53ceeb0d1c29e09d65e4c11633e.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-04-27 08:01:13 [auto1.es] INFO: Saving data for CN88860: {'created_time': 1777276873.047302, 'last_price_update_time': 1777276873.047312, 'has_photos': True, 'auction_closing_time': 1777303840.0}
2026-04-27 08:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da2cc43c-2ec6-5899-9884-b923f758728f with identifier: YD43230
2026-04-27 08:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da2cc43c-2ec6-5899-9884-b923f758728f with identifier: YD43230
2026-04-27 08:01:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da2cc43c-2ec6-5899-9884-b923f758728f with identifier: YD43230 to the API
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_a27c447f2e6bb8ba26c1ef9c74883958.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-04-27T15:43:02Z',
'fuel_type': 'petrol',
'id': 'da2cc43c-2ec6-5899-9884-b923f758728f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD43230',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 101378,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_8a543db6fb28a500942170dfb086ff79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_a27c447f2e6bb8ba26c1ef9c74883958.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9232f454ac03fd573b9c74c47c18e2a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_aae41336167ed01a2300f7aa70d925d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_57c6848c85d1017dff48c06e1a2688a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_08ccf73496244876b06449c1e96b7468.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_25435bf951dd2313e503f1e1c437924f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_97c9bc9af14104c0a3b635378cbaeb27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_43c10fb11937e8ed7637a534a4a9162e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da2cc43c-2ec6-5899-9884-b923f758728f/da2cc43c-2ec6-5899-9884-b923f758728f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/96/6f96b746a7abc45df1ed1575156bb062/pa/YD43230_9d991fbf0c0504c81c3d03e08f594c1b.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2009-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2009}
2026-04-27 08:01:13 [auto1.es] INFO: Saving data for YD43230: {'created_time': 1777276873.438498, 'last_price_update_time': 1777276873.438509, 'has_photos': True, 'auction_closing_time': 1777304582.0}
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048697450>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_1d5cac7394de1d8d93bda3927381427c.jpg saved to cache
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048867850>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_4be4040ffbcdd18cad0b2d081a478e7f.jpg saved to cache
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9b946de3370e36583cccbc122b8e46a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c9c50>
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9b946de3370e36583cccbc122b8e46a3.jpg saved to cache
2026-04-27 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_e9cabc04a12acddc52db52dca9f3d7b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f5590>
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_e9cabc04a12acddc52db52dca9f3d7b2.jpg saved to cache
2026-04-27 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE32180> (referer: https://www.auto1.com/v1/car-details-view/NE32180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39b9ab5c-1642-588e-81cc-22528bb096d6 with identifier: NE32180
2026-04-27 08:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b9ab5c-1642-588e-81cc-22528bb096d6 with scrape type 1
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_c989672cbbd0911f3de2a1d48deeb73c.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_cff1d2bad32b44ed35580f3a3d49a957.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6c704abf1dc8bab281eec85a1f479f26.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_9f42dd507ed037920e2bc63dd8c74a61.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e7b8a27b4cbac61a9c002e827ccc81eb.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_fbaa451b9bc6056503eccafa47feb271.jpg not downloaded yet
2026-04-27 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9688474407d806b803973c325c24a581.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_8beed9cb951e43ca2277ff385e397120.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_3370e6603064bfd938cd197af2a6d4e9.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6cc20cb794e8b98fd39b29bf5dae1401.jpg not downloaded yet
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e9b0231fe776e3ff8a4027598ad51980.jpg not downloaded yet
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048698d50>
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9688474407d806b803973c325c24a581.jpg saved to cache
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_fbaa451b9bc6056503eccafa47feb271.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e9b0231fe776e3ff8a4027598ad51980.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c4590>
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_fbaa451b9bc6056503eccafa47feb271.jpg saved to cache
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896a810>
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e9b0231fe776e3ff8a4027598ad51980.jpg saved to cache
2026-04-27 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6cc20cb794e8b98fd39b29bf5dae1401.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885ed10>
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6cc20cb794e8b98fd39b29bf5dae1401.jpg saved to cache
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_3370e6603064bfd938cd197af2a6d4e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842b590>
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_3370e6603064bfd938cd197af2a6d4e9.jpg saved to cache
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_8beed9cb951e43ca2277ff385e397120.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869bd10>
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_8beed9cb951e43ca2277ff385e397120.jpg saved to cache
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e7b8a27b4cbac61a9c002e827ccc81eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ca890>
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e7b8a27b4cbac61a9c002e827ccc81eb.jpg saved to cache
2026-04-27 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_9f42dd507ed037920e2bc63dd8c74a61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a41810>
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_9f42dd507ed037920e2bc63dd8c74a61.jpg saved to cache
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6c704abf1dc8bab281eec85a1f479f26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663bd0>
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6c704abf1dc8bab281eec85a1f479f26.jpg saved to cache
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_cff1d2bad32b44ed35580f3a3d49a957.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_c989672cbbd0911f3de2a1d48deeb73c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ee250>
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_cff1d2bad32b44ed35580f3a3d49a957.jpg saved to cache
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c9510>
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_c989672cbbd0911f3de2a1d48deeb73c.jpg saved to cache
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39b9ab5c-1642-588e-81cc-22528bb096d6
2026-04-27 08:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39b9ab5c-1642-588e-81cc-22528bb096d6, skipping ID generation
2026-04-27 08:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b9ab5c-1642-588e-81cc-22528bb096d6 with scrape type 1
2026-04-27 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39b9ab5c-1642-588e-81cc-22528bb096d6 sending to next pipeline
2026-04-27 08:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39b9ab5c-1642-588e-81cc-22528bb096d6, identifier: NE32180
2026-04-27 08:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39b9ab5c-1642-588e-81cc-22528bb096d6 with identifier: NE32180
2026-04-27 08:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39b9ab5c-1642-588e-81cc-22528bb096d6 with identifier: NE32180
2026-04-27 08:01:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39b9ab5c-1642-588e-81cc-22528bb096d6 with identifier: NE32180 to the API
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_c989672cbbd0911f3de2a1d48deeb73c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'city': 'Madrid',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:09:49Z',
'fuel_type': 'diesel',
'id': '39b9ab5c-1642-588e-81cc-22528bb096d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE32180',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Audi',
'model': 'Q3',
'odometer': 53168,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_c989672cbbd0911f3de2a1d48deeb73c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_cff1d2bad32b44ed35580f3a3d49a957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6c704abf1dc8bab281eec85a1f479f26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_9f42dd507ed037920e2bc63dd8c74a61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e7b8a27b4cbac61a9c002e827ccc81eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_fbaa451b9bc6056503eccafa47feb271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_8beed9cb951e43ca2277ff385e397120.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_3370e6603064bfd938cd197af2a6d4e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_6cc20cb794e8b98fd39b29bf5dae1401.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39b9ab5c-1642-588e-81cc-22528bb096d6/39b9ab5c-1642-588e-81cc-22528bb096d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/6c/6a6c708aedfac9ad036e01c05fed1324/pa/NE32180_e9b0231fe776e3ff8a4027598ad51980.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2023-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-04-27 08:01:19 [auto1.es] INFO: Saving data for NE32180: {'created_time': 1777276879.265919, 'last_price_update_time': 1777276879.265929, 'has_photos': True, 'auction_closing_time': 1777302589.0}
2026-04-27 08:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_869b8a365a9b4a4711bed5124a5b4db0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896af50>
2026-04-27 08:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_869b8a365a9b4a4711bed5124a5b4db0.jpg saved to cache
2026-04-27 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN56610> (referer: https://www.auto1.com/v1/car-details-view/UN56610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_150f5904bf1feeed03638890580f3d37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW01400> (referer: https://www.auto1.com/v1/car-details-view/TW01400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be0db9c-abbc-5120-ab96-bd35283836ce with identifier: UN56610
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be0db9c-abbc-5120-ab96-bd35283836ce with scrape type 1
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_3a34516bd454e6b4ff7e6ac5e219d1dc.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_9e292ca118043d9b793f8094170d094e.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_0f57af8ff3dbe1b7095064312e01ccf8.jpg not downloaded yet
2026-04-27 08:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c4790>
2026-04-27 08:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_150f5904bf1feeed03638890580f3d37.jpg saved to cache
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1cb47e0-d618-553a-94a0-b003a89ad31d
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1cb47e0-d618-553a-94a0-b003a89ad31d, skipping ID generation
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1cb47e0-d618-553a-94a0-b003a89ad31d with scrape type 1
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1cb47e0-d618-553a-94a0-b003a89ad31d sending to next pipeline
2026-04-27 08:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1cb47e0-d618-553a-94a0-b003a89ad31d, identifier: UM01301
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 815d80dc-1d15-5737-a009-2a4f0f81c425 with identifier: TW01400
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 815d80dc-1d15-5737-a009-2a4f0f81c425 with scrape type 1
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_09648ff0a610007dfee19da268a7d4d7.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_bcd2dce86e7c40168e1db74fc6601c75.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1cb47e0-d618-553a-94a0-b003a89ad31d with identifier: UM01301
2026-04-27 08:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1cb47e0-d618-553a-94a0-b003a89ad31d with identifier: UM01301
2026-04-27 08:01:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1cb47e0-d618-553a-94a0-b003a89ad31d with identifier: UM01301 to the API
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_150f5904bf1feeed03638890580f3d37.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Aldaya',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:34:07Z',
'fuel_type': 'diesel',
'id': 'c1cb47e0-d618-553a-94a0-b003a89ad31d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM01301',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 105362,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_150f5904bf1feeed03638890580f3d37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_869b8a365a9b4a4711bed5124a5b4db0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9688474407d806b803973c325c24a581.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_e9cabc04a12acddc52db52dca9f3d7b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_9b946de3370e36583cccbc122b8e46a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_4be4040ffbcdd18cad0b2d081a478e7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_1d5cac7394de1d8d93bda3927381427c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_14141a25f7f1ac945a7de75fdf4134aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_04b2607ea1e045ed482fe698744ed030.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1cb47e0-d618-553a-94a0-b003a89ad31d/c1cb47e0-d618-553a-94a0-b003a89ad31d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/b8/8cb886444bbe51a6be71e2c87033771c/pa/UM01301_ebec90741e0dfa32af051faba8f6a611.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-07-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI T1 BlueMotion Tech',
'transmission': 'manual',
'trim': 'T1 BlueMotion Tech',
'year': 2012}
2026-04-27 08:01:22 [auto1.es] INFO: Saving data for UM01301: {'created_time': 1777276882.246356, 'last_price_update_time': 1777276882.246365, 'has_photos': True, 'auction_closing_time': 1777304047.0}
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_30bc6499343af5558f0fb90f807bb288.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_a446913d76268a68546ceecb6585bb37.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_9a176e535403837d8a47deb7b4254200.jpg not downloaded yet
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE34286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_48cf6515480e3cff7602d2ca2656cf31.jpg not downloaded yet
2026-04-27 08:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_467c03239811db78bb12ecd29b5b353b.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_20696284ed55eedb76df95758ef01eb2.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_4268078fc80b392a9091c7ab17148a0e.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_33e8b6b7d6fb0e71562ed82cf7670662.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_5825c35f28f7b6c1a396655a5a53e16a.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_aefc754ed556bf6e3454af7b5ebbea33.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_f960bffb0d9d796dbb02e70464b514bc.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_8ca2fdbb32b39717b847c532a0b7402f.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_8c2f4cf7ef3ee968b5ec35ec0d23a272.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_100a100c1c0dc8b1bc57f57e5331ae18.jpg not downloaded yet
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_e25e8e8bca4abe11d048a37dc702f3ea.jpg not downloaded yet
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_a446913d76268a68546ceecb6585bb37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3510>
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_a446913d76268a68546ceecb6585bb37.jpg saved to cache
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_e25e8e8bca4abe11d048a37dc702f3ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a820d0>
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_e25e8e8bca4abe11d048a37dc702f3ea.jpg saved to cache
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_100a100c1c0dc8b1bc57f57e5331ae18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e0910>
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_100a100c1c0dc8b1bc57f57e5331ae18.jpg saved to cache
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ89279> (referer: https://www.auto1.com/v1/car-details-view/BZ89279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53366b33-b68e-5daf-a919-8e56f243f0dc with identifier: BZ89279
2026-04-27 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53366b33-b68e-5daf-a919-8e56f243f0dc with scrape type 1
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_6dc26e44e376ab8939d9563cb6c326f5.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_b1eb163dd435190c6fddb0d56ca5a1f8.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ae47fb564c741160d0a114adaf123184.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_cd54ec32991c72d987fb157516c1df1f.jpg not downloaded yet
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY72211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ca366fa0dcb232939e91308963ec4f71.jpg not downloaded yet
2026-04-27 08:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_05be5204be1792cee278eca11f0d0829.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_94b54e2430b713607829ebffb7b03e69.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_100cacaacb880b626bcad518f7414129.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_36688fcec8c445c4833bfd5e435040cf.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_a5b32dff6caf2edcedaeededb6f140fb.jpg not downloaded yet
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_8c2f4cf7ef3ee968b5ec35ec0d23a272.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_cd54ec32991c72d987fb157516c1df1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_a5b32dff6caf2edcedaeededb6f140fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG53468> (referer: https://www.auto1.com/v1/car-details-view/KG53468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a1490>
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_8c2f4cf7ef3ee968b5ec35ec0d23a272.jpg saved to cache
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486559d0>
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_cd54ec32991c72d987fb157516c1df1f.jpg saved to cache
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048742710>
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_a5b32dff6caf2edcedaeededb6f140fb.jpg saved to cache
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56019cbf-c244-5214-b5b0-fd505f61752d with identifier: KG53468
2026-04-27 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56019cbf-c244-5214-b5b0-fd505f61752d with scrape type 1
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_a4487b0a30c10b9508f2d1aad66244ae.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_3f1789b292389fd017f999090f1dc4cd.jpg not downloaded yet
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_36688fcec8c445c4833bfd5e435040cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_078f94dda1464b913908098fc2eec62d.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_adf6f7d9bff8a90fc923d0eb71e272c2.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_b8acec6f4a2509a002c217f840591ce1.jpg not downloaded yet
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_100cacaacb880b626bcad518f7414129.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_4ef0bce0da2faa1672e137fd902af840.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0c96ce4b67a0ad61227f49dc31b8b61b.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_7d5d5a53bcb982b6d02e39dad318ce10.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_c7808f6b792dbfa5ae95a16398a2018a.jpg not downloaded yet
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0f91cc6d85cdc95d0d26e2dada1a9320.jpg not downloaded yet
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520690>
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_36688fcec8c445c4833bfd5e435040cf.jpg saved to cache
2026-04-27 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_b8acec6f4a2509a002c217f840591ce1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488bb890>
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_100cacaacb880b626bcad518f7414129.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_3f1789b292389fd017f999090f1dc4cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0f91cc6d85cdc95d0d26e2dada1a9320.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869a390>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_b8acec6f4a2509a002c217f840591ce1.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_c7808f6b792dbfa5ae95a16398a2018a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485137d0>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_3f1789b292389fd017f999090f1dc4cd.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485116d0>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0f91cc6d85cdc95d0d26e2dada1a9320.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0c96ce4b67a0ad61227f49dc31b8b61b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c8f50>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_c7808f6b792dbfa5ae95a16398a2018a.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_7d5d5a53bcb982b6d02e39dad318ce10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_4ef0bce0da2faa1672e137fd902af840.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04860ac90>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0c96ce4b67a0ad61227f49dc31b8b61b.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_078f94dda1464b913908098fc2eec62d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eea10>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_7d5d5a53bcb982b6d02e39dad318ce10.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880dc10>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_4ef0bce0da2faa1672e137fd902af840.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_a4487b0a30c10b9508f2d1aad66244ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048521c10>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_078f94dda1464b913908098fc2eec62d.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_adf6f7d9bff8a90fc923d0eb71e272c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_94b54e2430b713607829ebffb7b03e69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048609550>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_a4487b0a30c10b9508f2d1aad66244ae.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_05be5204be1792cee278eca11f0d0829.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ca366fa0dcb232939e91308963ec4f71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048698bd0>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_adf6f7d9bff8a90fc923d0eb71e272c2.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56019cbf-c244-5214-b5b0-fd505f61752d
2026-04-27 08:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56019cbf-c244-5214-b5b0-fd505f61752d, skipping ID generation
2026-04-27 08:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56019cbf-c244-5214-b5b0-fd505f61752d with scrape type 1
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56019cbf-c244-5214-b5b0-fd505f61752d sending to next pipeline
2026-04-27 08:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 56019cbf-c244-5214-b5b0-fd505f61752d, identifier: KG53468
2026-04-27 08:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 56019cbf-c244-5214-b5b0-fd505f61752d with identifier: KG53468
2026-04-27 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 56019cbf-c244-5214-b5b0-fd505f61752d with identifier: KG53468
2026-04-27 08:01:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 56019cbf-c244-5214-b5b0-fd505f61752d with identifier: KG53468 to the API
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_adf6f7d9bff8a90fc923d0eb71e272c2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:02:32Z',
'fuel_type': 'diesel',
'id': '56019cbf-c244-5214-b5b0-fd505f61752d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG53468',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 289307,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_a4487b0a30c10b9508f2d1aad66244ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_3f1789b292389fd017f999090f1dc4cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_078f94dda1464b913908098fc2eec62d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_adf6f7d9bff8a90fc923d0eb71e272c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_b8acec6f4a2509a002c217f840591ce1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_4ef0bce0da2faa1672e137fd902af840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0c96ce4b67a0ad61227f49dc31b8b61b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_7d5d5a53bcb982b6d02e39dad318ce10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_c7808f6b792dbfa5ae95a16398a2018a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56019cbf-c244-5214-b5b0-fd505f61752d/56019cbf-c244-5214-b5b0-fd505f61752d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/fd/a3fd08a5f081f0d06d2016f3b9cae2be/pa/KG53468_0f91cc6d85cdc95d0d26e2dada1a9320.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2026-04-27 08:01:25 [auto1.es] INFO: Saving data for KG53468: {'created_time': 1777276885.28373, 'last_price_update_time': 1777276885.283738, 'has_photos': True, 'auction_closing_time': 1777302152.0}
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ae47fb564c741160d0a114adaf123184.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_b1eb163dd435190c6fddb0d56ca5a1f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW09486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN83337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a81690>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_94b54e2430b713607829ebffb7b03e69.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520f90>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_05be5204be1792cee278eca11f0d0829.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048890a10>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ca366fa0dcb232939e91308963ec4f71.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483eac50>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ae47fb564c741160d0a114adaf123184.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880e690>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_b1eb163dd435190c6fddb0d56ca5a1f8.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_8ca2fdbb32b39717b847c532a0b7402f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_6dc26e44e376ab8939d9563cb6c326f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_f960bffb0d9d796dbb02e70464b514bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048613010>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_8ca2fdbb32b39717b847c532a0b7402f.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7f10>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_6dc26e44e376ab8939d9563cb6c326f5.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53366b33-b68e-5daf-a919-8e56f243f0dc
2026-04-27 08:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53366b33-b68e-5daf-a919-8e56f243f0dc, skipping ID generation
2026-04-27 08:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53366b33-b68e-5daf-a919-8e56f243f0dc with scrape type 1
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53366b33-b68e-5daf-a919-8e56f243f0dc sending to next pipeline
2026-04-27 08:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53366b33-b68e-5daf-a919-8e56f243f0dc, identifier: BZ89279
2026-04-27 08:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53366b33-b68e-5daf-a919-8e56f243f0dc with identifier: BZ89279
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-04-27 08:01:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53366b33-b68e-5daf-a919-8e56f243f0dc with identifier: BZ89279
2026-04-27 08:01:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53366b33-b68e-5daf-a919-8e56f243f0dc with identifier: BZ89279 to the API
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_6dc26e44e376ab8939d9563cb6c326f5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'city': 'Campo Real',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:44:35Z',
'fuel_type': 'diesel',
'id': '53366b33-b68e-5daf-a919-8e56f243f0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ89279',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 154811,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_6dc26e44e376ab8939d9563cb6c326f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_b1eb163dd435190c6fddb0d56ca5a1f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ae47fb564c741160d0a114adaf123184.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_cd54ec32991c72d987fb157516c1df1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_ca366fa0dcb232939e91308963ec4f71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_05be5204be1792cee278eca11f0d0829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_94b54e2430b713607829ebffb7b03e69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_100cacaacb880b626bcad518f7414129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_36688fcec8c445c4833bfd5e435040cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_53366b33-b68e-5daf-a919-8e56f243f0dc/53366b33-b68e-5daf-a919-8e56f243f0dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d2/d9d243047f035be1db7cbb6a7004f633/pa/BZ89279_a5b32dff6caf2edcedaeededb6f140fb.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2018-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2018}
2026-04-27 08:01:26 [auto1.es] INFO: Saving data for BZ89279: {'created_time': 1777276886.32596, 'last_price_update_time': 1777276886.325969, 'has_photos': True, 'auction_closing_time': 1777304675.0}
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_aefc754ed556bf6e3454af7b5ebbea33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_5825c35f28f7b6c1a396655a5a53e16a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048210350>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_f960bffb0d9d796dbb02e70464b514bc.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a38d0>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_aefc754ed556bf6e3454af7b5ebbea33.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048610510>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_5825c35f28f7b6c1a396655a5a53e16a.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_33e8b6b7d6fb0e71562ed82cf7670662.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ee5d0>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_33e8b6b7d6fb0e71562ed82cf7670662.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_4268078fc80b392a9091c7ab17148a0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_20696284ed55eedb76df95758ef01eb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048932b50>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_4268078fc80b392a9091c7ab17148a0e.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4190>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_20696284ed55eedb76df95758ef01eb2.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_467c03239811db78bb12ecd29b5b353b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852d110>
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_467c03239811db78bb12ecd29b5b353b.jpg saved to cache
2026-04-27 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_48cf6515480e3cff7602d2ca2656cf31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_9a176e535403837d8a47deb7b4254200.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ef190>
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_48cf6515480e3cff7602d2ca2656cf31.jpg saved to cache
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484eeb90>
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_9a176e535403837d8a47deb7b4254200.jpg saved to cache
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_30bc6499343af5558f0fb90f807bb288.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_bcd2dce86e7c40168e1db74fc6601c75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_09648ff0a610007dfee19da268a7d4d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931750>
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_30bc6499343af5558f0fb90f807bb288.jpg saved to cache
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048613510>
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_bcd2dce86e7c40168e1db74fc6601c75.jpg saved to cache
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048643090>
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_09648ff0a610007dfee19da268a7d4d7.jpg saved to cache
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 815d80dc-1d15-5737-a009-2a4f0f81c425
2026-04-27 08:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 815d80dc-1d15-5737-a009-2a4f0f81c425, skipping ID generation
2026-04-27 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 815d80dc-1d15-5737-a009-2a4f0f81c425 with scrape type 1
2026-04-27 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 815d80dc-1d15-5737-a009-2a4f0f81c425 sending to next pipeline
2026-04-27 08:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 815d80dc-1d15-5737-a009-2a4f0f81c425, identifier: TW01400
2026-04-27 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 815d80dc-1d15-5737-a009-2a4f0f81c425 with identifier: TW01400
2026-04-27 08:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 815d80dc-1d15-5737-a009-2a4f0f81c425 with identifier: TW01400
2026-04-27 08:01:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 815d80dc-1d15-5737-a009-2a4f0f81c425 with identifier: TW01400 to the API
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_09648ff0a610007dfee19da268a7d4d7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': 'Rental',
'city': 'Sevilla',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:36:12Z',
'fuel_type': 'petrol',
'id': '815d80dc-1d15-5737-a009-2a4f0f81c425',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW01400',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Peugeot',
'model': '2008',
'odometer': 30291,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_09648ff0a610007dfee19da268a7d4d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_30bc6499343af5558f0fb90f807bb288.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_9a176e535403837d8a47deb7b4254200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_467c03239811db78bb12ecd29b5b353b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_4268078fc80b392a9091c7ab17148a0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_5825c35f28f7b6c1a396655a5a53e16a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_f960bffb0d9d796dbb02e70464b514bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_8c2f4cf7ef3ee968b5ec35ec0d23a272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_100a100c1c0dc8b1bc57f57e5331ae18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_815d80dc-1d15-5737-a009-2a4f0f81c425/815d80dc-1d15-5737-a009-2a4f0f81c425_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/3d/fb3df8ec6daccc9fbc95ad7efe4aa800/pa/TW01400_e25e8e8bca4abe11d048a37dc702f3ea.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2023-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2023}
2026-04-27 08:01:28 [auto1.es] INFO: Saving data for TW01400: {'created_time': 1777276888.022786, 'last_price_update_time': 1777276888.022795, 'has_photos': True, 'auction_closing_time': 1777304172.0}
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_0f57af8ff3dbe1b7095064312e01ccf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_9e292ca118043d9b793f8094170d094e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_3a34516bd454e6b4ff7e6ac5e219d1dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ad490>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_0f57af8ff3dbe1b7095064312e01ccf8.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048640a50>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_9e292ca118043d9b793f8094170d094e.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484194d0>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_3a34516bd454e6b4ff7e6ac5e219d1dc.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9be0db9c-abbc-5120-ab96-bd35283836ce
2026-04-27 08:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9be0db9c-abbc-5120-ab96-bd35283836ce, skipping ID generation
2026-04-27 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be0db9c-abbc-5120-ab96-bd35283836ce with scrape type 1
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9be0db9c-abbc-5120-ab96-bd35283836ce sending to next pipeline
2026-04-27 08:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9be0db9c-abbc-5120-ab96-bd35283836ce, identifier: UN56610
2026-04-27 08:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9be0db9c-abbc-5120-ab96-bd35283836ce with identifier: UN56610
2026-04-27 08:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9be0db9c-abbc-5120-ab96-bd35283836ce with identifier: UN56610
2026-04-27 08:01:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9be0db9c-abbc-5120-ab96-bd35283836ce with identifier: UN56610 to the API
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_3a34516bd454e6b4ff7e6ac5e219d1dc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:43:08Z',
'fuel_type': 'diesel',
'id': '9be0db9c-abbc-5120-ab96-bd35283836ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN56610',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 158399,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_3a34516bd454e6b4ff7e6ac5e219d1dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_9e292ca118043d9b793f8094170d094e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_0f57af8ff3dbe1b7095064312e01ccf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_bcd2dce86e7c40168e1db74fc6601c75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_a446913d76268a68546ceecb6585bb37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_48cf6515480e3cff7602d2ca2656cf31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_20696284ed55eedb76df95758ef01eb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_33e8b6b7d6fb0e71562ed82cf7670662.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_aefc754ed556bf6e3454af7b5ebbea33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9be0db9c-abbc-5120-ab96-bd35283836ce/9be0db9c-abbc-5120-ab96-bd35283836ce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/92/909223dc209f222996e523758b78afd9/pa/UN56610_8ca2fdbb32b39717b847c532a0b7402f.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-07-23',
'seats_number': 2,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Contrlol M',
'transmission': 'manual',
'trim': 'Contrlol M',
'year': 2019}
2026-04-27 08:01:28 [auto1.es] INFO: Saving data for UN56610: {'created_time': 1777276888.977197, 'last_price_update_time': 1777276888.977208, 'has_photos': True, 'auction_closing_time': 1777304588.0}
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES03046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:33 [scrapy.extensions.logstats] INFO: Crawled 360 pages (at 37 pages/min), scraped 450 items (at 40 items/min)
2026-04-27 08:01:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK70261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV18346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE34286> (referer: https://www.auto1.com/v1/car-details-view/VE34286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4853ccb-ddbc-5572-a09b-368a170b70d7 with identifier: VE34286
2026-04-27 08:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4853ccb-ddbc-5572-a09b-368a170b70d7 with scrape type 1
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_e4748ffa3821f965f9bd7537276336b3.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_4baaa4830c073cfabef9bcc02dc38e4e.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5074c17e383697582e67213e7e44e7cb.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5137dedadf514354c4631d3323f0eff0.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_6d79d4d3ae6059d874bf2b74bd4acbdf.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_89e1a440a61f8abfa3c333f2d9feae46.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_167143eb82f50eac508d92bdb0647f1f.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_b4f8a7eb6a39e3d0de5babe86fbae0eb.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_dd06abfe13ae543929ea7134bd897f0e.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_04562354002e5e463fd4bbe648bdbb21.jpg not downloaded yet
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY72211> (referer: https://www.auto1.com/v1/car-details-view/PY72211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c8a73a-0d87-56bc-bd2a-a3d5889d172b with identifier: PY72211
2026-04-27 08:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b with scrape type 1
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_84f18a7b5087a4a9ae02e37bf784d53e.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_f38bf5944bdaabae5f37432222e1f9da.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_103a2c854d737ab86ce9c68026502587.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_245df0aac19de0f8bdb33a4295ff92aa.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_a325f704e423bd80680865df0b95d377.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_119397ff06d597a9c7b9a56a44fa4faf.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_2d98f5cfed51c6e153b3effd8e554ddd.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_dbef1235beed9f36c3f240f9f928206b.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_95c4880599676782c161ef98ade34394.jpg not downloaded yet
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_78d6dc841402d7acc1c7c21c8b241e01.jpg not downloaded yet
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_04562354002e5e463fd4bbe648bdbb21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_78d6dc841402d7acc1c7c21c8b241e01.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876e910>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_04562354002e5e463fd4bbe648bdbb21.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_95c4880599676782c161ef98ade34394.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5e50>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_78d6dc841402d7acc1c7c21c8b241e01.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_dbef1235beed9f36c3f240f9f928206b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841fd90>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_95c4880599676782c161ef98ade34394.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_2d98f5cfed51c6e153b3effd8e554ddd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486562d0>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_dbef1235beed9f36c3f240f9f928206b.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_119397ff06d597a9c7b9a56a44fa4faf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048605e50>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_2d98f5cfed51c6e153b3effd8e554ddd.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_a325f704e423bd80680865df0b95d377.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ee650>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_119397ff06d597a9c7b9a56a44fa4faf.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869ca90>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_a325f704e423bd80680865df0b95d377.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_245df0aac19de0f8bdb33a4295ff92aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_103a2c854d737ab86ce9c68026502587.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048607ed0>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_245df0aac19de0f8bdb33a4295ff92aa.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048655e50>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_103a2c854d737ab86ce9c68026502587.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_f38bf5944bdaabae5f37432222e1f9da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_84f18a7b5087a4a9ae02e37bf784d53e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5690>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_f38bf5944bdaabae5f37432222e1f9da.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487acb10>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_84f18a7b5087a4a9ae02e37bf784d53e.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b
2026-04-27 08:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16c8a73a-0d87-56bc-bd2a-a3d5889d172b, skipping ID generation
2026-04-27 08:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b with scrape type 1
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16c8a73a-0d87-56bc-bd2a-a3d5889d172b sending to next pipeline
2026-04-27 08:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16c8a73a-0d87-56bc-bd2a-a3d5889d172b, identifier: PY72211
2026-04-27 08:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16c8a73a-0d87-56bc-bd2a-a3d5889d172b with identifier: PY72211
2026-04-27 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16c8a73a-0d87-56bc-bd2a-a3d5889d172b with identifier: PY72211
2026-04-27 08:02:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16c8a73a-0d87-56bc-bd2a-a3d5889d172b with identifier: PY72211 to the API
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_84f18a7b5087a4a9ae02e37bf784d53e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:56:09Z',
'fuel_type': 'diesel',
'id': '16c8a73a-0d87-56bc-bd2a-a3d5889d172b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY72211',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'BMW',
'model': '3er',
'odometer': 98014,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_84f18a7b5087a4a9ae02e37bf784d53e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_f38bf5944bdaabae5f37432222e1f9da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_103a2c854d737ab86ce9c68026502587.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_245df0aac19de0f8bdb33a4295ff92aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_a325f704e423bd80680865df0b95d377.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_119397ff06d597a9c7b9a56a44fa4faf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_2d98f5cfed51c6e153b3effd8e554ddd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_dbef1235beed9f36c3f240f9f928206b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_95c4880599676782c161ef98ade34394.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16c8a73a-0d87-56bc-bd2a-a3d5889d172b/16c8a73a-0d87-56bc-bd2a-a3d5889d172b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/48/a248cbfeb2c005667fce1528d836dae7/pa/PY72211_78d6dc841402d7acc1c7c21c8b241e01.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-04-27 08:02:06 [auto1.es] INFO: Saving data for PY72211: {'created_time': 1777276926.301995, 'last_price_update_time': 1777276926.302007, 'has_photos': True, 'auction_closing_time': 1777305369.0}
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_dd06abfe13ae543929ea7134bd897f0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_b4f8a7eb6a39e3d0de5babe86fbae0eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ede50>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_dd06abfe13ae543929ea7134bd897f0e.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a34d0>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_b4f8a7eb6a39e3d0de5babe86fbae0eb.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_167143eb82f50eac508d92bdb0647f1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_89e1a440a61f8abfa3c333f2d9feae46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876cb90>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_167143eb82f50eac508d92bdb0647f1f.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481be410>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_89e1a440a61f8abfa3c333f2d9feae46.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_6d79d4d3ae6059d874bf2b74bd4acbdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5137dedadf514354c4631d3323f0eff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048640190>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_6d79d4d3ae6059d874bf2b74bd4acbdf.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487af590>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5137dedadf514354c4631d3323f0eff0.jpg saved to cache
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5074c17e383697582e67213e7e44e7cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_4baaa4830c073cfabef9bcc02dc38e4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048886410>
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5074c17e383697582e67213e7e44e7cb.jpg saved to cache
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_e4748ffa3821f965f9bd7537276336b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048654150>
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_4baaa4830c073cfabef9bcc02dc38e4e.jpg saved to cache
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048606cd0>
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_e4748ffa3821f965f9bd7537276336b3.jpg saved to cache
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4853ccb-ddbc-5572-a09b-368a170b70d7
2026-04-27 08:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4853ccb-ddbc-5572-a09b-368a170b70d7, skipping ID generation
2026-04-27 08:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4853ccb-ddbc-5572-a09b-368a170b70d7 with scrape type 1
2026-04-27 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4853ccb-ddbc-5572-a09b-368a170b70d7 sending to next pipeline
2026-04-27 08:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4853ccb-ddbc-5572-a09b-368a170b70d7, identifier: VE34286
2026-04-27 08:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4853ccb-ddbc-5572-a09b-368a170b70d7 with identifier: VE34286
2026-04-27 08:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4853ccb-ddbc-5572-a09b-368a170b70d7 with identifier: VE34286
2026-04-27 08:02:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4853ccb-ddbc-5572-a09b-368a170b70d7 with identifier: VE34286 to the API
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_e4748ffa3821f965f9bd7537276336b3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-04-27T15:24:02Z',
'fuel_type': 'diesel',
'id': 'f4853ccb-ddbc-5572-a09b-368a170b70d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE34286',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Dacia',
'model': 'Duster',
'odometer': 161731,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_e4748ffa3821f965f9bd7537276336b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_4baaa4830c073cfabef9bcc02dc38e4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5074c17e383697582e67213e7e44e7cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_5137dedadf514354c4631d3323f0eff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_6d79d4d3ae6059d874bf2b74bd4acbdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_89e1a440a61f8abfa3c333f2d9feae46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_167143eb82f50eac508d92bdb0647f1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_b4f8a7eb6a39e3d0de5babe86fbae0eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_dd06abfe13ae543929ea7134bd897f0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f4853ccb-ddbc-5572-a09b-368a170b70d7/f4853ccb-ddbc-5572-a09b-368a170b70d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/a5/e4a5711c569f7450dd48fe0af5536efb/pa/VE34286_04562354002e5e463fd4bbe648bdbb21.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige 4x4',
'transmission': 'manual',
'trim': 'Prestige 4x4',
'year': 2020}
2026-04-27 08:02:07 [auto1.es] INFO: Saving data for VE34286: {'created_time': 1777276927.850611, 'last_price_update_time': 1777276927.850621, 'has_photos': True, 'auction_closing_time': 1777303442.0}
2026-04-27 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_20c9d8eb3cdde7175e38194aa3fe9bef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048769cd0>
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_20c9d8eb3cdde7175e38194aa3fe9bef.jpg saved to cache
2026-04-27 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:02:33 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 4 pages/min), scraped 452 items (at 2 items/min)
2026-04-27 08:02:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.956(s), this was the 1st time calling it.
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.661407067746893 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.379(s), this was the 1st time calling it.
2026-04-27 08:02:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.261453296980882 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA89613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW09486> (referer: https://www.auto1.com/v1/car-details-view/GW09486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18840cad-54d6-5d16-a275-1c5abb92d02f with identifier: GW09486
2026-04-27 08:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18840cad-54d6-5d16-a275-1c5abb92d02f with scrape type 1
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_86ee221e4cad1cd6a2f7a49057e1c8af.jpg not downloaded yet
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_28d0adcc364b45996a8c4cd3fc9b8499.jpg not downloaded yet
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_864a5ce07bc229d9914a45892a4f6c97.jpg not downloaded yet
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_ddc60a363974a4633a1e2020b33126aa.jpg not downloaded yet
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_b86a2cb23900ebaa1df6ae13be3ed78f.jpg not downloaded yet
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_eb8e1ab606b861c3bc877b86d4c03092.jpg not downloaded yet
2026-04-27 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP78962/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_eb8e1ab606b861c3bc877b86d4c03092.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bef50>
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_eb8e1ab606b861c3bc877b86d4c03092.jpg saved to cache
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA36356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_b86a2cb23900ebaa1df6ae13be3ed78f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eee10>
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_b86a2cb23900ebaa1df6ae13be3ed78f.jpg saved to cache
2026-04-27 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR89235> (referer: https://www.auto1.com/v1/car-details-view/LR89235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235
2026-04-27 08:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6655ee51-9da6-5e0c-9335-3242d967d70a with scrape type 1
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_153511755cdce79e153f1749536fea2a.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_a15c7fc2dd32e0d7d68a8dce078976cf.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_d08e668ebd832604a083db4a0e0e3bd0.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_43b10cb9c4a94535f8c27c15956ee0cb.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_eb1a7cef0c45d81b958723d867eff761.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5ffbc1b6c582ae80f5b8e7a3410f1484.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5a798613eb2d29b8eacf624c53cd2cc8.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_ca242577b2e5afbc93fcc258d185440f.jpg not downloaded yet
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_ddc60a363974a4633a1e2020b33126aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_193031af36f75ebc691a4a6a4e0e3c47.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_1da7f5133796af7d7e8aea75dd954895.jpg not downloaded yet
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895f090>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_ddc60a363974a4633a1e2020b33126aa.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_ca242577b2e5afbc93fcc258d185440f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841b450>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_ca242577b2e5afbc93fcc258d185440f.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_1da7f5133796af7d7e8aea75dd954895.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e1d50>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_1da7f5133796af7d7e8aea75dd954895.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_193031af36f75ebc691a4a6a4e0e3c47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841a590>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_193031af36f75ebc691a4a6a4e0e3c47.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES03046> (referer: https://www.auto1.com/v1/car-details-view/ES03046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5a798613eb2d29b8eacf624c53cd2cc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5ffbc1b6c582ae80f5b8e7a3410f1484.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932d90a1-72f1-5605-9ac4-2bbf0978171b with identifier: ES03046
2026-04-27 08:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932d90a1-72f1-5605-9ac4-2bbf0978171b with scrape type 1
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_5d233b3c629b175a6a027247333df880.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_cfdc4993bdc725045292af7158c39af1.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_92a03dab5c128b7070157491eae8cfe0.jpg not downloaded yet
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ef790>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5a798613eb2d29b8eacf624c53cd2cc8.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_eb1a7cef0c45d81b958723d867eff761.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51270aca32090accdb297eb41f84cad4.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51999e6c65a45d771d04c79a2bab6890.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_0be74968705d352b81c3ee38b2df04f5.jpg not downloaded yet
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a83950>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5ffbc1b6c582ae80f5b8e7a3410f1484.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_43b10cb9c4a94535f8c27c15956ee0cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_92a03dab5c128b7070157491eae8cfe0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42350>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_eb1a7cef0c45d81b958723d867eff761.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51999e6c65a45d771d04c79a2bab6890.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ee610>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_43b10cb9c4a94535f8c27c15956ee0cb.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048659550>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_92a03dab5c128b7070157491eae8cfe0.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_0be74968705d352b81c3ee38b2df04f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42650>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51999e6c65a45d771d04c79a2bab6890.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51270aca32090accdb297eb41f84cad4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048424790>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_0be74968705d352b81c3ee38b2df04f5.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_5d233b3c629b175a6a027247333df880.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a8890>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51270aca32090accdb297eb41f84cad4.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_cfdc4993bdc725045292af7158c39af1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893810>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_5d233b3c629b175a6a027247333df880.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a41210>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_cfdc4993bdc725045292af7158c39af1.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 932d90a1-72f1-5605-9ac4-2bbf0978171b
2026-04-27 08:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 932d90a1-72f1-5605-9ac4-2bbf0978171b, skipping ID generation
2026-04-27 08:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932d90a1-72f1-5605-9ac4-2bbf0978171b with scrape type 1
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 932d90a1-72f1-5605-9ac4-2bbf0978171b sending to next pipeline
2026-04-27 08:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 932d90a1-72f1-5605-9ac4-2bbf0978171b, identifier: ES03046
2026-04-27 08:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 932d90a1-72f1-5605-9ac4-2bbf0978171b with identifier: ES03046
2026-04-27 08:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 932d90a1-72f1-5605-9ac4-2bbf0978171b with identifier: ES03046
2026-04-27 08:02:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 932d90a1-72f1-5605-9ac4-2bbf0978171b with identifier: ES03046 to the API
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_cfdc4993bdc725045292af7158c39af1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Calaf',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.8L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:06:07Z',
'fuel_type': 'petrol',
'id': '932d90a1-72f1-5605-9ac4-2bbf0978171b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES03046',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Honda',
'model': 'Civic',
'odometer': 235412,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_5d233b3c629b175a6a027247333df880.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_cfdc4993bdc725045292af7158c39af1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_92a03dab5c128b7070157491eae8cfe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51270aca32090accdb297eb41f84cad4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_51999e6c65a45d771d04c79a2bab6890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_932d90a1-72f1-5605-9ac4-2bbf0978171b/932d90a1-72f1-5605-9ac4-2bbf0978171b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e26fcdeb65316035fcd7456e8aa476c/pa/ES03046_0be74968705d352b81c3ee38b2df04f5.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2006-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Civic 1.8 VTEC Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2006}
2026-04-27 08:02:58 [auto1.es] INFO: Saving data for ES03046: {'created_time': 1777276978.720784, 'last_price_update_time': 1777276978.720799, 'has_photos': True, 'auction_closing_time': 1777302367.0}
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_d08e668ebd832604a083db4a0e0e3bd0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_a15c7fc2dd32e0d7d68a8dce078976cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_153511755cdce79e153f1749536fea2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a18d0>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_d08e668ebd832604a083db4a0e0e3bd0.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3c90>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_a15c7fc2dd32e0d7d68a8dce078976cf.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_864a5ce07bc229d9914a45892a4f6c97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0496d3c10>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_153511755cdce79e153f1749536fea2a.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6655ee51-9da6-5e0c-9335-3242d967d70a
2026-04-27 08:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6655ee51-9da6-5e0c-9335-3242d967d70a, skipping ID generation
2026-04-27 08:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6655ee51-9da6-5e0c-9335-3242d967d70a with scrape type 1
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6655ee51-9da6-5e0c-9335-3242d967d70a sending to next pipeline
2026-04-27 08:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6655ee51-9da6-5e0c-9335-3242d967d70a, identifier: LR89235
2026-04-27 08:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-04-27 08:02:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235
2026-04-27 08:02:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6655ee51-9da6-5e0c-9335-3242d967d70a with identifier: LR89235 to the API
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_153511755cdce79e153f1749536fea2a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Araia',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:37:20Z',
'fuel_type': 'diesel',
'id': '6655ee51-9da6-5e0c-9335-3242d967d70a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR89235',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Audi',
'model': 'A6',
'odometer': 200344,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_153511755cdce79e153f1749536fea2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_a15c7fc2dd32e0d7d68a8dce078976cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_d08e668ebd832604a083db4a0e0e3bd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_43b10cb9c4a94535f8c27c15956ee0cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_eb1a7cef0c45d81b958723d867eff761.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5ffbc1b6c582ae80f5b8e7a3410f1484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_5a798613eb2d29b8eacf624c53cd2cc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_ca242577b2e5afbc93fcc258d185440f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_193031af36f75ebc691a4a6a4e0e3c47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6655ee51-9da6-5e0c-9335-3242d967d70a/6655ee51-9da6-5e0c-9335-3242d967d70a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/08/a208a65739944daf03a69e48b5ca15c5/pa/LR89235_1da7f5133796af7d7e8aea75dd954895.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2016-08-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 2.0 TDI ultra',
'transmission': 'automatic',
'trim': 'ultra',
'year': 2016}
2026-04-27 08:02:59 [auto1.es] INFO: Saving data for LR89235: {'created_time': 1777276979.625643, 'last_price_update_time': 1777276979.625654, 'has_photos': True, 'auction_closing_time': 1777304240.0}
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_28d0adcc364b45996a8c4cd3fc9b8499.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e2a50>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_864a5ce07bc229d9914a45892a4f6c97.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bee10>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_28d0adcc364b45996a8c4cd3fc9b8499.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_4a046fb7c15bc23d5fecc3a7963ca69c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ06023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048605e50>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_4a046fb7c15bc23d5fecc3a7963ca69c.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c38796b1-16ab-5498-beb2-1e7196c5043f
2026-04-27 08:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c38796b1-16ab-5498-beb2-1e7196c5043f, skipping ID generation
2026-04-27 08:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38796b1-16ab-5498-beb2-1e7196c5043f with scrape type 1
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c38796b1-16ab-5498-beb2-1e7196c5043f sending to next pipeline
2026-04-27 08:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c38796b1-16ab-5498-beb2-1e7196c5043f, identifier: KJ50966
2026-04-27 08:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c38796b1-16ab-5498-beb2-1e7196c5043f with identifier: KJ50966
2026-04-27 08:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c38796b1-16ab-5498-beb2-1e7196c5043f with identifier: KJ50966
2026-04-27 08:03:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c38796b1-16ab-5498-beb2-1e7196c5043f with identifier: KJ50966 to the API
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_4a046fb7c15bc23d5fecc3a7963ca69c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'Calaf',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:43:02Z',
'fuel_type': 'petrol',
'id': 'c38796b1-16ab-5498-beb2-1e7196c5043f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ50966',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Opel',
'model': 'Astra',
'odometer': 169136,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_d1d6eae9461f57901ed1b31f29e0b87a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_15f2e538fece86bc95d0eb21cf113ecc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_4a046fb7c15bc23d5fecc3a7963ca69c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_06a21b2bb387f43f40d2ed5645e6eb46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_ec53a84804151664859601591b2df987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c38796b1-16ab-5498-beb2-1e7196c5043f/c38796b1-16ab-5498-beb2-1e7196c5043f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/f2/7bf2a0c15bbb7ee31856212ebe2c70fb/pa/KJ50966_20c9d8eb3cdde7175e38194aa3fe9bef.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2012-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2012}
2026-04-27 08:03:00 [auto1.es] INFO: Saving data for KJ50966: {'created_time': 1777276980.441474, 'last_price_update_time': 1777276980.441486, 'has_photos': True, 'auction_closing_time': 1777304582.0}
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_86ee221e4cad1cd6a2f7a49057e1c8af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a837d0>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_86ee221e4cad1cd6a2f7a49057e1c8af.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18840cad-54d6-5d16-a275-1c5abb92d02f
2026-04-27 08:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18840cad-54d6-5d16-a275-1c5abb92d02f, skipping ID generation
2026-04-27 08:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18840cad-54d6-5d16-a275-1c5abb92d02f with scrape type 1
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18840cad-54d6-5d16-a275-1c5abb92d02f sending to next pipeline
2026-04-27 08:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 18840cad-54d6-5d16-a275-1c5abb92d02f, identifier: GW09486
2026-04-27 08:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 18840cad-54d6-5d16-a275-1c5abb92d02f with identifier: GW09486
2026-04-27 08:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 18840cad-54d6-5d16-a275-1c5abb92d02f with identifier: GW09486
2026-04-27 08:03:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 18840cad-54d6-5d16-a275-1c5abb92d02f with identifier: GW09486 to the API
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_86ee221e4cad1cd6a2f7a49057e1c8af.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:20:00Z',
'fuel_type': 'diesel',
'id': '18840cad-54d6-5d16-a275-1c5abb92d02f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW09486',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Smart',
'model': 'forfour',
'odometer': 167009,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_86ee221e4cad1cd6a2f7a49057e1c8af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_28d0adcc364b45996a8c4cd3fc9b8499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_864a5ce07bc229d9914a45892a4f6c97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_ddc60a363974a4633a1e2020b33126aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_b86a2cb23900ebaa1df6ae13be3ed78f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18840cad-54d6-5d16-a275-1c5abb92d02f/18840cad-54d6-5d16-a275-1c5abb92d02f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d7/b6d70792fe5eddfc4b672efaa7bf65de/pa/GW09486_eb8e1ab606b861c3bc877b86d4c03092.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2006-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'Smart forfour 1.5 CDI Pulse',
'transmission': 'manual',
'trim': 'Pulse',
'year': 2006}
2026-04-27 08:03:01 [auto1.es] INFO: Saving data for GW09486: {'created_time': 1777276981.015814, 'last_price_update_time': 1777276981.015825, 'has_photos': True, 'auction_closing_time': 1777303200.0}
2026-04-27 08:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK70261> (referer: https://www.auto1.com/v1/car-details-view/XK70261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c488272-406b-5981-a371-a199e63877de with identifier: XK70261
2026-04-27 08:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c488272-406b-5981-a371-a199e63877de with scrape type 1
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_cc909ef2d2cd1c6a99bd4e6c95a89ad0.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_6c187fec3c98e2cdf134233c4dae7fac.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_e6744a06fa3e31fb1b69ef69d5c3927e.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3b4a6c51340e06c0568b19e2619afc9c.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_97dfbedf3527e9a27616cad6b032b1ef.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3a506909dff0c891dbaf31409363b504.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_925b35c66746988cbe803e6c7956b969.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_b5d14e444b9f25f48c931674e2470a17.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_a4bf490359a988bd6f69f8773f044b90.jpg not downloaded yet
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_d6264416e2345bb72f0fc8cfd9b493a0.jpg not downloaded yet
2026-04-27 08:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB96723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_d6264416e2345bb72f0fc8cfd9b493a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048641850>
2026-04-27 08:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_d6264416e2345bb72f0fc8cfd9b493a0.jpg saved to cache
2026-04-27 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR98730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_a4bf490359a988bd6f69f8773f044b90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ed490>
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_a4bf490359a988bd6f69f8773f044b90.jpg saved to cache
2026-04-27 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV18346> (referer: https://www.auto1.com/v1/car-details-view/FV18346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 with identifier: FV18346
2026-04-27 08:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 with scrape type 1
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1f4464e1259cee14f684033c3b5e4f5e.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_cf33731b2b276c8ec67766c30f18ccc8.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_80ee6e4478ea1fcb2ce0b36fe473a90d.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_9bb2bc8bdc3d615c9acb2a3d77dfc3cf.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_bdc25a930c08949eddac7a5a9af6ed0e.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_ecb9810c64acc379ad420bc0a1caf817.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_b413eb20db7e77c40a9c6f9291cf8f7b.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_a63536695912aad4e090b22a40e3e714.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1ed720dabfaf445fc33a5827abb42401.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_6df6b96faa0d898acf5ee07a7d280186.jpg not downloaded yet
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_b5d14e444b9f25f48c931674e2470a17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a81490>
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_b5d14e444b9f25f48c931674e2470a17.jpg saved to cache
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_6df6b96faa0d898acf5ee07a7d280186.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1ed720dabfaf445fc33a5827abb42401.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484aa810>
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_6df6b96faa0d898acf5ee07a7d280186.jpg saved to cache
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_a63536695912aad4e090b22a40e3e714.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA89613> (referer: https://www.auto1.com/v1/car-details-view/HA89613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a49190>
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1ed720dabfaf445fc33a5827abb42401.jpg saved to cache
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843c190>
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_a63536695912aad4e090b22a40e3e714.jpg saved to cache
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 with identifier: HA89613
2026-04-27 08:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 with scrape type 1
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_dace6da534ffe881e33f9fdb0726f594.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_03fa079a7ed28d60c28753657f947ac8.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95a9899f6dc448d905b170c7790e17fd.jpg not downloaded yet
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_f538bfbdc2b23dfa274651b8c2a1653b.jpg not downloaded yet
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_ecb9810c64acc379ad420bc0a1caf817.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_9b35589b3658bcae697cba9b6b92e934.jpg not downloaded yet
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_b413eb20db7e77c40a9c6f9291cf8f7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_2cee073cc9143e5b8ca97847adeb5f81.jpg not downloaded yet
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95e0b9c1ca4525084473f58cc1effb48.jpg not downloaded yet
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_d87800fb925681cefb532d096f6e7876.jpg not downloaded yet
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_cfd6dcfaac9d77183cf0cd0b6a1c861d.jpg not downloaded yet
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_5810255b55cf177a396bff9b0a57b4df.jpg not downloaded yet
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_f538bfbdc2b23dfa274651b8c2a1653b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_9b35589b3658bcae697cba9b6b92e934.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048425cd0>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_ecb9810c64acc379ad420bc0a1caf817.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048643950>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_b413eb20db7e77c40a9c6f9291cf8f7b.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_5810255b55cf177a396bff9b0a57b4df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_cfd6dcfaac9d77183cf0cd0b6a1c861d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ebb10>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_f538bfbdc2b23dfa274651b8c2a1653b.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b6a90>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_9b35589b3658bcae697cba9b6b92e934.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95e0b9c1ca4525084473f58cc1effb48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876ff90>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_5810255b55cf177a396bff9b0a57b4df.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048658d10>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_cfd6dcfaac9d77183cf0cd0b6a1c861d.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_d87800fb925681cefb532d096f6e7876.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_2cee073cc9143e5b8ca97847adeb5f81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048857610>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95e0b9c1ca4525084473f58cc1effb48.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95a9899f6dc448d905b170c7790e17fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_03fa079a7ed28d60c28753657f947ac8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869dd10>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_d87800fb925681cefb532d096f6e7876.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_dace6da534ffe881e33f9fdb0726f594.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846c150>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_2cee073cc9143e5b8ca97847adeb5f81.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876a750>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95a9899f6dc448d905b170c7790e17fd.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5ad0>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_03fa079a7ed28d60c28753657f947ac8.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_bdc25a930c08949eddac7a5a9af6ed0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a14d0>
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_dace6da534ffe881e33f9fdb0726f594.jpg saved to cache
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40
2026-04-27 08:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40, skipping ID generation
2026-04-27 08:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 with scrape type 1
2026-04-27 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 sending to next pipeline
2026-04-27 08:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40, identifier: HA89613
2026-04-27 08:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 with identifier: HA89613
2026-04-27 08:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 with identifier: HA89613
2026-04-27 08:03:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60ef2fc3-beae-5bf9-9fac-6fdd09b00e40 with identifier: HA89613 to the API
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_dace6da534ffe881e33f9fdb0726f594.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'city': 'Sevilla',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-04-27T15:01:19Z',
'fuel_type': 'diesel',
'id': '60ef2fc3-beae-5bf9-9fac-6fdd09b00e40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA89613',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 251425,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48487,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_dace6da534ffe881e33f9fdb0726f594.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48022,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_03fa079a7ed28d60c28753657f947ac8.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42408,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95a9899f6dc448d905b170c7790e17fd.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37166,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_f538bfbdc2b23dfa274651b8c2a1653b.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39791,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_9b35589b3658bcae697cba9b6b92e934.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42235,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_2cee073cc9143e5b8ca97847adeb5f81.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40448,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_95e0b9c1ca4525084473f58cc1effb48.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49863,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_d87800fb925681cefb532d096f6e7876.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_cfd6dcfaac9d77183cf0cd0b6a1c861d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ef2fc3-beae-5bf9-9fac-6fdd09b00e40/60ef2fc3-beae-5bf9-9fac-6fdd09b00e40_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51079,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/81/1b81f3a2adfda088fdd743d341d2b6b7/pa/HA89613_5810255b55cf177a396bff9b0a57b4df.jpg',
'Width': 640}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2012-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 250 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2012}
2026-04-27 08:03:14 [auto1.es] INFO: Saving data for HA89613: {'created_time': 1777276994.258319, 'last_price_update_time': 1777276994.258329, 'has_photos': True, 'auction_closing_time': 1777302079.0}
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_9bb2bc8bdc3d615c9acb2a3d77dfc3cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA36356> (referer: https://www.auto1.com/v1/car-details-view/HA36356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489310d0>
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_bdc25a930c08949eddac7a5a9af6ed0e.jpg saved to cache
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662a50>
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_9bb2bc8bdc3d615c9acb2a3d77dfc3cf.jpg saved to cache
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4580eba3-1b90-59a6-98ab-d10cc637be01 with identifier: HA36356
2026-04-27 08:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4580eba3-1b90-59a6-98ab-d10cc637be01 with scrape type 1
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_e08615dc1a2278036ddf921eeead0d1f.jpg not downloaded yet
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1f4464e1259cee14f684033c3b5e4f5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_3331f389de8d0ca816319be1c095920d.jpg not downloaded yet
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_a0288282b52283ebb3a3723aea37a323.jpg not downloaded yet
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_80ee6e4478ea1fcb2ce0b36fe473a90d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_89c1558d38487e03a942a9ea901bdeba.jpg not downloaded yet
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_c630b5ef6aa4f070f85100c63650f124.jpg not downloaded yet
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_cf33731b2b276c8ec67766c30f18ccc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_7c1b46c908ddab974e519eafb9024a93.jpg not downloaded yet
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_11a1653f7e3d74cde14d12393ebff92e.jpg not downloaded yet
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_0cd465f86ec2f309428d10e229781152.jpg not downloaded yet
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_e08615dc1a2278036ddf921eeead0d1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_02ff206364df3846557321e8ff9d488a.jpg not downloaded yet
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048677e90>
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1f4464e1259cee14f684033c3b5e4f5e.jpg saved to cache
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_97b8975c178fbb0530fdd9b18b55a8a2.jpg not downloaded yet
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_a0288282b52283ebb3a3723aea37a323.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_c630b5ef6aa4f070f85100c63650f124.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e8810>
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_80ee6e4478ea1fcb2ce0b36fe473a90d.jpg saved to cache
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822a650>
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_cf33731b2b276c8ec67766c30f18ccc8.jpg saved to cache
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14
2026-04-27 08:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14, skipping ID generation
2026-04-27 08:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 with scrape type 1
2026-04-27 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 sending to next pipeline
2026-04-27 08:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14, identifier: FV18346
2026-04-27 08:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 with identifier: FV18346
2026-04-27 08:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 with identifier: FV18346
2026-04-27 08:03:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14 with identifier: FV18346 to the API
2026-04-27 08:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_cf33731b2b276c8ec67766c30f18ccc8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Calaf',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-04-27T15:20:57Z',
'fuel_type': 'petrol',
'id': '3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV18346',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Peugeot',
'model': '208',
'odometer': 86214,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1f4464e1259cee14f684033c3b5e4f5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_cf33731b2b276c8ec67766c30f18ccc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_80ee6e4478ea1fcb2ce0b36fe473a90d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_9bb2bc8bdc3d615c9acb2a3d77dfc3cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_bdc25a930c08949eddac7a5a9af6ed0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_ecb9810c64acc379ad420bc0a1caf817.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_b413eb20db7e77c40a9c6f9291cf8f7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_a63536695912aad4e090b22a40e3e714.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_1ed720dabfaf445fc33a5827abb42401.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14/3f0d11ff-e164-5a8a-b54a-ed2c51bf5f14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3e11551c2e105a0d434e337eadd76d/pa/FV18346_6df6b96faa0d898acf5ee07a7d280186.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2017-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 e-VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-04-27 08:03:15 [auto1.es] INFO: Saving data for FV18346: {'created_time': 1777276995.189162, 'last_price_update_time': 1777276995.189172, 'has_photos': True, 'auction_closing_time': 1777303257.0}
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_97b8975c178fbb0530fdd9b18b55a8a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_0cd465f86ec2f309428d10e229781152.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841b790>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_e08615dc1a2278036ddf921eeead0d1f.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876d7d0>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_a0288282b52283ebb3a3723aea37a323.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048510d50>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_c630b5ef6aa4f070f85100c63650f124.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_02ff206364df3846557321e8ff9d488a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ78547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5710>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_97b8975c178fbb0530fdd9b18b55a8a2.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865be10>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_0cd465f86ec2f309428d10e229781152.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_89c1558d38487e03a942a9ea901bdeba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880f890>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_02ff206364df3846557321e8ff9d488a.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_7c1b46c908ddab974e519eafb9024a93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837fc10>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_89c1558d38487e03a942a9ea901bdeba.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_11a1653f7e3d74cde14d12393ebff92e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484aacd0>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_7c1b46c908ddab974e519eafb9024a93.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_3331f389de8d0ca816319be1c095920d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42090>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_11a1653f7e3d74cde14d12393ebff92e.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_925b35c66746988cbe803e6c7956b969.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484aa4d0>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_3331f389de8d0ca816319be1c095920d.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4580eba3-1b90-59a6-98ab-d10cc637be01
2026-04-27 08:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4580eba3-1b90-59a6-98ab-d10cc637be01, skipping ID generation
2026-04-27 08:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4580eba3-1b90-59a6-98ab-d10cc637be01 with scrape type 1
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4580eba3-1b90-59a6-98ab-d10cc637be01 sending to next pipeline
2026-04-27 08:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4580eba3-1b90-59a6-98ab-d10cc637be01, identifier: HA36356
2026-04-27 08:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4580eba3-1b90-59a6-98ab-d10cc637be01 with identifier: HA36356
2026-04-27 08:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4580eba3-1b90-59a6-98ab-d10cc637be01 with identifier: HA36356
2026-04-27 08:03:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4580eba3-1b90-59a6-98ab-d10cc637be01 with identifier: HA36356 to the API
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_3331f389de8d0ca816319be1c095920d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Esquivias',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 128,
'expiration_date': '2026-04-27T15:29:35Z',
'fuel_type': 'petrol',
'id': '4580eba3-1b90-59a6-98ab-d10cc637be01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA36356',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Ssangyong',
'model': 'Tivoli',
'odometer': 103635,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_e08615dc1a2278036ddf921eeead0d1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_3331f389de8d0ca816319be1c095920d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_a0288282b52283ebb3a3723aea37a323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_89c1558d38487e03a942a9ea901bdeba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_c630b5ef6aa4f070f85100c63650f124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_7c1b46c908ddab974e519eafb9024a93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_11a1653f7e3d74cde14d12393ebff92e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_0cd465f86ec2f309428d10e229781152.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_02ff206364df3846557321e8ff9d488a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4580eba3-1b90-59a6-98ab-d10cc637be01/4580eba3-1b90-59a6-98ab-d10cc637be01_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/7e/147efabdec9fc3201ae2d0dcd643b374/pa/HA36356_97b8975c178fbb0530fdd9b18b55a8a2.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2015-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Ssangyong Tivoli 1.6 Limited 4x2',
'transmission': 'manual',
'trim': 'Limited 4x2',
'year': 2015}
2026-04-27 08:03:16 [auto1.es] INFO: Saving data for HA36356: {'created_time': 1777276996.213317, 'last_price_update_time': 1777276996.213328, 'has_photos': True, 'auction_closing_time': 1777303775.0}
2026-04-27 08:03:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.230(s), this was the 1st time calling it.
2026-04-27 08:03:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9128357535429767 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3a506909dff0c891dbaf31409363b504.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_97dfbedf3527e9a27616cad6b032b1ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3b4a6c51340e06c0568b19e2619afc9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a40e10>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_925b35c66746988cbe803e6c7956b969.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cacd0>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3a506909dff0c891dbaf31409363b504.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b1050>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_97dfbedf3527e9a27616cad6b032b1ef.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1c50>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3b4a6c51340e06c0568b19e2619afc9c.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_cc909ef2d2cd1c6a99bd4e6c95a89ad0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_6c187fec3c98e2cdf134233c4dae7fac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_e6744a06fa3e31fb1b69ef69d5c3927e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_97ac97e4a6227672b4b4a9e7b21d988c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bc1d0>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_cc909ef2d2cd1c6a99bd4e6c95a89ad0.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048657690>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_6c187fec3c98e2cdf134233c4dae7fac.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_7e51e94b629e8c2bf5a4deb5173e57eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895ec10>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_e6744a06fa3e31fb1b69ef69d5c3927e.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c488272-406b-5981-a371-a199e63877de
2026-04-27 08:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c488272-406b-5981-a371-a199e63877de, skipping ID generation
2026-04-27 08:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c488272-406b-5981-a371-a199e63877de with scrape type 1
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c488272-406b-5981-a371-a199e63877de sending to next pipeline
2026-04-27 08:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c488272-406b-5981-a371-a199e63877de, identifier: XK70261
2026-04-27 08:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c488272-406b-5981-a371-a199e63877de with identifier: XK70261
2026-04-27 08:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c488272-406b-5981-a371-a199e63877de with identifier: XK70261
2026-04-27 08:03:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c488272-406b-5981-a371-a199e63877de with identifier: XK70261 to the API
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_e6744a06fa3e31fb1b69ef69d5c3927e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Calaf',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:40:47Z',
'fuel_type': 'diesel',
'id': '9c488272-406b-5981-a371-a199e63877de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK70261',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Audi',
'model': 'A4',
'odometer': 214358,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_cc909ef2d2cd1c6a99bd4e6c95a89ad0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_6c187fec3c98e2cdf134233c4dae7fac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_e6744a06fa3e31fb1b69ef69d5c3927e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3b4a6c51340e06c0568b19e2619afc9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_97dfbedf3527e9a27616cad6b032b1ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_3a506909dff0c891dbaf31409363b504.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_925b35c66746988cbe803e6c7956b969.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_b5d14e444b9f25f48c931674e2470a17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_a4bf490359a988bd6f69f8773f044b90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c488272-406b-5981-a371-a199e63877de/9c488272-406b-5981-a371-a199e63877de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/d2/1dd2ac4b15610ef9a13449742f9c610f/pa/XK70261_d6264416e2345bb72f0fc8cfd9b493a0.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2008-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 08:03:17 [auto1.es] INFO: Saving data for XK70261: {'created_time': 1777276997.038105, 'last_price_update_time': 1777276997.038115, 'has_photos': True, 'auction_closing_time': 1777304447.0}
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843ffd0>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_97ac97e4a6227672b4b4a9e7b21d988c.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837e410>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_7e51e94b629e8c2bf5a4deb5173e57eb.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT96538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.609(s), this was the 1st time calling it.
2026-04-27 08:03:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.142967380541246 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.455(s), this was the 1st time calling it.
2026-04-27 08:03:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.482072609976896 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP78962> (referer: https://www.auto1.com/v1/car-details-view/NP78962/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d1471a4-d653-59df-a1ef-ef46e6554cd6 with identifier: NP78962
2026-04-27 08:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6 with scrape type 1
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_ae414aece3911a64cf4cc43bd3ac66f2.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_a345cc2d7e8dc50128da0af773a8a54b.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_f3116667f323cbb82e16374d5bc1487b.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_d67b6e1b8c788df99b5ece6043088e21.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_7324fa14eef6e6f5f1ad10343afd48e2.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_656691ba91e0d99f266cda557d56d2dd.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_adee51af735101304765a8f34853e444.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_0b4d495c78551b18f38bb5ad9629d312.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c7aa860abe7993f29e5ba5d304ca8fc2.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c85bac9dca53dc695fc6c610766fc9e2.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ02934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c85bac9dca53dc695fc6c610766fc9e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c7aa860abe7993f29e5ba5d304ca8fc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048607290>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c85bac9dca53dc695fc6c610766fc9e2.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852e290>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c7aa860abe7993f29e5ba5d304ca8fc2.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW64500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_0b4d495c78551b18f38bb5ad9629d312.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB96723> (referer: https://www.auto1.com/v1/car-details-view/PB96723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486059d0>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_0b4d495c78551b18f38bb5ad9629d312.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_adee51af735101304765a8f34853e444.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf6650d-38e0-5129-bfe9-04c7cb4b02db with identifier: PB96723
2026-04-27 08:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf6650d-38e0-5129-bfe9-04c7cb4b02db with scrape type 1
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_4ba8ffd66865d4b3db2fb71e049036c3.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_2e6547a6198c658e9f79e5d54a8ddd04.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_58d914c4263ac46fcd5f5ca291674709.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_12403359a11edb288ea77e6aabe1b4a8.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_78dbc103fd49acbe867902d9544211f7.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_1bab52ffe9e19767e788ed1543875dab.jpg not downloaded yet
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843c510>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_adee51af735101304765a8f34853e444.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_194c2589aa43e9be17b67e9af7ac3a9f.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_16638b99ee5933518046246f35f65519.jpg not downloaded yet
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_656691ba91e0d99f266cda557d56d2dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_b06f3d7d0669790f32d316e499bd42dc.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_62010038e4d31dae0bbaf370de5a4255.jpg not downloaded yet
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b1d50>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_656691ba91e0d99f266cda557d56d2dd.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_16638b99ee5933518046246f35f65519.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_62010038e4d31dae0bbaf370de5a4255.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04895c450>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_16638b99ee5933518046246f35f65519.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_b06f3d7d0669790f32d316e499bd42dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a8750>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_62010038e4d31dae0bbaf370de5a4255.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR98730> (referer: https://www.auto1.com/v1/car-details-view/JR98730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a810d0>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_b06f3d7d0669790f32d316e499bd42dc.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_1bab52ffe9e19767e788ed1543875dab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec4892a-21cf-52b6-a03a-480553a21ce3 with identifier: JR98730
2026-04-27 08:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec4892a-21cf-52b6-a03a-480553a21ce3 with scrape type 1
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_9fd3e4bcb0e593389a133b8dc33e3d9f.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_194c2589aa43e9be17b67e9af7ac3a9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ce671cadad7175b7862e689fca6607ea.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_74b76243a26603c849d404c076121ba4.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_3c081f2b4679411683086271ef318d13.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_60b4f402748c057e864405b9dfe95236.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_76b92c74949bbef9eaf3bf6f1127ddec.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_29260daec3e3686f995795faf3a77ea8.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_78dbc103fd49acbe867902d9544211f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ed20fe51189f7071d0d2f4395cbe9b5d.jpg not downloaded yet
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852ca50>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_1bab52ffe9e19767e788ed1543875dab.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_9fd3e4bcb0e593389a133b8dc33e3d9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_2a50199516ff7543d28b114fc4b6043c.jpg not downloaded yet
2026-04-27 08:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a85fe50>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_194c2589aa43e9be17b67e9af7ac3a9f.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_95b785a63595af416c286826e2885d82.jpg not downloaded yet
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048886890>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_78dbc103fd49acbe867902d9544211f7.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_29260daec3e3686f995795faf3a77ea8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892a90>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_9fd3e4bcb0e593389a133b8dc33e3d9f.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_95b785a63595af416c286826e2885d82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048605e50>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_29260daec3e3686f995795faf3a77ea8.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ed20fe51189f7071d0d2f4395cbe9b5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a66d0>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_95b785a63595af416c286826e2885d82.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7890>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ed20fe51189f7071d0d2f4395cbe9b5d.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_2a50199516ff7543d28b114fc4b6043c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_76b92c74949bbef9eaf3bf6f1127ddec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880dc50>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_2a50199516ff7543d28b114fc4b6043c.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768a90>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_76b92c74949bbef9eaf3bf6f1127ddec.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_60b4f402748c057e864405b9dfe95236.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_3c081f2b4679411683086271ef318d13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896ae10>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_60b4f402748c057e864405b9dfe95236.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048696310>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_3c081f2b4679411683086271ef318d13.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_74b76243a26603c849d404c076121ba4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ce671cadad7175b7862e689fca6607ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_12403359a11edb288ea77e6aabe1b4a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0f90>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_74b76243a26603c849d404c076121ba4.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_2e6547a6198c658e9f79e5d54a8ddd04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837f310>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ce671cadad7175b7862e689fca6607ea.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bec4892a-21cf-52b6-a03a-480553a21ce3
2026-04-27 08:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bec4892a-21cf-52b6-a03a-480553a21ce3, skipping ID generation
2026-04-27 08:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec4892a-21cf-52b6-a03a-480553a21ce3 with scrape type 1
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bec4892a-21cf-52b6-a03a-480553a21ce3 sending to next pipeline
2026-04-27 08:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bec4892a-21cf-52b6-a03a-480553a21ce3, identifier: JR98730
2026-04-27 08:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bec4892a-21cf-52b6-a03a-480553a21ce3 with identifier: JR98730
2026-04-27 08:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bec4892a-21cf-52b6-a03a-480553a21ce3 with identifier: JR98730
2026-04-27 08:03:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bec4892a-21cf-52b6-a03a-480553a21ce3 with identifier: JR98730 to the API
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ce671cadad7175b7862e689fca6607ea.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:03:54Z',
'fuel_type': 'diesel',
'id': 'bec4892a-21cf-52b6-a03a-480553a21ce3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR98730',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 263244,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_9fd3e4bcb0e593389a133b8dc33e3d9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ce671cadad7175b7862e689fca6607ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_74b76243a26603c849d404c076121ba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_3c081f2b4679411683086271ef318d13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_60b4f402748c057e864405b9dfe95236.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101158,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_76b92c74949bbef9eaf3bf6f1127ddec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_29260daec3e3686f995795faf3a77ea8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_ed20fe51189f7071d0d2f4395cbe9b5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_2a50199516ff7543d28b114fc4b6043c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bec4892a-21cf-52b6-a03a-480553a21ce3/bec4892a-21cf-52b6-a03a-480553a21ce3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/87/9987e5fc719de8b9c8f167a46c68525f/pa/JR98730_95b785a63595af416c286826e2885d82.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2012}
2026-04-27 08:03:24 [auto1.es] INFO: Saving data for JR98730: {'created_time': 1777277004.309315, 'last_price_update_time': 1777277004.309326, 'has_photos': True, 'auction_closing_time': 1777302234.0}
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_58d914c4263ac46fcd5f5ca291674709.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_4ba8ffd66865d4b3db2fb71e049036c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ65320> (referer: https://www.auto1.com/v1/car-details-view/UJ65320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ab110>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_12403359a11edb288ea77e6aabe1b4a8.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c850>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_2e6547a6198c658e9f79e5d54a8ddd04.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ78547> (referer: https://www.auto1.com/v1/car-details-view/WJ78547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876f850>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_58d914c4263ac46fcd5f5ca291674709.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896010>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_4ba8ffd66865d4b3db2fb71e049036c3.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item caf6650d-38e0-5129-bfe9-04c7cb4b02db
2026-04-27 08:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caf6650d-38e0-5129-bfe9-04c7cb4b02db, skipping ID generation
2026-04-27 08:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf6650d-38e0-5129-bfe9-04c7cb4b02db with scrape type 1
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item caf6650d-38e0-5129-bfe9-04c7cb4b02db sending to next pipeline
2026-04-27 08:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: caf6650d-38e0-5129-bfe9-04c7cb4b02db, identifier: PB96723
2026-04-27 08:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: caf6650d-38e0-5129-bfe9-04c7cb4b02db with identifier: PB96723
2026-04-27 08:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: caf6650d-38e0-5129-bfe9-04c7cb4b02db with identifier: PB96723
2026-04-27 08:03:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: caf6650d-38e0-5129-bfe9-04c7cb4b02db with identifier: PB96723 to the API
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_4ba8ffd66865d4b3db2fb71e049036c3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:36:14Z',
'fuel_type': 'diesel',
'id': 'caf6650d-38e0-5129-bfe9-04c7cb4b02db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB96723',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'MINI',
'odometer': 231573,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_4ba8ffd66865d4b3db2fb71e049036c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_2e6547a6198c658e9f79e5d54a8ddd04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_58d914c4263ac46fcd5f5ca291674709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_12403359a11edb288ea77e6aabe1b4a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_78dbc103fd49acbe867902d9544211f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_1bab52ffe9e19767e788ed1543875dab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_194c2589aa43e9be17b67e9af7ac3a9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_16638b99ee5933518046246f35f65519.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_b06f3d7d0669790f32d316e499bd42dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caf6650d-38e0-5129-bfe9-04c7cb4b02db/caf6650d-38e0-5129-bfe9-04c7cb4b02db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/b4/f6b4e3aee86a230759239dab022e4387/pa/PB96723_62010038e4d31dae0bbaf370de5a4255.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-07-28',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-04-27 08:03:24 [auto1.es] INFO: Saving data for PB96723: {'created_time': 1777277004.95044, 'last_price_update_time': 1777277004.95045, 'has_photos': True, 'auction_closing_time': 1777304174.0}
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_a345cc2d7e8dc50128da0af773a8a54b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_d67b6e1b8c788df99b5ece6043088e21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_7324fa14eef6e6f5f1ad10343afd48e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_f3116667f323cbb82e16374d5bc1487b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d336239-15a9-5d57-8386-c3301111d2a8 with identifier: UJ65320
2026-04-27 08:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d336239-15a9-5d57-8386-c3301111d2a8 with scrape type 1
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_1270c409c43380c43dd666b929446ee3.jpg not downloaded yet
2026-04-27 08:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3bd009-8940-5699-8839-228f1a92d3a1 with identifier: WJ78547
2026-04-27 08:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3bd009-8940-5699-8839-228f1a92d3a1 with scrape type 1
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_38c8bb97aaede6e8e250488c7b40b70d.jpg not downloaded yet
2026-04-27 08:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_b729026e7c8ac29f4bda38841ba31930.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_151e2aab33d86503af770c048be23b5d.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_13259a1806c6a2ce7179387c995294b6.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_a48d50a8de7ffe17bfecfb66a0f8b8e1.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_9aac115743eeca0ecdb3b041eb09332a.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_3c16e01a3dd8f9d540b114901e0db5bb.jpg not downloaded yet
2026-04-27 08:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_ae414aece3911a64cf4cc43bd3ac66f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04875abd0>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_a345cc2d7e8dc50128da0af773a8a54b.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a78890>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_d67b6e1b8c788df99b5ece6043088e21.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865ac50>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_7324fa14eef6e6f5f1ad10343afd48e2.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048717a90>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_f3116667f323cbb82e16374d5bc1487b.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:25 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2027 | hits on page: 40
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_f06726737221d2f7a15badb173d755da.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_22c3b74090dea685a67b379bfb8d1565.jpg not downloaded yet
2026-04-27 08:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_b963b89b9f2f79492feec329a0a23a52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:25 [auto1.es] INFO: Found listing with ID: HG31601
2026-04-27 08:03:25 [auto1.es] INFO: Scrape type for HG31601: 0
2026-04-27 08:03:25 [auto1.es] INFO: Found listing with ID: BR87747
2026-04-27 08:03:25 [auto1.es] INFO: Scrape type for BR87747: 0
2026-04-27 08:03:25 [auto1.es] INFO: Found listing with ID: BM51968
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_56eeaeb8a5c974c012c13df28cb6d78a.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_51de3f1279aa99a99033cb342177a175.jpg not downloaded yet
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d6290>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_ae414aece3911a64cf4cc43bd3ac66f2.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6
2026-04-27 08:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d1471a4-d653-59df-a1ef-ef46e6554cd6, skipping ID generation
2026-04-27 08:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6 with scrape type 1
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d1471a4-d653-59df-a1ef-ef46e6554cd6 sending to next pipeline
2026-04-27 08:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d1471a4-d653-59df-a1ef-ef46e6554cd6, identifier: NP78962
2026-04-27 08:03:25 [auto1.es] INFO: Found listing with ID: VT79907
2026-04-27 08:03:25 [auto1.es] INFO: Scrape type for VT79907: 0
2026-04-27 08:03:25 [auto1.es] INFO: Found listing with ID: BE85179
2026-04-27 08:03:25 [auto1.es] INFO: Scrape type for BE85179: 1
2026-04-27 08:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d1471a4-d653-59df-a1ef-ef46e6554cd6 with identifier: NP78962
2026-04-27 08:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d1471a4-d653-59df-a1ef-ef46e6554cd6 with identifier: NP78962
2026-04-27 08:03:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d1471a4-d653-59df-a1ef-ef46e6554cd6 with identifier: NP78962 to the API
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_ae414aece3911a64cf4cc43bd3ac66f2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'city': 'Collado Villalba',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:06:43Z',
'fuel_type': 'diesel',
'id': '5d1471a4-d653-59df-a1ef-ef46e6554cd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.6424,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP78962',
'listing': 'auction',
'location': 'ES, Collado Villalba, Madrid',
'location_confidence': 'geocoded',
'longitude': -3.9981,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 193187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_ae414aece3911a64cf4cc43bd3ac66f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_a345cc2d7e8dc50128da0af773a8a54b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_f3116667f323cbb82e16374d5bc1487b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_d67b6e1b8c788df99b5ece6043088e21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_7324fa14eef6e6f5f1ad10343afd48e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_656691ba91e0d99f266cda557d56d2dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_adee51af735101304765a8f34853e444.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_0b4d495c78551b18f38bb5ad9629d312.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c7aa860abe7993f29e5ba5d304ca8fc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5d1471a4-d653-59df-a1ef-ef46e6554cd6/5d1471a4-d653-59df-a1ef-ef46e6554cd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d28b0303f4705365f062c5c6b95ad91/pa/NP78962_c85bac9dca53dc695fc6c610766fc9e2.jpg',
'Width': 800}],
'postal_code': '28400',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2017-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2017}
2026-04-27 08:03:25 [auto1.es] INFO: Saving data for NP78962: {'created_time': 1777277005.936877, 'last_price_update_time': 1777277005.936887, 'has_photos': True, 'auction_closing_time': 1777302403.0}
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_e46649e55915615355575f093df5e754.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_7fa0225fef662a1f97360d4b3e42a2ba.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_a48d50a8de7ffe17bfecfb66a0f8b8e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [auto1.es] INFO: Found listing with ID: VW25923
2026-04-27 08:03:26 [auto1.es] INFO: Scrape type for VW25923: 1
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482bab50>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_b963b89b9f2f79492feec329a0a23a52.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f5c1371-dc24-55a4-86f6-427ee840293c
2026-04-27 08:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f5c1371-dc24-55a4-86f6-427ee840293c, skipping ID generation
2026-04-27 08:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5c1371-dc24-55a4-86f6-427ee840293c with scrape type 1
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f5c1371-dc24-55a4-86f6-427ee840293c sending to next pipeline
2026-04-27 08:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f5c1371-dc24-55a4-86f6-427ee840293c, identifier: RJ00848
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_44854c343b3651bc00e7369b650b06b1.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0e4511f917bd7cf5b53e4c19f9e1b957.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ06023> (referer: https://www.auto1.com/v1/car-details-view/VZ06023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f5c1371-dc24-55a4-86f6-427ee840293c with identifier: RJ00848
2026-04-27 08:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f5c1371-dc24-55a4-86f6-427ee840293c with identifier: RJ00848
2026-04-27 08:03:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f5c1371-dc24-55a4-86f6-427ee840293c with identifier: RJ00848 to the API
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_b963b89b9f2f79492feec329a0a23a52.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Esquivias',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:48:09Z',
'fuel_type': 'diesel',
'id': '3f5c1371-dc24-55a4-86f6-427ee840293c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ00848',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Kia',
'model': 'Sportage',
'odometer': 133446,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_b963b89b9f2f79492feec329a0a23a52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_5e09ff3099be79df66c34e06db95f675.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_fec94f925eecfe392c90312995e2e943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_7e51e94b629e8c2bf5a4deb5173e57eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_e57ecc7b2c054dd2a06968d3bccbe954.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_30f6bd111add072105eb2a3eb3d56224.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_f3827911a40435d80b0bc97bca806911.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_11cc8d1e2424dab1a4f38163f66eddca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_2b01bb03403dbc386054d10bf8a0a26a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f5c1371-dc24-55a4-86f6-427ee840293c/3f5c1371-dc24-55a4-86f6-427ee840293c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/3b/403bc8baa11e5716be124cc8de290c4e/pa/RJ00848_97ac97e4a6227672b4b4a9e7b21d988c.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2016-06-16',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Drive 4x2',
'transmission': 'manual',
'trim': 'Drive 4x2',
'year': 2016}
2026-04-27 08:03:26 [auto1.es] INFO: Saving data for RJ00848: {'created_time': 1777277006.641944, 'last_price_update_time': 1777277006.641955, 'has_photos': True, 'auction_closing_time': 1777304889.0}
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_22c3b74090dea685a67b379bfb8d1565.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [auto1.es] INFO: Found listing with ID: DN96024
2026-04-27 08:03:26 [auto1.es] INFO: Scrape type for DN96024: 1
2026-04-27 08:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_a0ea72546e4fb7d836f7f586b5c481e4.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_eb928d7938d81e898d9c66f3d588c100.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM66280/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:26 [auto1.es] INFO: Found listing with ID: VG52049
2026-04-27 08:03:26 [auto1.es] INFO: Scrape type for VG52049: 1
2026-04-27 08:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_facac25671e5e51c1b58256d5f757c3c.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0c9991205c614ba8fb2adbb5deb20188.jpg not downloaded yet
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048165190>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_a48d50a8de7ffe17bfecfb66a0f8b8e1.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059de279-ee4c-59de-b645-32a17cbb958e with identifier: VZ06023
2026-04-27 08:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059de279-ee4c-59de-b645-32a17cbb958e with scrape type 1
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_c8a47b089347014cb6e82fd025e86c15.jpg not downloaded yet
2026-04-27 08:03:26 [auto1.es] INFO: Found listing with ID: RK66669
2026-04-27 08:03:26 [auto1.es] INFO: Scrape type for RK66669: 1
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_b08c47f3d7de49b2456bc0b12eab4f3c.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_7fa0225fef662a1f97360d4b3e42a2ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [auto1.es] INFO: Found listing with ID: GC65194
2026-04-27 08:03:26 [auto1.es] INFO: Scrape type for GC65194: 1
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880d110>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_22c3b74090dea685a67b379bfb8d1565.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_2851f221edfb83f4ea6a567aa06ddddb.jpg not downloaded yet
2026-04-27 08:03:26 [auto1.es] INFO: Found listing with ID: JA70447
2026-04-27 08:03:26 [auto1.es] INFO: Scrape type for JA70447: 2
2026-04-27 08:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 604001dd-da26-5dbb-8d55-7ac3e2e6a980 with identifier: JA70447
2026-04-27 08:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 604001dd-da26-5dbb-8d55-7ac3e2e6a980 with scrape type 2
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 604001dd-da26-5dbb-8d55-7ac3e2e6a980 with scrape type 2
2026-04-27 08:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 604001dd-da26-5dbb-8d55-7ac3e2e6a980, identifier: JA70447
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_eb928d7938d81e898d9c66f3d588c100.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 604001dd-da26-5dbb-8d55-7ac3e2e6a980 with identifier: JA70447
2026-04-27 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 604001dd-da26-5dbb-8d55-7ac3e2e6a980 with identifier: JA70447
2026-04-27 08:03:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 604001dd-da26-5dbb-8d55-7ac3e2e6a980 with identifier: JA70447 to the API
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:29:38Z',
'fuel_type': 'gas',
'id': '604001dd-da26-5dbb-8d55-7ac3e2e6a980',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA70447',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 111479,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-05',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TGI FR Plus',
'transmission': 'manual',
'trim': 'FR Plus',
'year': 2019}
2026-04-27 08:03:27 [auto1.es] INFO: Saving data for JA70447: {'auction_closing_time': 1777303778.0, 'created_time': 1777018849.069504, 'has_photos': True, 'last_price_update_time': 1777277007.344773}
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_856139eea38d53bd267dd4dfe678fad7.jpg not downloaded yet
2026-04-27 08:03:27 [auto1.es] INFO: Found listing with ID: FY41505
2026-04-27 08:03:27 [auto1.es] INFO: Scrape type for FY41505: 2
2026-04-27 08:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3dbb5cb-4f20-5053-9a33-5a132c06893c with identifier: FY41505
2026-04-27 08:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3dbb5cb-4f20-5053-9a33-5a132c06893c with scrape type 2
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3dbb5cb-4f20-5053-9a33-5a132c06893c with scrape type 2
2026-04-27 08:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c3dbb5cb-4f20-5053-9a33-5a132c06893c, identifier: FY41505
2026-04-27 08:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c3dbb5cb-4f20-5053-9a33-5a132c06893c with identifier: FY41505
2026-04-27 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c3dbb5cb-4f20-5053-9a33-5a132c06893c with identifier: FY41505
2026-04-27 08:03:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c3dbb5cb-4f20-5053-9a33-5a132c06893c with identifier: FY41505 to the API
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:01:14Z',
'fuel_type': 'diesel',
'id': 'c3dbb5cb-4f20-5053-9a33-5a132c06893c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY41505',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 181095,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-03-07',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
'transmission': 'automatic',
'trim': 'AMG Sport',
'year': 2017}
2026-04-27 08:03:27 [auto1.es] INFO: Saving data for FY41505: {'auction_closing_time': 1777302074.0, 'created_time': 1777019159.378234, 'has_photos': True, 'last_price_update_time': 1777277007.88122}
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_8643a93f4a32550c3c7fb569746baeaa.jpg not downloaded yet
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM51968> (referer: https://www.auto1.com/v1/car-details-view/BM51968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE59735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869c6d0>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_7fa0225fef662a1f97360d4b3e42a2ba.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:03:27 [auto1.es] INFO: Found listing with ID: FX57212
2026-04-27 08:03:27 [auto1.es] INFO: Scrape type for FX57212: 2
2026-04-27 08:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fd26a7-a463-5073-ab9d-657df02bf745 with identifier: FX57212
2026-04-27 08:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fd26a7-a463-5073-ab9d-657df02bf745 with scrape type 2
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40fd26a7-a463-5073-ab9d-657df02bf745 with scrape type 2
2026-04-27 08:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40fd26a7-a463-5073-ab9d-657df02bf745, identifier: FX57212
2026-04-27 08:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_2851f221edfb83f4ea6a567aa06ddddb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40fd26a7-a463-5073-ab9d-657df02bf745 with identifier: FX57212
2026-04-27 08:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40fd26a7-a463-5073-ab9d-657df02bf745 with identifier: FX57212
2026-04-27 08:03:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40fd26a7-a463-5073-ab9d-657df02bf745 with identifier: FX57212 to the API
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:40:30Z',
'fuel_type': 'diesel',
'id': '40fd26a7-a463-5073-ab9d-657df02bf745',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX57212',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ssangyong',
'model': 'Tivoli',
'odometer': 41974,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'Ssangyong Tivoli 1.6 Turbodiesel Premium 4x2',
'transmission': 'manual',
'trim': 'Premium 4x2',
'year': 2018}
2026-04-27 08:03:28 [auto1.es] INFO: Saving data for FX57212: {'auction_closing_time': 1777304430.0, 'created_time': 1777019393.29979, 'has_photos': True, 'last_price_update_time': 1777277008.44466}
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_4192bd90fecaf02777a3cd4dba91201e.jpg not downloaded yet
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852ef50>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_eb928d7938d81e898d9c66f3d588c100.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: XY57124
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for XY57124: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_6994cc90a3d8727691a225e6ed2408d3.jpg not downloaded yet
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: EX06881
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for EX06881: 1
2026-04-27 08:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24303877-2e60-58bb-8a6f-1022dbd0012c with identifier: BM51968
2026-04-27 08:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24303877-2e60-58bb-8a6f-1022dbd0012c with scrape type 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_577beb3072f9e67675cc7b4e16725fcd.jpg not downloaded yet
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852c210>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_2851f221edfb83f4ea6a567aa06ddddb.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_19345534dc8e052c0bbb392ab97d53bd.jpg not downloaded yet
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: UN76944
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for UN76944: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_a4cfda678768ac2a4cc63958a4923568.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_bc085499d0b29e05ed4fd16b6ec37e05.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_856139eea38d53bd267dd4dfe678fad7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: TU27127
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for TU27127: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_bc57228bef0c3278a3e1972342fa04c1.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_8643a93f4a32550c3c7fb569746baeaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_68630608ea32c7e0ea4c184cf39d0b94.jpg not downloaded yet
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: HP09139
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for HP09139: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_92e3c2be53e627d39af7a4ce28656aee.jpg not downloaded yet
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: TY46229
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for TY46229: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_c987e8cddeadebbb90cb535d471d8a14.jpg not downloaded yet
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: SF85973
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for SF85973: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_b4cd6d08c23422c9ef1dff82a064ed98.jpg not downloaded yet
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: KD38096
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for KD38096: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_eaff32489418e7e00fa8c6e12fd2cd6c.jpg not downloaded yet
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2690>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_856139eea38d53bd267dd4dfe678fad7.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:28 [auto1.es] INFO: Found listing with ID: XF27749
2026-04-27 08:03:28 [auto1.es] INFO: Scrape type for XF27749: 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_5e5e5cf2da12d81e10bfe5fd4bc158ca.jpg not downloaded yet
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483df850>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_8643a93f4a32550c3c7fb569746baeaa.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:29 [auto1.es] INFO: Found listing with ID: TZ79556
2026-04-27 08:03:29 [auto1.es] INFO: Scrape type for TZ79556: 2
2026-04-27 08:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5b31247-0929-5b8c-bbb6-4d4e20444d89 with identifier: TZ79556
2026-04-27 08:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b31247-0929-5b8c-bbb6-4d4e20444d89 with scrape type 2
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5b31247-0929-5b8c-bbb6-4d4e20444d89 with scrape type 2
2026-04-27 08:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5b31247-0929-5b8c-bbb6-4d4e20444d89, identifier: TZ79556
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_de0130f966f02590a4ecd96f431bdc96.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5b31247-0929-5b8c-bbb6-4d4e20444d89 with identifier: TZ79556
2026-04-27 08:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5b31247-0929-5b8c-bbb6-4d4e20444d89 with identifier: TZ79556
2026-04-27 08:03:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5b31247-0929-5b8c-bbb6-4d4e20444d89 with identifier: TZ79556 to the API
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-04-27T15:56:35Z',
'fuel_type': 'diesel',
'id': 'f5b31247-0929-5b8c-bbb6-4d4e20444d89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ79556',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 150580,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-07-21',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI 4Motion',
'transmission': 'manual',
'trim': '4Motion',
'year': 2021}
2026-04-27 08:03:29 [auto1.es] INFO: Saving data for TZ79556: {'auction_closing_time': 1777305395.0, 'created_time': 1776941075.927567, 'has_photos': True, 'last_price_update_time': 1777277009.499263}
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_a4cfda678768ac2a4cc63958a4923568.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_bc085499d0b29e05ed4fd16b6ec37e05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [auto1.es] INFO: Found listing with ID: PK51970
2026-04-27 08:03:29 [auto1.es] INFO: Scrape type for PK51970: 2
2026-04-27 08:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b757b5-293b-5358-85b0-4b358ad04b20 with identifier: PK51970
2026-04-27 08:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b757b5-293b-5358-85b0-4b358ad04b20 with scrape type 2
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5b757b5-293b-5358-85b0-4b358ad04b20 with scrape type 2
2026-04-27 08:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5b757b5-293b-5358-85b0-4b358ad04b20, identifier: PK51970
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_68ac694b5e7f22b73d4bdea2c0525962.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5b757b5-293b-5358-85b0-4b358ad04b20 with identifier: PK51970
2026-04-27 08:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5b757b5-293b-5358-85b0-4b358ad04b20 with identifier: PK51970
2026-04-27 08:03:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5b757b5-293b-5358-85b0-4b358ad04b20 with identifier: PK51970 to the API
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:46:53Z',
'fuel_type': 'diesel',
'id': 'e5b757b5-293b-5358-85b0-4b358ad04b20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK51970',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Hilux',
'odometer': 327358,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-12',
'seller_name': None,
'title': 'Toyota Hilux 2.4 D-4D Double Cab GX 4x4',
'transmission': 'manual',
'trim': 'Double Cab GX 4x4',
'year': 2019}
2026-04-27 08:03:30 [auto1.es] INFO: Saving data for PK51970: {'auction_closing_time': 1777304813.0, 'created_time': 1777019441.173661, 'has_photos': True, 'last_price_update_time': 1777277010.092299}
2026-04-27 08:03:30 [auto1.es] INFO: Found listing with ID: WD78496
2026-04-27 08:03:30 [auto1.es] INFO: Scrape type for WD78496: 2
2026-04-27 08:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b42ba0e-1401-5d6b-855e-95247ec4c1dd with identifier: WD78496
2026-04-27 08:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b42ba0e-1401-5d6b-855e-95247ec4c1dd with scrape type 2
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b42ba0e-1401-5d6b-855e-95247ec4c1dd with scrape type 2
2026-04-27 08:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7b42ba0e-1401-5d6b-855e-95247ec4c1dd, identifier: WD78496
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ02934> (referer: https://www.auto1.com/v1/car-details-view/ZJ02934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7b42ba0e-1401-5d6b-855e-95247ec4c1dd with identifier: WD78496
2026-04-27 08:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7b42ba0e-1401-5d6b-855e-95247ec4c1dd with identifier: WD78496
2026-04-27 08:03:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7b42ba0e-1401-5d6b-855e-95247ec4c1dd with identifier: WD78496 to the API
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:23:33Z',
'fuel_type': 'diesel',
'id': '7b42ba0e-1401-5d6b-855e-95247ec4c1dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD78496',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 139351,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-08-24',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Live M',
'transmission': 'manual',
'trim': 'Live M',
'year': 2021}
2026-04-27 08:03:30 [auto1.es] INFO: Saving data for WD78496: {'auction_closing_time': 1777303413.0, 'created_time': 1777018046.449719, 'has_photos': True, 'last_price_update_time': 1777277010.669244}
2026-04-27 08:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486771d0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_a4cfda678768ac2a4cc63958a4923568.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862ba90>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_bc085499d0b29e05ed4fd16b6ec37e05.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:30 [auto1.es] INFO: Found listing with ID: YM75877
2026-04-27 08:03:30 [auto1.es] INFO: Scrape type for YM75877: 1
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW64500> (referer: https://www.auto1.com/v1/car-details-view/TW64500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_5e5e5cf2da12d81e10bfe5fd4bc158ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_de0130f966f02590a4ecd96f431bdc96.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:30 [auto1.es] INFO: Found listing with ID: VV68340
2026-04-27 08:03:30 [auto1.es] INFO: Scrape type for VV68340: 2
2026-04-27 08:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536911fe-7183-5c37-b5d8-8ca4f1bfe38f with identifier: VV68340
2026-04-27 08:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536911fe-7183-5c37-b5d8-8ca4f1bfe38f with scrape type 2
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 536911fe-7183-5c37-b5d8-8ca4f1bfe38f with scrape type 2
2026-04-27 08:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 536911fe-7183-5c37-b5d8-8ca4f1bfe38f, identifier: VV68340
2026-04-27 08:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4f0a8b-e939-5042-bee2-de52a8c25c65 with identifier: ZJ02934
2026-04-27 08:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65 with scrape type 1
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_f055e53ccfc4f91bb1c1a3c6e65981e2.jpg not downloaded yet
2026-04-27 08:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 536911fe-7183-5c37-b5d8-8ca4f1bfe38f with identifier: VV68340
2026-04-27 08:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 536911fe-7183-5c37-b5d8-8ca4f1bfe38f with identifier: VV68340
2026-04-27 08:03:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 536911fe-7183-5c37-b5d8-8ca4f1bfe38f with identifier: VV68340 to the API
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:46:26Z',
'fuel_type': 'diesel',
'id': '536911fe-7183-5c37-b5d8-8ca4f1bfe38f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV68340',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 166853,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-03-23',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Ambiente',
'transmission': 'manual',
'trim': '320 L1 Ambiente',
'year': 2021}
2026-04-27 08:03:31 [auto1.es] INFO: Saving data for VV68340: {'auction_closing_time': 1777304786.0, 'created_time': 1777018875.247647, 'has_photos': True, 'last_price_update_time': 1777277011.61324}
2026-04-27 08:03:31 [auto1.es] INFO: Found listing with ID: NU36495
2026-04-27 08:03:31 [auto1.es] INFO: Scrape type for NU36495: 1
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_de320531476e29005370e2a68622dd39.jpg not downloaded yet
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_68ac694b5e7f22b73d4bdea2c0525962.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_eaff32489418e7e00fa8c6e12fd2cd6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [auto1.es] INFO: Found listing with ID: VE02241
2026-04-27 08:03:31 [auto1.es] INFO: Scrape type for VE02241: 1
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_b0a6c68f1cf04ea8ea1041ef5d927f35.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2a8100-e407-57b9-9cce-fba95f7b66fe with identifier: TW64500
2026-04-27 08:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe with scrape type 1
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_74d8743501678bb357053e815ce6d406.jpg not downloaded yet
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f86d0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_5e5e5cf2da12d81e10bfe5fd4bc158ca.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a413d0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_de0130f966f02590a4ecd96f431bdc96.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:31 [auto1.es] INFO: Found listing with ID: BB31898
2026-04-27 08:03:31 [auto1.es] INFO: Scrape type for BB31898: 2
2026-04-27 08:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e with identifier: BB31898
2026-04-27 08:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e with scrape type 2
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e with scrape type 2
2026-04-27 08:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e, identifier: BB31898
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_e2793f5c8c4075c060bc1e65c6a3789d.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_0a584da8c62ca9f7e820b8b760bd963a.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e with identifier: BB31898
2026-04-27 08:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e with identifier: BB31898
2026-04-27 08:03:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 81c30eac-3ef4-5664-ae45-b4dcb6e25e3e with identifier: BB31898 to the API
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:32:27Z',
'fuel_type': 'diesel',
'id': '81c30eac-3ef4-5664-ae45-b4dcb6e25e3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB31898',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Kangoo',
'odometer': 133298,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-28',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Furgón Professional',
'transmission': 'manual',
'trim': 'Furgón Professional',
'year': 2016}
2026-04-27 08:03:32 [auto1.es] INFO: Saving data for BB31898: {'auction_closing_time': 1777303947.0, 'created_time': 1776940847.247876, 'has_photos': True, 'last_price_update_time': 1777277012.244041}
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853590>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_68ac694b5e7f22b73d4bdea2c0525962.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048169850>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_eaff32489418e7e00fa8c6e12fd2cd6c.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:32 [auto1.es] INFO: Found listing with ID: UG88710
2026-04-27 08:03:32 [auto1.es] INFO: Scrape type for UG88710: 2
2026-04-27 08:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d063bd4-d7b8-54c5-9700-4d334bc021da with identifier: UG88710
2026-04-27 08:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d063bd4-d7b8-54c5-9700-4d334bc021da with scrape type 2
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d063bd4-d7b8-54c5-9700-4d334bc021da with scrape type 2
2026-04-27 08:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d063bd4-d7b8-54c5-9700-4d334bc021da, identifier: UG88710
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_84303abac4ad8d143e105e00f96ea907.jpg not downloaded yet
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bba25f27d2b30f8bdba8a46e43559357.jpg not downloaded yet
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_de320531476e29005370e2a68622dd39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d063bd4-d7b8-54c5-9700-4d334bc021da with identifier: UG88710
2026-04-27 08:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d063bd4-d7b8-54c5-9700-4d334bc021da with identifier: UG88710
2026-04-27 08:03:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d063bd4-d7b8-54c5-9700-4d334bc021da with identifier: UG88710 to the API
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:50:45Z',
'fuel_type': 'petrol',
'id': '0d063bd4-d7b8-54c5-9700-4d334bc021da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG88710',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 258379,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-02-05',
'seller_name': None,
'title': 'BMW X1 sDrive 18i',
'transmission': 'manual',
'trim': '',
'year': 2022}
2026-04-27 08:03:32 [auto1.es] INFO: Saving data for UG88710: {'auction_closing_time': 1777305045.0, 'created_time': 1777019424.090042, 'has_photos': True, 'last_price_update_time': 1777277012.810011}
2026-04-27 08:03:32 [auto1.es] INFO: Found listing with ID: RR74907
2026-04-27 08:03:32 [auto1.es] INFO: Scrape type for RR74907: 2
2026-04-27 08:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f54c5abf-b4f8-5ec5-b51e-b3952a66394d with identifier: RR74907
2026-04-27 08:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f54c5abf-b4f8-5ec5-b51e-b3952a66394d with scrape type 2
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f54c5abf-b4f8-5ec5-b51e-b3952a66394d with scrape type 2
2026-04-27 08:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f54c5abf-b4f8-5ec5-b51e-b3952a66394d, identifier: RR74907
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_6b2093a5ca807981f3383d3489066108.jpg not downloaded yet
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_cd398a3715b385a290e949b424f51d1b.jpg not downloaded yet
2026-04-27 08:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f54c5abf-b4f8-5ec5-b51e-b3952a66394d with identifier: RR74907
2026-04-27 08:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f54c5abf-b4f8-5ec5-b51e-b3952a66394d with identifier: RR74907
2026-04-27 08:03:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f54c5abf-b4f8-5ec5-b51e-b3952a66394d with identifier: RR74907 to the API
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:17:13Z',
'fuel_type': 'petrol',
'id': 'f54c5abf-b4f8-5ec5-b51e-b3952a66394d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR74907',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': '500X',
'odometer': 68466,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-05-29',
'seller_name': None,
'title': 'Fiat 500X 1.6 Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2017}
2026-04-27 08:03:33 [auto1.es] INFO: Saving data for RR74907: {'auction_closing_time': 1777303033.0, 'created_time': 1776940907.029918, 'has_photos': True, 'last_price_update_time': 1777277013.277944}
2026-04-27 08:03:33 [auto1.es] INFO: Found listing with ID: NH85653
2026-04-27 08:03:33 [auto1.es] INFO: Scrape type for NH85653: 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_9d345cb8a0347ba36ba91c40e4ce3d73.jpg not downloaded yet
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_022c59848bcd5244a891bf86a789d555.jpg not downloaded yet
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA57631> (referer: https://www.auto1.com/v1/car-details-view/TA57631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN47559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT96538> (referer: https://www.auto1.com/v1/car-details-view/JT96538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048418810>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_de320531476e29005370e2a68622dd39.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:33 [auto1.es] INFO: Found listing with ID: NS51143
2026-04-27 08:03:33 [auto1.es] INFO: Scrape type for NS51143: 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_c8b860ebc391d19d3497cd8e68b2a111.jpg not downloaded yet
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_1d75f71f5d6acccc298f84d5d1d9f429.jpg not downloaded yet
2026-04-27 08:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:33 [auto1.es] INFO: Found listing with ID: CZ91046
2026-04-27 08:03:33 [auto1.es] INFO: Scrape type for CZ91046: 2
2026-04-27 08:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a4d43be-6281-53fe-8f25-4b44fd4471b1 with identifier: CZ91046
2026-04-27 08:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a4d43be-6281-53fe-8f25-4b44fd4471b1 with scrape type 2
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a4d43be-6281-53fe-8f25-4b44fd4471b1 with scrape type 2
2026-04-27 08:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a4d43be-6281-53fe-8f25-4b44fd4471b1, identifier: CZ91046
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_7564bfde570e427bac302576e535b802.jpg not downloaded yet
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_645fb3e778577b8d33e0d12e069f0ac2.jpg not downloaded yet
2026-04-27 08:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a4d43be-6281-53fe-8f25-4b44fd4471b1 with identifier: CZ91046
2026-04-27 08:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a4d43be-6281-53fe-8f25-4b44fd4471b1 with identifier: CZ91046
2026-04-27 08:03:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a4d43be-6281-53fe-8f25-4b44fd4471b1 with identifier: CZ91046 to the API
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:42:36Z',
'fuel_type': 'diesel',
'id': '5a4d43be-6281-53fe-8f25-4b44fd4471b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ91046',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 120249,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-04-06',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Contrlol M',
'transmission': 'manual',
'trim': 'Contrlol M',
'year': 2021}
2026-04-27 08:03:33 [auto1.es] INFO: Saving data for CZ91046: {'auction_closing_time': 1777304556.0, 'created_time': 1777021884.327087, 'has_photos': True, 'last_price_update_time': 1777277013.89483}
2026-04-27 08:03:34 [scrapy.extensions.logstats] INFO: Crawled 396 pages (at 32 pages/min), scraped 475 items (at 23 items/min)
2026-04-27 08:03:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:03:34 [auto1.es] INFO: Found listing with ID: MT32146
2026-04-27 08:03:34 [auto1.es] INFO: Scrape type for MT32146: 2
2026-04-27 08:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31 with identifier: MT32146
2026-04-27 08:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31 with scrape type 2
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31 with scrape type 2
2026-04-27 08:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31, identifier: MT32146
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_a4d5ea83b6ba610fba40622c0e901f6b.jpg not downloaded yet
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_a214228d3a7b97d4edfd2815549cfb99.jpg not downloaded yet
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_6b2093a5ca807981f3383d3489066108.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_cd398a3715b385a290e949b424f51d1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bba25f27d2b30f8bdba8a46e43559357.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31 with identifier: MT32146
2026-04-27 08:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31 with identifier: MT32146
2026-04-27 08:03:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 64d4ba0d-376d-51eb-83b2-ffc15b3cfb31 with identifier: MT32146 to the API
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-04-27T15:28:10Z',
'fuel_type': 'diesel',
'id': '64d4ba0d-376d-51eb-83b2-ffc15b3cfb31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT32146',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 434283,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-29',
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2011}
2026-04-27 08:03:34 [auto1.es] INFO: Saving data for MT32146: {'auction_closing_time': 1777303690.0, 'created_time': 1777018017.001424, 'has_photos': True, 'last_price_update_time': 1777277014.434255}
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_022c59848bcd5244a891bf86a789d555.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [auto1.es] INFO: Found listing with ID: UP52460
2026-04-27 08:03:34 [auto1.es] INFO: Scrape type for UP52460: 2
2026-04-27 08:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6174d4-eea9-5f91-9d52-3226654b0145 with identifier: UP52460
2026-04-27 08:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6174d4-eea9-5f91-9d52-3226654b0145 with scrape type 2
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf6174d4-eea9-5f91-9d52-3226654b0145 with scrape type 2
2026-04-27 08:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf6174d4-eea9-5f91-9d52-3226654b0145, identifier: UP52460
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_de26e2ee2c9698348321a9039a8233b5.jpg not downloaded yet
2026-04-27 08:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 with identifier: TA57631
2026-04-27 08:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 with scrape type 1
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_1e9ea6220c12e96504efac65a303a3f5.jpg not downloaded yet
2026-04-27 08:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3adf0175-8c87-55c5-811d-00abbbdeca39 with identifier: JT96538
2026-04-27 08:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adf0175-8c87-55c5-811d-00abbbdeca39 with scrape type 1
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_191d2d1c030367ca340cb5b3b2f4fe50.jpg not downloaded yet
2026-04-27 08:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf6174d4-eea9-5f91-9d52-3226654b0145 with identifier: UP52460
2026-04-27 08:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf6174d4-eea9-5f91-9d52-3226654b0145 with identifier: UP52460
2026-04-27 08:03:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf6174d4-eea9-5f91-9d52-3226654b0145 with identifier: UP52460 to the API
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:44:21Z',
'fuel_type': 'petrol',
'id': 'cf6174d4-eea9-5f91-9d52-3226654b0145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP52460',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 193347,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2003-06-02',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 4WD',
'transmission': 'manual',
'trim': '4WD',
'year': 2003}
2026-04-27 08:03:34 [auto1.es] INFO: Saving data for UP52460: {'auction_closing_time': 1777304661.0, 'created_time': 1777020302.662376, 'has_photos': True, 'last_price_update_time': 1777277014.942325}
2026-04-27 08:03:34 [auto1.es] INFO: Found listing with ID: EC08619
2026-04-27 08:03:34 [auto1.es] INFO: Scrape type for EC08619: 1
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bebde146156fc922f12a5f4e89d80f12.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_b83c074ce0b61d1fd682ff8e85c5861d.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_44d1e6fb465a7e867630b6e49da68165.jpg not downloaded yet
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ01434> (referer: https://www.auto1.com/v1/car-details-view/RZ01434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS01724/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP80713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846da90>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_6b2093a5ca807981f3383d3489066108.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048541090>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_cd398a3715b385a290e949b424f51d1b.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04815b350>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bba25f27d2b30f8bdba8a46e43559357.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048678150>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_022c59848bcd5244a891bf86a789d555.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:35 [auto1.es] INFO: Found listing with ID: WT19992
2026-04-27 08:03:35 [auto1.es] INFO: Scrape type for WT19992: 2
2026-04-27 08:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0fdb45-c930-53c4-a667-856f5efc2b47 with identifier: WT19992
2026-04-27 08:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0fdb45-c930-53c4-a667-856f5efc2b47 with scrape type 2
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0fdb45-c930-53c4-a667-856f5efc2b47 with scrape type 2
2026-04-27 08:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f0fdb45-c930-53c4-a667-856f5efc2b47, identifier: WT19992
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d2b7f7ce9e9d2c09e99ff86bd86db966.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_e33ea9b00dd0a68b19721770ea22d10a.jpg not downloaded yet
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_a4d5ea83b6ba610fba40622c0e901f6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_a214228d3a7b97d4edfd2815549cfb99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f0fdb45-c930-53c4-a667-856f5efc2b47 with identifier: WT19992
2026-04-27 08:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f0fdb45-c930-53c4-a667-856f5efc2b47 with identifier: WT19992
2026-04-27 08:03:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f0fdb45-c930-53c4-a667-856f5efc2b47 with identifier: WT19992 to the API
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:02:42Z',
'fuel_type': 'diesel',
'id': '7f0fdb45-c930-53c4-a667-856f5efc2b47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT19992',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X3',
'odometer': 139007,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-07-29',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 08:03:35 [auto1.es] INFO: Saving data for WT19992: {'auction_closing_time': 1777302162.0, 'created_time': 1776940956.51968, 'has_photos': True, 'last_price_update_time': 1777277015.652379}
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_645fb3e778577b8d33e0d12e069f0ac2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [auto1.es] INFO: Found listing with ID: YH52314
2026-04-27 08:03:35 [auto1.es] INFO: Scrape type for YH52314: 2
2026-04-27 08:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 919778c1-08b0-5e28-a6be-98baa977df37 with identifier: YH52314
2026-04-27 08:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919778c1-08b0-5e28-a6be-98baa977df37 with scrape type 2
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 919778c1-08b0-5e28-a6be-98baa977df37 with scrape type 2
2026-04-27 08:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 919778c1-08b0-5e28-a6be-98baa977df37, identifier: YH52314
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_0d417a279dd58d8afbe5f70712bd5fa9.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_f4e1699083332ea43f064c4a534610e6.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180f47f3-0e77-5f0d-820d-371c2d5ef74a with identifier: RZ01434
2026-04-27 08:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a with scrape type 1
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_b2faa7f100350c6d293dd0e8adf54c89.jpg not downloaded yet
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_7564bfde570e427bac302576e535b802.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 919778c1-08b0-5e28-a6be-98baa977df37 with identifier: YH52314
2026-04-27 08:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 919778c1-08b0-5e28-a6be-98baa977df37 with identifier: YH52314
2026-04-27 08:03:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 919778c1-08b0-5e28-a6be-98baa977df37 with identifier: YH52314 to the API
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-04-27T15:03:13Z',
'fuel_type': 'diesel',
'id': '919778c1-08b0-5e28-a6be-98baa977df37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH52314',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 586703,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-04-15',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-04-27 08:03:36 [auto1.es] INFO: Saving data for YH52314: {'auction_closing_time': 1777302193.0, 'created_time': 1777018332.125559, 'has_photos': True, 'last_price_update_time': 1777277016.384019}
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_191d2d1c030367ca340cb5b3b2f4fe50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_1e9ea6220c12e96504efac65a303a3f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_732c6db1c2757370e3a42d17ae80a0b8.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_d1ec255ba38fff07013a7edee7c8275e.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ad45aa41b1b595b77b77ee16251b68bc.jpg not downloaded yet
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481daed0>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_a4d5ea83b6ba610fba40622c0e901f6b.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048827510>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_a214228d3a7b97d4edfd2815549cfb99.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_b83c074ce0b61d1fd682ff8e85c5861d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.210(s), this was the 1st time calling it.
2026-04-27 08:03:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.2449129557117224 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_44d1e6fb465a7e867630b6e49da68165.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_59fd2294e181c2cd5d783f2a28935dab.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_90e42d09d62d9b99ea551cbe3f7bd05a.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_a4024a5f1ae470baebcf7bfe86a4d210.jpg not downloaded yet
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e2a50>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_645fb3e778577b8d33e0d12e069f0ac2.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d0c10>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_7564bfde570e427bac302576e535b802.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_e33ea9b00dd0a68b19721770ea22d10a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_27f491e7c2cb1848ebf9a53cf500f350.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_aa147beca8d16e611ec823ce2c37bd28.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_cfc066f67d2cd7db510039abceb9e1ea.jpg not downloaded yet
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e1c90>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_191d2d1c030367ca340cb5b3b2f4fe50.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048629810>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_1e9ea6220c12e96504efac65a303a3f5.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d2b7f7ce9e9d2c09e99ff86bd86db966.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048867350>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_b83c074ce0b61d1fd682ff8e85c5861d.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cb010>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_44d1e6fb465a7e867630b6e49da68165.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_6795e175a298305c7e44dec6fe3c787d.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_fecb47887c3549e8b0dcdedadda76da8.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_76d0e6547d92f61a8dff67fe2444741f.jpg not downloaded yet
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_d1ec255ba38fff07013a7edee7c8275e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c6c90>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_e33ea9b00dd0a68b19721770ea22d10a.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ad45aa41b1b595b77b77ee16251b68bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d4ed1e54f7e37ac34c5601931dbc7adf.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_83a4fa27b9bca0e292a25f038bf87cb2.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_378d868c884f459250bda8bc655420b6.jpg not downloaded yet
2026-04-27 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_732c6db1c2757370e3a42d17ae80a0b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823cd50>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d2b7f7ce9e9d2c09e99ff86bd86db966.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_76c4401735c61a806912a77a14d55365.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_150581b47919b5f8f88f3a4a7aefa188.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ba9f4346e9cbc155e3a04c9b6ebe76f3.jpg not downloaded yet
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_a4024a5f1ae470baebcf7bfe86a4d210.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_392439716f70f8f3eb74a7a1852bf08f.jpg not downloaded yet
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a949d0>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_d1ec255ba38fff07013a7edee7c8275e.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_76d0e6547d92f61a8dff67fe2444741f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_62be79c3582fcd7969641330b9364c14.jpg not downloaded yet
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d4f10>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ad45aa41b1b595b77b77ee16251b68bc.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048378b50>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_732c6db1c2757370e3a42d17ae80a0b8.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_05c30ad9b81985426660c0b4514a59fb.jpg not downloaded yet
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_cfc066f67d2cd7db510039abceb9e1ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04814c8d0>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_a4024a5f1ae470baebcf7bfe86a4d210.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_fecb47887c3549e8b0dcdedadda76da8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f8510>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_76d0e6547d92f61a8dff67fe2444741f.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_392439716f70f8f3eb74a7a1852bf08f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663790>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_cfc066f67d2cd7db510039abceb9e1ea.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_05c30ad9b81985426660c0b4514a59fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048660d90>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_fecb47887c3549e8b0dcdedadda76da8.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD38096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ba9f4346e9cbc155e3a04c9b6ebe76f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f7c90>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_392439716f70f8f3eb74a7a1852bf08f.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_76c4401735c61a806912a77a14d55365.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256fd0>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_05c30ad9b81985426660c0b4514a59fb.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d4ed1e54f7e37ac34c5601931dbc7adf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_62be79c3582fcd7969641330b9364c14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048878910>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ba9f4346e9cbc155e3a04c9b6ebe76f3.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_150581b47919b5f8f88f3a4a7aefa188.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_6795e175a298305c7e44dec6fe3c787d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048255450>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_76c4401735c61a806912a77a14d55365.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_83a4fa27b9bca0e292a25f038bf87cb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW25923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_aa147beca8d16e611ec823ce2c37bd28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_27f491e7c2cb1848ebf9a53cf500f350.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04864ac90>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d4ed1e54f7e37ac34c5601931dbc7adf.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_f4e1699083332ea43f064c4a534610e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841ea10>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_62be79c3582fcd7969641330b9364c14.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_378d868c884f459250bda8bc655420b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_b2faa7f100350c6d293dd0e8adf54c89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a2a50>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_150581b47919b5f8f88f3a4a7aefa188.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048524890>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_6795e175a298305c7e44dec6fe3c787d.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_0d417a279dd58d8afbe5f70712bd5fa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_59fd2294e181c2cd5d783f2a28935dab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bebde146156fc922f12a5f4e89d80f12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048781290>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_83a4fa27b9bca0e292a25f038bf87cb2.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842af50>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_aa147beca8d16e611ec823ce2c37bd28.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c0710>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_27f491e7c2cb1848ebf9a53cf500f350.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ef010>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_f4e1699083332ea43f064c4a534610e6.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_90e42d09d62d9b99ea551cbe3f7bd05a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_de26e2ee2c9698348321a9039a8233b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE85179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841f610>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_378d868c884f459250bda8bc655420b6.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048641050>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_b2faa7f100350c6d293dd0e8adf54c89.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a
2026-04-27 08:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 180f47f3-0e77-5f0d-820d-371c2d5ef74a, skipping ID generation
2026-04-27 08:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a with scrape type 1
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 180f47f3-0e77-5f0d-820d-371c2d5ef74a sending to next pipeline
2026-04-27 08:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 180f47f3-0e77-5f0d-820d-371c2d5ef74a, identifier: RZ01434
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0576834d0>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_0d417a279dd58d8afbe5f70712bd5fa9.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482548d0>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_59fd2294e181c2cd5d783f2a28935dab.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29
2026-04-27 08:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eedc01f-fe2e-5eee-a92f-94d071ac6d29, skipping ID generation
2026-04-27 08:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 with scrape type 1
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 sending to next pipeline
2026-04-27 08:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2eedc01f-fe2e-5eee-a92f-94d071ac6d29, identifier: TA57631
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862b090>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bebde146156fc922f12a5f4e89d80f12.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 180f47f3-0e77-5f0d-820d-371c2d5ef74a with identifier: RZ01434
2026-04-27 08:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 180f47f3-0e77-5f0d-820d-371c2d5ef74a with identifier: RZ01434
2026-04-27 08:03:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 180f47f3-0e77-5f0d-820d-371c2d5ef74a with identifier: RZ01434 to the API
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_b2faa7f100350c6d293dd0e8adf54c89.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Esquivias',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:43:18Z',
'fuel_type': 'diesel',
'id': '180f47f3-0e77-5f0d-820d-371c2d5ef74a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ01434',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Mazda',
'model': 'CX-5',
'odometer': 101741,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_b2faa7f100350c6d293dd0e8adf54c89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ad45aa41b1b595b77b77ee16251b68bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_a4024a5f1ae470baebcf7bfe86a4d210.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_cfc066f67d2cd7db510039abceb9e1ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_76d0e6547d92f61a8dff67fe2444741f.jpg',
'Width': 613},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_378d868c884f459250bda8bc655420b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_ba9f4346e9cbc155e3a04c9b6ebe76f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_392439716f70f8f3eb74a7a1852bf08f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_62be79c3582fcd7969641330b9364c14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_180f47f3-0e77-5f0d-820d-371c2d5ef74a/180f47f3-0e77-5f0d-820d-371c2d5ef74a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/cd/b7cd672929bc44a6d2e2eb32d2d9a425/pa/RZ01434_05c30ad9b81985426660c0b4514a59fb.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Black Tech Ed.',
'transmission': 'automatic',
'trim': 'Black Tech Ed.',
'year': 2017}
2026-04-27 08:03:39 [auto1.es] INFO: Saving data for RZ01434: {'created_time': 1777277019.104875, 'last_price_update_time': 1777277019.104886, 'has_photos': True, 'auction_closing_time': 1777304598.0}
2026-04-27 08:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 with identifier: TA57631
2026-04-27 08:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 with identifier: TA57631
2026-04-27 08:03:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2eedc01f-fe2e-5eee-a92f-94d071ac6d29 with identifier: TA57631 to the API
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_59fd2294e181c2cd5d783f2a28935dab.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Rebolledo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:54:42Z',
'fuel_type': 'diesel',
'id': '2eedc01f-fe2e-5eee-a92f-94d071ac6d29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA57631',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 173325,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_1e9ea6220c12e96504efac65a303a3f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_b83c074ce0b61d1fd682ff8e85c5861d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d2b7f7ce9e9d2c09e99ff86bd86db966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_0d417a279dd58d8afbe5f70712bd5fa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_732c6db1c2757370e3a42d17ae80a0b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_59fd2294e181c2cd5d783f2a28935dab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_27f491e7c2cb1848ebf9a53cf500f350.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_6795e175a298305c7e44dec6fe3c787d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_d4ed1e54f7e37ac34c5601931dbc7adf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eedc01f-fe2e-5eee-a92f-94d071ac6d29/2eedc01f-fe2e-5eee-a92f-94d071ac6d29_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/c1/45c113ba6ac921ba143785a34441afef/pa/TA57631_76c4401735c61a806912a77a14d55365.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2020-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2020}
2026-04-27 08:03:39 [auto1.es] INFO: Saving data for TA57631: {'created_time': 1777277019.45499, 'last_price_update_time': 1777277019.455, 'has_photos': True, 'auction_closing_time': 1777305282.0}
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_1d75f71f5d6acccc298f84d5d1d9f429.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_c8b860ebc391d19d3497cd8e68b2a111.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3d850>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_90e42d09d62d9b99ea551cbe3f7bd05a.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3adf0175-8c87-55c5-811d-00abbbdeca39
2026-04-27 08:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3adf0175-8c87-55c5-811d-00abbbdeca39, skipping ID generation
2026-04-27 08:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adf0175-8c87-55c5-811d-00abbbdeca39 with scrape type 1
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3adf0175-8c87-55c5-811d-00abbbdeca39 sending to next pipeline
2026-04-27 08:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3adf0175-8c87-55c5-811d-00abbbdeca39, identifier: JT96538
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c8590>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_de26e2ee2c9698348321a9039a8233b5.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3adf0175-8c87-55c5-811d-00abbbdeca39 with identifier: JT96538
2026-04-27 08:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3adf0175-8c87-55c5-811d-00abbbdeca39 with identifier: JT96538
2026-04-27 08:03:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3adf0175-8c87-55c5-811d-00abbbdeca39 with identifier: JT96538 to the API
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_90e42d09d62d9b99ea551cbe3f7bd05a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 251,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '4.0L',
'engine_horse_power': 475,
'expiration_date': '2026-04-27T15:00:26Z',
'fuel_type': 'petrol',
'id': '3adf0175-8c87-55c5-811d-00abbbdeca39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT96538',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 124171,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_191d2d1c030367ca340cb5b3b2f4fe50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_44d1e6fb465a7e867630b6e49da68165.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_e33ea9b00dd0a68b19721770ea22d10a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_f4e1699083332ea43f064c4a534610e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_d1ec255ba38fff07013a7edee7c8275e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_90e42d09d62d9b99ea551cbe3f7bd05a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_aa147beca8d16e611ec823ce2c37bd28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_fecb47887c3549e8b0dcdedadda76da8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_83a4fa27b9bca0e292a25f038bf87cb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3adf0175-8c87-55c5-811d-00abbbdeca39/3adf0175-8c87-55c5-811d-00abbbdeca39_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/4c/734c8fe723511a924f9bf060876db8c4/pa/JT96538_150581b47919b5f8f88f3a4a7aefa188.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2020-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 63 AMG',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-04-27 08:03:40 [auto1.es] INFO: Saving data for JT96538: {'created_time': 1777277020.016981, 'last_price_update_time': 1777277020.016993, 'has_photos': True, 'auction_closing_time': 1777302026.0}
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_9d345cb8a0347ba36ba91c40e4ce3d73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9010>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_1d75f71f5d6acccc298f84d5d1d9f429.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c82d0>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_c8b860ebc391d19d3497cd8e68b2a111.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a2710>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_9d345cb8a0347ba36ba91c40e4ce3d73.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_84303abac4ad8d143e105e00f96ea907.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_0a584da8c62ca9f7e820b8b760bd963a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU36495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048165b90>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_84303abac4ad8d143e105e00f96ea907.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_74d8743501678bb357053e815ce6d406.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f9190>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_0a584da8c62ca9f7e820b8b760bd963a.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a34d0>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_74d8743501678bb357053e815ce6d406.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe
2026-04-27 08:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b2a8100-e407-57b9-9cce-fba95f7b66fe, skipping ID generation
2026-04-27 08:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe with scrape type 1
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b2a8100-e407-57b9-9cce-fba95f7b66fe sending to next pipeline
2026-04-27 08:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b2a8100-e407-57b9-9cce-fba95f7b66fe, identifier: TW64500
2026-04-27 08:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b2a8100-e407-57b9-9cce-fba95f7b66fe with identifier: TW64500
2026-04-27 08:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b2a8100-e407-57b9-9cce-fba95f7b66fe with identifier: TW64500
2026-04-27 08:03:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b2a8100-e407-57b9-9cce-fba95f7b66fe with identifier: TW64500 to the API
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_74d8743501678bb357053e815ce6d406.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:44:20Z',
'fuel_type': 'diesel',
'id': '4b2a8100-e407-57b9-9cce-fba95f7b66fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW64500',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 173948,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_74d8743501678bb357053e815ce6d406.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_0a584da8c62ca9f7e820b8b760bd963a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bba25f27d2b30f8bdba8a46e43559357.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_cd398a3715b385a290e949b424f51d1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_022c59848bcd5244a891bf86a789d555.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_1d75f71f5d6acccc298f84d5d1d9f429.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_645fb3e778577b8d33e0d12e069f0ac2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_a214228d3a7b97d4edfd2815549cfb99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_de26e2ee2c9698348321a9039a8233b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b2a8100-e407-57b9-9cce-fba95f7b66fe/4b2a8100-e407-57b9-9cce-fba95f7b66fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/76/6d762ce7dbaf9321019b4301b8b661c8/pa/TW64500_bebde146156fc922f12a5f4e89d80f12.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-10-03',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Live M',
'transmission': 'manual',
'trim': 'Live M',
'year': 2019}
2026-04-27 08:03:40 [auto1.es] INFO: Saving data for TW64500: {'created_time': 1777277020.890904, 'last_price_update_time': 1777277020.890914, 'has_photos': True, 'auction_closing_time': 1777304660.0}
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_e2793f5c8c4075c060bc1e65c6a3789d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_b0a6c68f1cf04ea8ea1041ef5d927f35.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN47559> (referer: https://www.auto1.com/v1/car-details-view/KN47559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_f055e53ccfc4f91bb1c1a3c6e65981e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834e8d0>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_e2793f5c8c4075c060bc1e65c6a3789d.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fad90>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_b0a6c68f1cf04ea8ea1041ef5d927f35.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP80713> (referer: https://www.auto1.com/v1/car-details-view/LP80713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2859860-6dca-59dd-979a-52a83482660b with identifier: KN47559
2026-04-27 08:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2859860-6dca-59dd-979a-52a83482660b with scrape type 1
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_0cc9bf6b1c94d6b58f2da6295050b8b2.jpg not downloaded yet
2026-04-27 08:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_9d38276058ddc97cd24802fb8279221f.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_fea2e5c7934e03148cfa0143a06add90.jpg not downloaded yet
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a0850>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_f055e53ccfc4f91bb1c1a3c6e65981e2.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65
2026-04-27 08:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e4f0a8b-e939-5042-bee2-de52a8c25c65, skipping ID generation
2026-04-27 08:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65 with scrape type 1
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e4f0a8b-e939-5042-bee2-de52a8c25c65 sending to next pipeline
2026-04-27 08:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e4f0a8b-e939-5042-bee2-de52a8c25c65, identifier: ZJ02934
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK66669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e4f0a8b-e939-5042-bee2-de52a8c25c65 with identifier: ZJ02934
2026-04-27 08:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e4f0a8b-e939-5042-bee2-de52a8c25c65 with identifier: ZJ02934
2026-04-27 08:03:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e4f0a8b-e939-5042-bee2-de52a8c25c65 with identifier: ZJ02934 to the API
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_f055e53ccfc4f91bb1c1a3c6e65981e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Aldaya',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:45:34Z',
'fuel_type': 'diesel',
'id': '9e4f0a8b-e939-5042-bee2-de52a8c25c65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ02934',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'Expert',
'odometer': 82549,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_f055e53ccfc4f91bb1c1a3c6e65981e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_de320531476e29005370e2a68622dd39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_b0a6c68f1cf04ea8ea1041ef5d927f35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_e2793f5c8c4075c060bc1e65c6a3789d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_84303abac4ad8d143e105e00f96ea907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_6b2093a5ca807981f3383d3489066108.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_9d345cb8a0347ba36ba91c40e4ce3d73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_c8b860ebc391d19d3497cd8e68b2a111.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_7564bfde570e427bac302576e535b802.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4f0a8b-e939-5042-bee2-de52a8c25c65/9e4f0a8b-e939-5042-bee2-de52a8c25c65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d3/46d32567f06832b43eacc7ffb07a1dca/pa/ZJ02934_a4d5ea83b6ba610fba40622c0e901f6b.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-05-30',
'seats_number': 6,
'seller_name': None,
'title': 'Peugeot Expert 1.5 Blue-HDi L2',
'transmission': 'manual',
'trim': 'L2',
'year': 2021}
2026-04-27 08:03:41 [auto1.es] INFO: Saving data for ZJ02934: {'created_time': 1777277021.654566, 'last_price_update_time': 1777277021.654576, 'has_photos': True, 'auction_closing_time': 1777304734.0}
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_7278b1876e5508ac001648ecb0394caf.jpg not downloaded yet
2026-04-27 08:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_b4cd6d08c23422c9ef1dff82a064ed98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM66280> (referer: https://www.auto1.com/v1/car-details-view/CM66280/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_88e1470e08f73d000bec064b8d2760d8.jpg not downloaded yet
2026-04-27 08:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa with identifier: LP80713
2026-04-27 08:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa with scrape type 1
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_85d53e4421ecf165742c24d7725cf9b5.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_3d9c4c46ba1a74a4dfcd5f394c52004b.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_1c611327fdbaaa436acc847e67e768a4.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f781c007e2eb36eb7b7bc306fda6a33e.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c201e7a237a542526441d5d5fb473b1d.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f1055ea217d2cf634a277b3271cb8529.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_e537fffc177e723322b4b5a2d5aa4386.jpg not downloaded yet
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_7278b1876e5508ac001648ecb0394caf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_142335ca996584b6a86dc98cd1d50486.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_b39a287f71180f60b3fa73ce07ca4afa.jpg not downloaded yet
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_9d38276058ddc97cd24802fb8279221f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_1cbc72020807a0218deecb1bcb79358b.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c313228f35d800d63a24bfa3cd8f9fb8.jpg not downloaded yet
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c9090>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_b4cd6d08c23422c9ef1dff82a064ed98.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ede425-cfb9-5874-b851-7729f959eee7 with identifier: CM66280
2026-04-27 08:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ede425-cfb9-5874-b851-7729f959eee7 with scrape type 1
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a1b358094f359def4fc5fb02508d2a69.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_f23024491137fba5b51ae19606d2b14b.jpg not downloaded yet
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8eef6485c76429c27b854a9b6dddb4b1.jpg not downloaded yet
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_fea2e5c7934e03148cfa0143a06add90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_5038fb23f349e5866d1bca9c340e0f0b.jpg not downloaded yet
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8610b662f7ded43391fbfa8fee026e8d.jpg not downloaded yet
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c3050>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_7278b1876e5508ac001648ecb0394caf.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a3cd0>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_9d38276058ddc97cd24802fb8279221f.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_122119eb9cea0f3a5dec050821585782.jpg not downloaded yet
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_0c5efb0e8bc0139147aa8647282b9826.jpg not downloaded yet
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_e537fffc177e723322b4b5a2d5aa4386.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_2b18662819c3af078d02928a39334ada.jpg not downloaded yet
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_3d040d2e32febe759303a4c721fff365.jpg not downloaded yet
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04846df50>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_fea2e5c7934e03148cfa0143a06add90.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_97c3454517f1b61d797ea28f925b424a.jpg not downloaded yet
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f1055ea217d2cf634a277b3271cb8529.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a422a2b2ac55179f8bbcef77214737de.jpg not downloaded yet
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_2288ca01ddbfa2bc8f9962d73d922148.jpg not downloaded yet
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_80c6eb3219839638e78975f94a9c2846.jpg not downloaded yet
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894f8d0>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_e537fffc177e723322b4b5a2d5aa4386.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_0c5efb0e8bc0139147aa8647282b9826.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_5ddfdad1149b23c24a767afec250cb74.jpg not downloaded yet
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_3d040d2e32febe759303a4c721fff365.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a96b50>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f1055ea217d2cf634a277b3271cb8529.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_80c6eb3219839638e78975f94a9c2846.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8eef6485c76429c27b854a9b6dddb4b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ca890>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_0c5efb0e8bc0139147aa8647282b9826.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048852810>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_3d040d2e32febe759303a4c721fff365.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048661750>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_80c6eb3219839638e78975f94a9c2846.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1c10>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8eef6485c76429c27b854a9b6dddb4b1.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_2288ca01ddbfa2bc8f9962d73d922148.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_5ddfdad1149b23c24a767afec250cb74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a422a2b2ac55179f8bbcef77214737de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_122119eb9cea0f3a5dec050821585782.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c8b90>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_2288ca01ddbfa2bc8f9962d73d922148.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8610b662f7ded43391fbfa8fee026e8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048780990>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_5ddfdad1149b23c24a767afec250cb74.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048709510>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a422a2b2ac55179f8bbcef77214737de.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_97c3454517f1b61d797ea28f925b424a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_2b18662819c3af078d02928a39334ada.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483780d0>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_122119eb9cea0f3a5dec050821585782.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834e290>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8610b662f7ded43391fbfa8fee026e8d.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482c5e50>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_97c3454517f1b61d797ea28f925b424a.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fdd90>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_2b18662819c3af078d02928a39334ada.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_5038fb23f349e5866d1bca9c340e0f0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a1b358094f359def4fc5fb02508d2a69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_f23024491137fba5b51ae19606d2b14b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876cd90>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_5038fb23f349e5866d1bca9c340e0f0b.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eced0>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a1b358094f359def4fc5fb02508d2a69.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71ede425-cfb9-5874-b851-7729f959eee7
2026-04-27 08:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71ede425-cfb9-5874-b851-7729f959eee7, skipping ID generation
2026-04-27 08:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ede425-cfb9-5874-b851-7729f959eee7 with scrape type 1
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71ede425-cfb9-5874-b851-7729f959eee7 sending to next pipeline
2026-04-27 08:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71ede425-cfb9-5874-b851-7729f959eee7, identifier: CM66280
2026-04-27 08:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71ede425-cfb9-5874-b851-7729f959eee7 with identifier: CM66280
2026-04-27 08:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71ede425-cfb9-5874-b851-7729f959eee7 with identifier: CM66280
2026-04-27 08:03:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71ede425-cfb9-5874-b851-7729f959eee7 with identifier: CM66280 to the API
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a1b358094f359def4fc5fb02508d2a69.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Esquivias',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:15:59Z',
'fuel_type': 'diesel',
'id': '71ede425-cfb9-5874-b851-7729f959eee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM66280',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 149580,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a1b358094f359def4fc5fb02508d2a69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8eef6485c76429c27b854a9b6dddb4b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_8610b662f7ded43391fbfa8fee026e8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_0c5efb0e8bc0139147aa8647282b9826.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_3d040d2e32febe759303a4c721fff365.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_97c3454517f1b61d797ea28f925b424a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_a422a2b2ac55179f8bbcef77214737de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_2288ca01ddbfa2bc8f9962d73d922148.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_80c6eb3219839638e78975f94a9c2846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ede425-cfb9-5874-b851-7729f959eee7/71ede425-cfb9-5874-b851-7729f959eee7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/98/e898e72fb89e6864dd85d35cc709db80/pa/CM66280_5ddfdad1149b23c24a767afec250cb74.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2018-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-04-27 08:03:43 [auto1.es] INFO: Saving data for CM66280: {'created_time': 1777277023.818117, 'last_price_update_time': 1777277023.818129, 'has_photos': True, 'auction_closing_time': 1777302959.0}
2026-04-27 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_1cbc72020807a0218deecb1bcb79358b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c313228f35d800d63a24bfa3cd8f9fb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_b39a287f71180f60b3fa73ce07ca4afa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fcd10>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_f23024491137fba5b51ae19606d2b14b.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837b510>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_1cbc72020807a0218deecb1bcb79358b.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768890>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c313228f35d800d63a24bfa3cd8f9fb8.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048743350>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_b39a287f71180f60b3fa73ce07ca4afa.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c201e7a237a542526441d5d5fb473b1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_142335ca996584b6a86dc98cd1d50486.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f781c007e2eb36eb7b7bc306fda6a33e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487aca90>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c201e7a237a542526441d5d5fb473b1d.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662c90>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_142335ca996584b6a86dc98cd1d50486.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768550>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f781c007e2eb36eb7b7bc306fda6a33e.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_1c611327fdbaaa436acc847e67e768a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_3d9c4c46ba1a74a4dfcd5f394c52004b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_85d53e4421ecf165742c24d7725cf9b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_88e1470e08f73d000bec064b8d2760d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048840f10>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_1c611327fdbaaa436acc847e67e768a4.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_0cc9bf6b1c94d6b58f2da6295050b8b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a976d0>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_3d9c4c46ba1a74a4dfcd5f394c52004b.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869b4d0>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_85d53e4421ecf165742c24d7725cf9b5.jpg saved to cache
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa
2026-04-27 08:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa, skipping ID generation
2026-04-27 08:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa with scrape type 1
2026-04-27 08:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa sending to next pipeline
2026-04-27 08:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa, identifier: LP80713
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823d7d0>
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_88e1470e08f73d000bec064b8d2760d8.jpg saved to cache
2026-04-27 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa with identifier: LP80713
2026-04-27 08:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa with identifier: LP80713
2026-04-27 08:03:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa with identifier: LP80713 to the API
2026-04-27 08:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_85d53e4421ecf165742c24d7725cf9b5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'city': 'Aldaya',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 194,
'expiration_date': '2026-04-27T15:14:45Z',
'fuel_type': 'diesel',
'id': 'a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP80713',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 111266,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_85d53e4421ecf165742c24d7725cf9b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_1c611327fdbaaa436acc847e67e768a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c201e7a237a542526441d5d5fb473b1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_e537fffc177e723322b4b5a2d5aa4386.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_b39a287f71180f60b3fa73ce07ca4afa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_c313228f35d800d63a24bfa3cd8f9fb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_f23024491137fba5b51ae19606d2b14b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_5038fb23f349e5866d1bca9c340e0f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_122119eb9cea0f3a5dec050821585782.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa/a0cbd4c8-6406-53d4-9bf2-fbdf077d05aa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/6e/456e362a8296972da878c162906cdb42/pa/LP80713_2b18662819c3af078d02928a39334ada.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-04-27 08:03:45 [auto1.es] INFO: Saving data for LP80713: {'created_time': 1777277025.449981, 'last_price_update_time': 1777277025.449991, 'has_photos': True, 'auction_closing_time': 1777302885.0}
2026-04-27 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH13326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057147890>
2026-04-27 08:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_0cc9bf6b1c94d6b58f2da6295050b8b2.jpg saved to cache
2026-04-27 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2859860-6dca-59dd-979a-52a83482660b
2026-04-27 08:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2859860-6dca-59dd-979a-52a83482660b, skipping ID generation
2026-04-27 08:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2859860-6dca-59dd-979a-52a83482660b with scrape type 1
2026-04-27 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2859860-6dca-59dd-979a-52a83482660b sending to next pipeline
2026-04-27 08:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2859860-6dca-59dd-979a-52a83482660b, identifier: KN47559
2026-04-27 08:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2859860-6dca-59dd-979a-52a83482660b with identifier: KN47559
2026-04-27 08:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2859860-6dca-59dd-979a-52a83482660b with identifier: KN47559
2026-04-27 08:03:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2859860-6dca-59dd-979a-52a83482660b with identifier: KN47559 to the API
2026-04-27 08:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_0cc9bf6b1c94d6b58f2da6295050b8b2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:31:59Z',
'fuel_type': 'diesel',
'id': 'd2859860-6dca-59dd-979a-52a83482660b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN47559',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 112585,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_0cc9bf6b1c94d6b58f2da6295050b8b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_9d38276058ddc97cd24802fb8279221f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_fea2e5c7934e03148cfa0143a06add90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_7278b1876e5508ac001648ecb0394caf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_88e1470e08f73d000bec064b8d2760d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_3d9c4c46ba1a74a4dfcd5f394c52004b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f781c007e2eb36eb7b7bc306fda6a33e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_f1055ea217d2cf634a277b3271cb8529.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_142335ca996584b6a86dc98cd1d50486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d2859860-6dca-59dd-979a-52a83482660b/d2859860-6dca-59dd-979a-52a83482660b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/80/21804870cd5da094723a66bb74241494/pa/KN47559_1cbc72020807a0218deecb1bcb79358b.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2018-04-22',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Autobiography',
'transmission': 'automatic',
'trim': 'Autobiography',
'year': 2018}
2026-04-27 08:03:45 [auto1.es] INFO: Saving data for KN47559: {'created_time': 1777277025.911383, 'last_price_update_time': 1777277025.911395, 'has_photos': True, 'auction_closing_time': 1777303919.0}
2026-04-27 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_c987e8cddeadebbb90cb535d471d8a14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_92e3c2be53e627d39af7a4ce28656aee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889ddd0>
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_c987e8cddeadebbb90cb535d471d8a14.jpg saved to cache
2026-04-27 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048873f90>
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_92e3c2be53e627d39af7a4ce28656aee.jpg saved to cache
2026-04-27 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD38096> (referer: https://www.auto1.com/v1/car-details-view/KD38096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 with identifier: KD38096
2026-04-27 08:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 with scrape type 1
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_f43615ae219df89ffb638a40d5df454d.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_2bada6169c6a523b885167775daa6a80.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_7c581b12c326f01d1b3ecfded5a25bef.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_329f64bd4f647d8d808d8ab533c5ca83.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_5f390136a500e7beb695b72029e81bac.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_3b620009618988a247c30dc8edd10877.jpg not downloaded yet
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC08619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_3b620009618988a247c30dc8edd10877.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_5f390136a500e7beb695b72029e81bac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836b8d0>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_3b620009618988a247c30dc8edd10877.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048743550>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_5f390136a500e7beb695b72029e81bac.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE85179> (referer: https://www.auto1.com/v1/car-details-view/BE85179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_329f64bd4f647d8d808d8ab533c5ca83.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca17fc7-ee01-5bb1-a216-1cf088c0fdae with identifier: BE85179
2026-04-27 08:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae with scrape type 1
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c07da85f265ad6d03ddc39d05379f3e1.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_a271e49678a85492685da9e407e88ef3.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_118d8957a303266c73cd99bddb919727.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_cabcad3b3fdac070cbcbdc892d1f6b17.jpg not downloaded yet
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e010>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_329f64bd4f647d8d808d8ab533c5ca83.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_57bb9feb801e8c2d3136bcd8cba3d803.jpg not downloaded yet
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_7c581b12c326f01d1b3ecfded5a25bef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_6768a063b75340e29ed295ddad3227d8.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_9083054271d0885b446bbe2f77ea1626.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_086c8a76245a256c6e35358a95578f66.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c363d1dd94dbab068b1bb6b3f307ded2.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_8f8d853f306c559968e2a464c1b91883.jpg not downloaded yet
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663510>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_7c581b12c326f01d1b3ecfded5a25bef.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_57bb9feb801e8c2d3136bcd8cba3d803.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486995d0>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_57bb9feb801e8c2d3136bcd8cba3d803.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_8f8d853f306c559968e2a464c1b91883.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876f810>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_8f8d853f306c559968e2a464c1b91883.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF27749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c363d1dd94dbab068b1bb6b3f307ded2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048698450>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c363d1dd94dbab068b1bb6b3f307ded2.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_086c8a76245a256c6e35358a95578f66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_9083054271d0885b446bbe2f77ea1626.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048872f50>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_086c8a76245a256c6e35358a95578f66.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048782090>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_9083054271d0885b446bbe2f77ea1626.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE02241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_6768a063b75340e29ed295ddad3227d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_118d8957a303266c73cd99bddb919727.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048982790>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_6768a063b75340e29ed295ddad3227d8.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048828fd0>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_118d8957a303266c73cd99bddb919727.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_cabcad3b3fdac070cbcbdc892d1f6b17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_a271e49678a85492685da9e407e88ef3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048709f10>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_cabcad3b3fdac070cbcbdc892d1f6b17.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c07da85f265ad6d03ddc39d05379f3e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3d710>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_a271e49678a85492685da9e407e88ef3.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876cb50>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c07da85f265ad6d03ddc39d05379f3e1.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae
2026-04-27 08:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca17fc7-ee01-5bb1-a216-1cf088c0fdae, skipping ID generation
2026-04-27 08:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae with scrape type 1
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bca17fc7-ee01-5bb1-a216-1cf088c0fdae sending to next pipeline
2026-04-27 08:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bca17fc7-ee01-5bb1-a216-1cf088c0fdae, identifier: BE85179
2026-04-27 08:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bca17fc7-ee01-5bb1-a216-1cf088c0fdae with identifier: BE85179
2026-04-27 08:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bca17fc7-ee01-5bb1-a216-1cf088c0fdae with identifier: BE85179
2026-04-27 08:03:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bca17fc7-ee01-5bb1-a216-1cf088c0fdae with identifier: BE85179 to the API
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c07da85f265ad6d03ddc39d05379f3e1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': 'Rental',
'city': 'Colloto, Oviedo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:09:43Z',
'fuel_type': 'diesel',
'id': 'bca17fc7-ee01-5bb1-a216-1cf088c0fdae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE85179',
'listing': 'auction',
'location': 'ES, Colloto, Oviedo',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 27073,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c07da85f265ad6d03ddc39d05379f3e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_a271e49678a85492685da9e407e88ef3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_118d8957a303266c73cd99bddb919727.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_cabcad3b3fdac070cbcbdc892d1f6b17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_57bb9feb801e8c2d3136bcd8cba3d803.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_6768a063b75340e29ed295ddad3227d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_9083054271d0885b446bbe2f77ea1626.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_086c8a76245a256c6e35358a95578f66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_c363d1dd94dbab068b1bb6b3f307ded2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca17fc7-ee01-5bb1-a216-1cf088c0fdae/bca17fc7-ee01-5bb1-a216-1cf088c0fdae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/00/2a004a4bf5881803b20bcd8fe8c65dbb/pa/BE85179_8f8d853f306c559968e2a464c1b91883.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2024-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 120d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2026-04-27 08:03:53 [auto1.es] INFO: Saving data for BE85179: {'created_time': 1777277033.070746, 'last_price_update_time': 1777277033.07076, 'has_photos': True, 'auction_closing_time': 1777302583.0}
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_2bada6169c6a523b885167775daa6a80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK66669> (referer: https://www.auto1.com/v1/car-details-view/RK66669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_f43615ae219df89ffb638a40d5df454d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e1ed0>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_2bada6169c6a523b885167775daa6a80.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d33ca8d1-583b-5ad2-bba4-c43b49c63b24 with identifier: RK66669
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_75a999fd383f6b4a6069d0be7847f5e2.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_ac261e6f47bb5ca4e337b4d432e50e50.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_68630608ea32c7e0ea4c184cf39d0b94.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_47f5d42098519a5f624ad66b55a12625.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048257390>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_f43615ae219df89ffb638a40d5df454d.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6, skipping ID generation
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 sending to next pipeline
2026-04-27 08:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6, identifier: KD38096
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_b9729a09f8ff56864c22a7bb89bcb844.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 with identifier: KD38096
2026-04-27 08:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 with identifier: KD38096
2026-04-27 08:03:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6 with identifier: KD38096 to the API
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_f43615ae219df89ffb638a40d5df454d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Sevilla',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-04-27T15:40:05Z',
'fuel_type': 'diesel',
'id': '29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD38096',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Opel',
'model': 'Astra',
'odometer': 410534,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_f43615ae219df89ffb638a40d5df454d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_2bada6169c6a523b885167775daa6a80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_7c581b12c326f01d1b3ecfded5a25bef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_329f64bd4f647d8d808d8ab533c5ca83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_5f390136a500e7beb695b72029e81bac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6/29ccb205-5e6a-5af8-8b1e-1a19c1ee07d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/35/b435b7a1bf91d2331ac959bf0313ec60/pa/KD38096_3b620009618988a247c30dc8edd10877.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2015}
2026-04-27 08:03:53 [auto1.es] INFO: Saving data for KD38096: {'created_time': 1777277033.879653, 'last_price_update_time': 1777277033.879666, 'has_photos': True, 'auction_closing_time': 1777304405.0}
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_bc57228bef0c3278a3e1972342fa04c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_23a663953b10a52720259c45095c8f29.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ca8d0>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_68630608ea32c7e0ea4c184cf39d0b94.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_86a69e93b277d4e022bd3fd30e3da4d9.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_ac261e6f47bb5ca4e337b4d432e50e50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS51143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_3c76473b859c49f83fdc21971d90b1d9.jpg not downloaded yet
2026-04-27 08:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_38508dc665471bb92ad35656c9dbe76c.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_40a441b627aa307c4088962b4fbf536d.jpg not downloaded yet
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c7dd0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_bc57228bef0c3278a3e1972342fa04c1.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_c2b07e47fa03100f46ac39501da532c4.jpg not downloaded yet
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048843b10>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_ac261e6f47bb5ca4e337b4d432e50e50.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_b9729a09f8ff56864c22a7bb89bcb844.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_86a69e93b277d4e022bd3fd30e3da4d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_23a663953b10a52720259c45095c8f29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487aced0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_b9729a09f8ff56864c22a7bb89bcb844.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487af350>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_86a69e93b277d4e022bd3fd30e3da4d9.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_c2b07e47fa03100f46ac39501da532c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c61d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_23a663953b10a52720259c45095c8f29.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_40a441b627aa307c4088962b4fbf536d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2c90>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_c2b07e47fa03100f46ac39501da532c4.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876bbd0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_40a441b627aa307c4088962b4fbf536d.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_38508dc665471bb92ad35656c9dbe76c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_3c76473b859c49f83fdc21971d90b1d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048697a50>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_38508dc665471bb92ad35656c9dbe76c.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF85973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_47f5d42098519a5f624ad66b55a12625.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bea10>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_3c76473b859c49f83fdc21971d90b1d9.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048379910>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_47f5d42098519a5f624ad66b55a12625.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH85653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_75a999fd383f6b4a6069d0be7847f5e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_19345534dc8e052c0bbb392ab97d53bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870b890>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_75a999fd383f6b4a6069d0be7847f5e2.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24
2026-04-27 08:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d33ca8d1-583b-5ad2-bba4-c43b49c63b24, skipping ID generation
2026-04-27 08:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24 with scrape type 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d33ca8d1-583b-5ad2-bba4-c43b49c63b24 sending to next pipeline
2026-04-27 08:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d33ca8d1-583b-5ad2-bba4-c43b49c63b24, identifier: RK66669
2026-04-27 08:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d33ca8d1-583b-5ad2-bba4-c43b49c63b24 with identifier: RK66669
2026-04-27 08:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d33ca8d1-583b-5ad2-bba4-c43b49c63b24 with identifier: RK66669
2026-04-27 08:03:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d33ca8d1-583b-5ad2-bba4-c43b49c63b24 with identifier: RK66669 to the API
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_75a999fd383f6b4a6069d0be7847f5e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'city': 'Granyanella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:36:40Z',
'fuel_type': 'petrol',
'id': 'd33ca8d1-583b-5ad2-bba4-c43b49c63b24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK66669',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Seat',
'model': 'Alhambra',
'odometer': 127839,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_75a999fd383f6b4a6069d0be7847f5e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_ac261e6f47bb5ca4e337b4d432e50e50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_47f5d42098519a5f624ad66b55a12625.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_b9729a09f8ff56864c22a7bb89bcb844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_23a663953b10a52720259c45095c8f29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_86a69e93b277d4e022bd3fd30e3da4d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_3c76473b859c49f83fdc21971d90b1d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_38508dc665471bb92ad35656c9dbe76c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_40a441b627aa307c4088962b4fbf536d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d33ca8d1-583b-5ad2-bba4-c43b49c63b24/d33ca8d1-583b-5ad2-bba4-c43b49c63b24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fb/51fb750d2480afb5de80dc3295c41c9c/pa/RK66669_c2b07e47fa03100f46ac39501da532c4.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2012-07-19',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-04-27 08:03:55 [auto1.es] INFO: Saving data for RK66669: {'created_time': 1777277035.592691, 'last_price_update_time': 1777277035.592715, 'has_photos': True, 'auction_closing_time': 1777304200.0}
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fc50>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_19345534dc8e052c0bbb392ab97d53bd.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU36495> (referer: https://www.auto1.com/v1/car-details-view/NU36495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b with identifier: NU36495
2026-04-27 08:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b with scrape type 1
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_fc8f6be7c971a8b2ce111582cb89a4e9.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_99e8bef2a1f93f4e32ca00747996fc90.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_73b3c89492e550c086035bd232aab815.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_ddab236fb4920bb2467845eb9bf52276.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_328a4703f1ad13a2fc7b38416c9677cc.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_d976e7ede2c06ec61cbe22ba1137897e.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_28eb66a3502e6a10b03de9aca78a3991.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_86395680f1bd96410ab4ef0e1032047b.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_7c880b638e0906c0dac1be381c79be27.jpg not downloaded yet
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_b4bc9da11ed1551db0e2aea4a56693cb.jpg not downloaded yet
2026-04-27 08:04:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.764(s), this was the 1st time calling it.
2026-04-27 08:04:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.416551309210442 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS01724> (referer: https://www.auto1.com/v1/car-details-view/MS01724/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_b4bc9da11ed1551db0e2aea4a56693cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb with identifier: MS01724
2026-04-27 08:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb with scrape type 1
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_2035cd13091f6660a97563bb85e22334.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bd10e3e5e505d3a348522a3a7c0e8ca5.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_67101a01b5bb22c70b890bf792f9a7fa.jpg not downloaded yet
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_7c880b638e0906c0dac1be381c79be27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_902f49768d959f549b613badf42ea54c.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bbebbcc4391c7464b218d3e72fb22206.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_388e7c333065a51140859f30710f5fa4.jpg not downloaded yet
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3c690>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_b4bc9da11ed1551db0e2aea4a56693cb.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_8d578507a5fd418c86cfb766571c69f9.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_9d44db63d82a7a632722a372216d0e91.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_f3b4519955a82c4e74c16505942c5174.jpg not downloaded yet
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eec10>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_7c880b638e0906c0dac1be381c79be27.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_20def86a1535cb206d81afae392e1600.jpg not downloaded yet
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bd10e3e5e505d3a348522a3a7c0e8ca5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482572d0>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bd10e3e5e505d3a348522a3a7c0e8ca5.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_20def86a1535cb206d81afae392e1600.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048695010>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_20def86a1535cb206d81afae392e1600.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_f3b4519955a82c4e74c16505942c5174.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7d50>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_f3b4519955a82c4e74c16505942c5174.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_9d44db63d82a7a632722a372216d0e91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fd110>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_9d44db63d82a7a632722a372216d0e91.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_8d578507a5fd418c86cfb766571c69f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_388e7c333065a51140859f30710f5fa4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eefd0>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_8d578507a5fd418c86cfb766571c69f9.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7650>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_388e7c333065a51140859f30710f5fa4.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF27749> (referer: https://www.auto1.com/v1/car-details-view/XF27749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bbebbcc4391c7464b218d3e72fb22206.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_902f49768d959f549b613badf42ea54c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13151f4d-7024-5969-b561-ce8d2ae63ea9 with identifier: XF27749
2026-04-27 08:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13151f4d-7024-5969-b561-ce8d2ae63ea9 with scrape type 1
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_3f0e1cfcae4e84de71fd33483e5acad6.jpg not downloaded yet
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_2035cd13091f6660a97563bb85e22334.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_93efdcb074d09b9b27df2bd2a9b1772a.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_15115b4de433a50b2419b62e574d8bc5.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7484b81d6e2afc476df16dfcf1a15028.jpg not downloaded yet
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04814c450>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bbebbcc4391c7464b218d3e72fb22206.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_4f3296b3a2a1e8ddce6fea57b4cacbd9.jpg not downloaded yet
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a181d0>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_902f49768d959f549b613badf42ea54c.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_3f0e1cfcae4e84de71fd33483e5acad6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_67101a01b5bb22c70b890bf792f9a7fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7826066031ec84289c2743caa4241a2a.jpg not downloaded yet
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048769790>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_2035cd13091f6660a97563bb85e22334.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_a98468f18b50fcf7635dbfaf308a4cb9.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_ab3530894298167135fd5b64cb98dfa4.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_26aa1e92b95806005a9bb835143d00cb.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_e8af1120aece104abeea778165538ba6.jpg not downloaded yet
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048252990>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_3f0e1cfcae4e84de71fd33483e5acad6.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c0d10>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_67101a01b5bb22c70b890bf792f9a7fa.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb
2026-04-27 08:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb, skipping ID generation
2026-04-27 08:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb with scrape type 1
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb sending to next pipeline
2026-04-27 08:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb, identifier: MS01724
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_4f3296b3a2a1e8ddce6fea57b4cacbd9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb with identifier: MS01724
2026-04-27 08:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb with identifier: MS01724
2026-04-27 08:04:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb with identifier: MS01724 to the API
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_67101a01b5bb22c70b890bf792f9a7fa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'city': 'Granyanella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 132,
'expiration_date': '2026-04-27T15:29:03Z',
'fuel_type': 'petrol',
'id': 'd9d5519f-e6ac-5195-8c5f-65cd47cf4cbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS01724',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Kia',
'model': 'Sportage',
'odometer': 146467,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_2035cd13091f6660a97563bb85e22334.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bd10e3e5e505d3a348522a3a7c0e8ca5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_67101a01b5bb22c70b890bf792f9a7fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_902f49768d959f549b613badf42ea54c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_bbebbcc4391c7464b218d3e72fb22206.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_388e7c333065a51140859f30710f5fa4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_8d578507a5fd418c86cfb766571c69f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_9d44db63d82a7a632722a372216d0e91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_f3b4519955a82c4e74c16505942c5174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb/d9d5519f-e6ac-5195-8c5f-65cd47cf4cbb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/fb/c5fb69a454a2ce82f151b7d7578958b0/pa/MS01724_20def86a1535cb206d81afae392e1600.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2019-07-14',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 Basic 2WD',
'transmission': 'manual',
'trim': 'Basic 2WD',
'year': 2019}
2026-04-27 08:04:19 [auto1.es] INFO: Saving data for MS01724: {'created_time': 1777277059.139905, 'last_price_update_time': 1777277059.13992, 'has_photos': True, 'auction_closing_time': 1777303743.0}
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7484b81d6e2afc476df16dfcf1a15028.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC08619> (referer: https://www.auto1.com/v1/car-details-view/EC08619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW25923> (referer: https://www.auto1.com/v1/car-details-view/VW25923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048525f10>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_4f3296b3a2a1e8ddce6fea57b4cacbd9.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_e8af1120aece104abeea778165538ba6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a19b10>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7484b81d6e2afc476df16dfcf1a15028.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_ab3530894298167135fd5b64cb98dfa4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE02241> (referer: https://www.auto1.com/v1/car-details-view/VE02241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8768216-41a0-563c-a67b-3254680ad8c1 with identifier: EC08619
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8768216-41a0-563c-a67b-3254680ad8c1 with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_c27a3e36686392519cf06f090341953f.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 with identifier: VW25923
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_d4394f9628f4047ac964f18ff63642c8.jpg not downloaded yet
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_26aa1e92b95806005a9bb835143d00cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_672da276f18b2612ecc403e1c4b20cd2.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b56e561e252d628dcbfdde8618ef7d70.jpg not downloaded yet
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_a98468f18b50fcf7635dbfaf308a4cb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048699a50>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_e8af1120aece104abeea778165538ba6.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7826066031ec84289c2743caa4241a2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_6de825c3156e62b719a1e07eb237c68b.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_fd3b64d2e36171c57c2af12634c51e39.jpg not downloaded yet
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_93efdcb074d09b9b27df2bd2a9b1772a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048643a10>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_ab3530894298167135fd5b64cb98dfa4.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4a770f9-b82b-5782-aebc-15e57e2af821 with identifier: VE02241
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4a770f9-b82b-5782-aebc-15e57e2af821 with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_8e6448a282dafef5cb22689ee70fb32f.jpg not downloaded yet
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_15115b4de433a50b2419b62e574d8bc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_f34a9df318dba3acc66a7a8ac397bc42.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b43ce7765251ae1d04330b41bca489d5.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_c7b930a205d75189f7d187428aed67d5.jpg not downloaded yet
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048526a50>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_26aa1e92b95806005a9bb835143d00cb.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_c27a3e36686392519cf06f090341953f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_d4394f9628f4047ac964f18ff63642c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_0d70108dbfa0a1c16cf8c3c2a3f1a691.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_afedfb8ba53e52fef497680bccc2bff1.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_9ea987799d4c5180caa669f17c997c28.jpg not downloaded yet
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048497890>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_a98468f18b50fcf7635dbfaf308a4cb9.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fd290>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7826066031ec84289c2743caa4241a2a.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b56e561e252d628dcbfdde8618ef7d70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_fc1602cbc1f23aa6869e864548927e44.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b1de7a6ad4a1768437bdd38248703692.jpg not downloaded yet
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_672da276f18b2612ecc403e1c4b20cd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_da3d681ba3e3d101be0203708476aff6.jpg not downloaded yet
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488b8690>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_93efdcb074d09b9b27df2bd2a9b1772a.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a3210>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_15115b4de433a50b2419b62e574d8bc5.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13151f4d-7024-5969-b561-ce8d2ae63ea9
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13151f4d-7024-5969-b561-ce8d2ae63ea9, skipping ID generation
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13151f4d-7024-5969-b561-ce8d2ae63ea9 with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13151f4d-7024-5969-b561-ce8d2ae63ea9 sending to next pipeline
2026-04-27 08:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13151f4d-7024-5969-b561-ce8d2ae63ea9, identifier: XF27749
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_fd3b64d2e36171c57c2af12634c51e39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_2a4dfafe4369363e577e59f2c4c67347.jpg not downloaded yet
2026-04-27 08:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13151f4d-7024-5969-b561-ce8d2ae63ea9 with identifier: XF27749
2026-04-27 08:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13151f4d-7024-5969-b561-ce8d2ae63ea9 with identifier: XF27749
2026-04-27 08:04:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13151f4d-7024-5969-b561-ce8d2ae63ea9 with identifier: XF27749 to the API
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_15115b4de433a50b2419b62e574d8bc5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'city': 'El Rebolledo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:03:15Z',
'fuel_type': 'diesel',
'id': '13151f4d-7024-5969-b561-ce8d2ae63ea9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF27749',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 178559,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_3f0e1cfcae4e84de71fd33483e5acad6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_93efdcb074d09b9b27df2bd2a9b1772a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_15115b4de433a50b2419b62e574d8bc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7484b81d6e2afc476df16dfcf1a15028.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_4f3296b3a2a1e8ddce6fea57b4cacbd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_7826066031ec84289c2743caa4241a2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_a98468f18b50fcf7635dbfaf308a4cb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_ab3530894298167135fd5b64cb98dfa4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_26aa1e92b95806005a9bb835143d00cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13151f4d-7024-5969-b561-ce8d2ae63ea9/13151f4d-7024-5969-b561-ce8d2ae63ea9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e2/3ae21d34650d9aa68c5d2cce3e5c1114/pa/XF27749_e8af1120aece104abeea778165538ba6.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2009-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2009}
2026-04-27 08:04:20 [auto1.es] INFO: Saving data for XF27749: {'created_time': 1777277060.489504, 'last_price_update_time': 1777277060.489514, 'has_photos': True, 'auction_closing_time': 1777302195.0}
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880f690>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_c27a3e36686392519cf06f090341953f.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c0250>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_d4394f9628f4047ac964f18ff63642c8.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_c7b930a205d75189f7d187428aed67d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_6663cdbceea1314a8abe7a679e59c340.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b43ce7765251ae1d04330b41bca489d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_8275439990fde26a63ba2e70335e0b5b.jpg not downloaded yet
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c4810>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b56e561e252d628dcbfdde8618ef7d70.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483eae50>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_672da276f18b2612ecc403e1c4b20cd2.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_afedfb8ba53e52fef497680bccc2bff1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_bf46f788b2152a4a6534efda41d90815.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU27127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822f810>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_fd3b64d2e36171c57c2af12634c51e39.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_9ea987799d4c5180caa669f17c997c28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_ad6f9a79096ed69f27a8d5abef4b04a3.jpg not downloaded yet
2026-04-27 08:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS51143> (referer: https://www.auto1.com/v1/car-details-view/NS51143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_58bc42d33c7f36c38e4052aa05616b42.jpg not downloaded yet
2026-04-27 08:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837db50>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_c7b930a205d75189f7d187428aed67d5.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048211250>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b43ce7765251ae1d04330b41bca489d5.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_3dae0b27ee2524bfa252c33f2fb7adf9.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_da3d681ba3e3d101be0203708476aff6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_7a5bb0d8a5dc11758c37e09fbd51a645.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b1de7a6ad4a1768437bdd38248703692.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c1fd0>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_afedfb8ba53e52fef497680bccc2bff1.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048697310>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_9ea987799d4c5180caa669f17c997c28.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_f13fbbdf310c1314b8f840641534b4fe.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_6663cdbceea1314a8abe7a679e59c340.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_2a4dfafe4369363e577e59f2c4c67347.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_af7384aa5c2e19751d42148560c0d4bb.jpg not downloaded yet
2026-04-27 08:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359aa396-39ea-5901-8b76-ab56b3b196f4 with identifier: NS51143
2026-04-27 08:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359aa396-39ea-5901-8b76-ab56b3b196f4 with scrape type 1
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_5a0c3ddb1f44574e77ca2e64a149b99c.jpg not downloaded yet
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_8b386de1d9b534119865d381e09d9041.jpg not downloaded yet
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e6d90>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_da3d681ba3e3d101be0203708476aff6.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_8275439990fde26a63ba2e70335e0b5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN76944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_bf46f788b2152a4a6534efda41d90815.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_fc1602cbc1f23aa6869e864548927e44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_ac7e03abb26f6c466597967cf94078db.jpg not downloaded yet
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048250690>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b1de7a6ad4a1768437bdd38248703692.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1
2026-04-27 08:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1, skipping ID generation
2026-04-27 08:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 with scrape type 1
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 sending to next pipeline
2026-04-27 08:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1, identifier: VW25923
2026-04-27 08:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 with identifier: VW25923
2026-04-27 08:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 with identifier: VW25923
2026-04-27 08:04:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71955179-dfe2-5f7b-b6a6-3e4ab475b7c1 with identifier: VW25923 to the API
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b1de7a6ad4a1768437bdd38248703692.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Alcobendas',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:09:32Z',
'fuel_type': 'diesel',
'id': '71955179-dfe2-5f7b-b6a6-3e4ab475b7c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.5447,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW25923',
'listing': 'auction',
'location': 'ES, Alcobendas',
'location_confidence': 'geocoded',
'longitude': -3.6406,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 290473,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_d4394f9628f4047ac964f18ff63642c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b56e561e252d628dcbfdde8618ef7d70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_fd3b64d2e36171c57c2af12634c51e39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b43ce7765251ae1d04330b41bca489d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_afedfb8ba53e52fef497680bccc2bff1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71955179-dfe2-5f7b-b6a6-3e4ab475b7c1/71955179-dfe2-5f7b-b6a6-3e4ab475b7c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/74/83744b97849771e0d2accb2a68ba7959/pa/VW25923_b1de7a6ad4a1768437bdd38248703692.jpg',
'Width': 800}],
'postal_code': '28100',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2009-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2009}
2026-04-27 08:04:21 [auto1.es] INFO: Saving data for VW25923: {'created_time': 1777277061.676704, 'last_price_update_time': 1777277061.676714, 'has_photos': True, 'auction_closing_time': 1777302572.0}
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_58bc42d33c7f36c38e4052aa05616b42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_3dae0b27ee2524bfa252c33f2fb7adf9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_f13fbbdf310c1314b8f840641534b4fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_4392df7a901d96d58fe88599834bf325.jpg not downloaded yet
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5cd0>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_6663cdbceea1314a8abe7a679e59c340.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048572d10>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_2a4dfafe4369363e577e59f2c4c67347.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048570c10>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_8275439990fde26a63ba2e70335e0b5b.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824f810>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_bf46f788b2152a4a6534efda41d90815.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048237450>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_fc1602cbc1f23aa6869e864548927e44.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_7a5bb0d8a5dc11758c37e09fbd51a645.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_af7384aa5c2e19751d42148560c0d4bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_02be07ebfc17f24d27e022dc88d1e0a4.jpg not downloaded yet
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_8b386de1d9b534119865d381e09d9041.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_5a0c3ddb1f44574e77ca2e64a149b99c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN83337> (referer: https://www.auto1.com/v1/car-details-view/KN83337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dc9d0>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_58bc42d33c7f36c38e4052aa05616b42.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048694450>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_3dae0b27ee2524bfa252c33f2fb7adf9.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885c1d0>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_f13fbbdf310c1314b8f840641534b4fe.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_aedd6717ded38f035314481ee8ba1eb8.jpg not downloaded yet
2026-04-27 08:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_d81f8b7ccd250783b2606f8f1a5ca8a0.jpg not downloaded yet
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048582490>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_7a5bb0d8a5dc11758c37e09fbd51a645.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889e850>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_af7384aa5c2e19751d42148560c0d4bb.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a84db50>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_8b386de1d9b534119865d381e09d9041.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889e850>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_5a0c3ddb1f44574e77ca2e64a149b99c.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 489c970a-e03b-56f3-9d03-c842a1fbdb58 with identifier: KN83337
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 489c970a-e03b-56f3-9d03-c842a1fbdb58 with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_147dd8a401f690c500d28557425a575e.jpg not downloaded yet
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_0d70108dbfa0a1c16cf8c3c2a3f1a691.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_8e6448a282dafef5cb22689ee70fb32f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_f34a9df318dba3acc66a7a8ac397bc42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_6673ed1ddc478842e043fc27e1e41509.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_d110a1b90715fd997d59e1357ce93572.jpg not downloaded yet
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_4392df7a901d96d58fe88599834bf325.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_02be07ebfc17f24d27e022dc88d1e0a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_ac7e03abb26f6c466597967cf94078db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_ad6f9a79096ed69f27a8d5abef4b04a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_523edc9ed7e4640fb349dc4a959af720.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_6942e6e779b44c3290d669d51ff21f21.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_514e7b11f87b7c3ad3b21797270fdc4a.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_e345f1733a4ae50847084f4b45479279.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_03c31943bff5ac2c3ac602375a040fbc.jpg not downloaded yet
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_147dd8a401f690c500d28557425a575e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_d81f8b7ccd250783b2606f8f1a5ca8a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_aedd6717ded38f035314481ee8ba1eb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a82850>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_0d70108dbfa0a1c16cf8c3c2a3f1a691.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833b090>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_8e6448a282dafef5cb22689ee70fb32f.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4a770f9-b82b-5782-aebc-15e57e2af821
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4a770f9-b82b-5782-aebc-15e57e2af821, skipping ID generation
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4a770f9-b82b-5782-aebc-15e57e2af821 with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4a770f9-b82b-5782-aebc-15e57e2af821 sending to next pipeline
2026-04-27 08:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4a770f9-b82b-5782-aebc-15e57e2af821, identifier: VE02241
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d6e90>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_f34a9df318dba3acc66a7a8ac397bc42.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_ef42172e519612d218956a3963831440.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4a770f9-b82b-5782-aebc-15e57e2af821 with identifier: VE02241
2026-04-27 08:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4a770f9-b82b-5782-aebc-15e57e2af821 with identifier: VE02241
2026-04-27 08:04:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4a770f9-b82b-5782-aebc-15e57e2af821 with identifier: VE02241 to the API
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_8e6448a282dafef5cb22689ee70fb32f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Esquivias',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:34:18Z',
'fuel_type': 'diesel',
'id': 'e4a770f9-b82b-5782-aebc-15e57e2af821',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE02241',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Ford',
'model': 'C-Max',
'odometer': 85394,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38047,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_8e6448a282dafef5cb22689ee70fb32f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38047,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_c7b930a205d75189f7d187428aed67d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36537,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_9ea987799d4c5180caa669f17c997c28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35271,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_da3d681ba3e3d101be0203708476aff6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29752,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_6663cdbceea1314a8abe7a679e59c340.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36779,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_bf46f788b2152a4a6534efda41d90815.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34723,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_58bc42d33c7f36c38e4052aa05616b42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38103,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_7a5bb0d8a5dc11758c37e09fbd51a645.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30997,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_f13fbbdf310c1314b8f840641534b4fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4a770f9-b82b-5782-aebc-15e57e2af821/e4a770f9-b82b-5782-aebc-15e57e2af821_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49665,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img96/2a/962a3cfd09cc5ec3b86e179cd1d3c363/pa/VE02241_af7384aa5c2e19751d42148560c0d4bb.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-04-27 08:04:23 [auto1.es] INFO: Saving data for VE02241: {'created_time': 1777277063.299922, 'last_price_update_time': 1777277063.299932, 'has_photos': True, 'auction_closing_time': 1777304058.0}
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_86395680f1bd96410ab4ef0e1032047b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_d976e7ede2c06ec61cbe22ba1137897e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_6de825c3156e62b719a1e07eb237c68b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_28eb66a3502e6a10b03de9aca78a3991.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_b275e0e80ecdb332a447f2c27840d01e.jpg not downloaded yet
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH85653> (referer: https://www.auto1.com/v1/car-details-view/NH85653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870eb90>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_4392df7a901d96d58fe88599834bf325.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880cb10>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_02be07ebfc17f24d27e022dc88d1e0a4.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848e7d0>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_ac7e03abb26f6c466597967cf94078db.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048161550>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_ad6f9a79096ed69f27a8d5abef4b04a3.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048495950>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_147dd8a401f690c500d28557425a575e.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714110>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_d81f8b7ccd250783b2606f8f1a5ca8a0.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487b8cd0>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_aedd6717ded38f035314481ee8ba1eb8.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_e345f1733a4ae50847084f4b45479279.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_6942e6e779b44c3290d669d51ff21f21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_44aa44830cd31705436ab223aa560e0c.jpg not downloaded yet
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_514e7b11f87b7c3ad3b21797270fdc4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048661890>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_86395680f1bd96410ab4ef0e1032047b.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d0a10>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_d976e7ede2c06ec61cbe22ba1137897e.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a84d690>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_6de825c3156e62b719a1e07eb237c68b.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8768216-41a0-563c-a67b-3254680ad8c1
2026-04-27 08:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8768216-41a0-563c-a67b-3254680ad8c1, skipping ID generation
2026-04-27 08:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8768216-41a0-563c-a67b-3254680ad8c1 with scrape type 1
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8768216-41a0-563c-a67b-3254680ad8c1 sending to next pipeline
2026-04-27 08:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8768216-41a0-563c-a67b-3254680ad8c1, identifier: EC08619
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a8110>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_28eb66a3502e6a10b03de9aca78a3991.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db4a8de3-9a72-57c5-9529-8540d7ddd79e with identifier: NH85653
2026-04-27 08:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4a8de3-9a72-57c5-9529-8540d7ddd79e with scrape type 1
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_d86a15aa5df8334001412d590446310c.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_63e1ea03a0d5c1fdce7ca58e041d6c87.jpg not downloaded yet
2026-04-27 08:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8768216-41a0-563c-a67b-3254680ad8c1 with identifier: EC08619
2026-04-27 08:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8768216-41a0-563c-a67b-3254680ad8c1 with identifier: EC08619
2026-04-27 08:04:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8768216-41a0-563c-a67b-3254680ad8c1 with identifier: EC08619 to the API
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_6de825c3156e62b719a1e07eb237c68b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 165,
'expiration_date': '2026-04-27T15:33:19Z',
'fuel_type': 'petrol',
'id': 'e8768216-41a0-563c-a67b-3254680ad8c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC08619',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Peugeot',
'model': '3008',
'odometer': 72739,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_c27a3e36686392519cf06f090341953f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_672da276f18b2612ecc403e1c4b20cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_6de825c3156e62b719a1e07eb237c68b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_f34a9df318dba3acc66a7a8ac397bc42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_0d70108dbfa0a1c16cf8c3c2a3f1a691.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_fc1602cbc1f23aa6869e864548927e44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_2a4dfafe4369363e577e59f2c4c67347.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_8275439990fde26a63ba2e70335e0b5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_ad6f9a79096ed69f27a8d5abef4b04a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8768216-41a0-563c-a67b-3254680ad8c1/e8768216-41a0-563c-a67b-3254680ad8c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/d9/8bd972afc51167ab13c7c385f1fee531/pa/EC08619_3dae0b27ee2524bfa252c33f2fb7adf9.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2016-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-04-27 08:04:24 [auto1.es] INFO: Saving data for EC08619: {'created_time': 1777277064.274312, 'last_price_update_time': 1777277064.274325, 'has_photos': True, 'auction_closing_time': 1777303999.0}
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_03c31943bff5ac2c3ac602375a040fbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_61346b5c2e0b8012f595552d5d6fc0f6.jpg not downloaded yet
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_b275e0e80ecdb332a447f2c27840d01e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_6673ed1ddc478842e043fc27e1e41509.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_d110a1b90715fd997d59e1357ce93572.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_523edc9ed7e4640fb349dc4a959af720.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_ef42172e519612d218956a3963831440.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_afcce91d37ed94a48ccecabb0f56baaa.jpg not downloaded yet
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048629590>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_e345f1733a4ae50847084f4b45479279.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834dc10>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_6942e6e779b44c3290d669d51ff21f21.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893410>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_514e7b11f87b7c3ad3b21797270fdc4a.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_328a4703f1ad13a2fc7b38416c9677cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_5550a6539168fc50827983fc6ad18c25.jpg not downloaded yet
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_ddab236fb4920bb2467845eb9bf52276.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_552c0a59866a53228cb9066a0cff3c2b.jpg not downloaded yet
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f9790>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_03c31943bff5ac2c3ac602375a040fbc.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714b90>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_b275e0e80ecdb332a447f2c27840d01e.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487bba90>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_6673ed1ddc478842e043fc27e1e41509.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870f490>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_d110a1b90715fd997d59e1357ce93572.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487baa50>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_523edc9ed7e4640fb349dc4a959af720.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 359aa396-39ea-5901-8b76-ab56b3b196f4
2026-04-27 08:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 359aa396-39ea-5901-8b76-ab56b3b196f4, skipping ID generation
2026-04-27 08:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359aa396-39ea-5901-8b76-ab56b3b196f4 with scrape type 1
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 359aa396-39ea-5901-8b76-ab56b3b196f4 sending to next pipeline
2026-04-27 08:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 359aa396-39ea-5901-8b76-ab56b3b196f4, identifier: NS51143
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484941d0>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_ef42172e519612d218956a3963831440.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 359aa396-39ea-5901-8b76-ab56b3b196f4 with identifier: NS51143
2026-04-27 08:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 359aa396-39ea-5901-8b76-ab56b3b196f4 with identifier: NS51143
2026-04-27 08:04:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 359aa396-39ea-5901-8b76-ab56b3b196f4 with identifier: NS51143 to the API
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_523edc9ed7e4640fb349dc4a959af720.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:02:59Z',
'fuel_type': 'diesel',
'id': '359aa396-39ea-5901-8b76-ab56b3b196f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS51143',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 192352,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_5a0c3ddb1f44574e77ca2e64a149b99c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_8b386de1d9b534119865d381e09d9041.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_ac7e03abb26f6c466597967cf94078db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_4392df7a901d96d58fe88599834bf325.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_02be07ebfc17f24d27e022dc88d1e0a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_aedd6717ded38f035314481ee8ba1eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_d81f8b7ccd250783b2606f8f1a5ca8a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_6673ed1ddc478842e043fc27e1e41509.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_523edc9ed7e4640fb349dc4a959af720.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_359aa396-39ea-5901-8b76-ab56b3b196f4/359aa396-39ea-5901-8b76-ab56b3b196f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/4b/244b900fa32e12da5c31d85431d4ec20/pa/NS51143_514e7b11f87b7c3ad3b21797270fdc4a.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-04-27 08:04:25 [auto1.es] INFO: Saving data for NS51143: {'created_time': 1777277065.160722, 'last_price_update_time': 1777277065.160734, 'has_photos': True, 'auction_closing_time': 1777302179.0}
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_d86a15aa5df8334001412d590446310c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_61346b5c2e0b8012f595552d5d6fc0f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_6d4eb72ebf2eba0ee7d760c75bb4ce2a.jpg not downloaded yet
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_99e8bef2a1f93f4e32ca00747996fc90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_fc8f6be7c971a8b2ce111582cb89a4e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_73b3c89492e550c086035bd232aab815.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_44aa44830cd31705436ab223aa560e0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_63e1ea03a0d5c1fdce7ca58e041d6c87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048658a90>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_328a4703f1ad13a2fc7b38416c9677cc.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04864a8d0>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_ddab236fb4920bb2467845eb9bf52276.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_74bdb29e51184f7e56ae0cee3ecaf043.jpg not downloaded yet
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_5550a6539168fc50827983fc6ad18c25.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE59735> (referer: https://www.auto1.com/v1/car-details-view/UE59735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048165490>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_d86a15aa5df8334001412d590446310c.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5c50>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_61346b5c2e0b8012f595552d5d6fc0f6.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7cd0>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_99e8bef2a1f93f4e32ca00747996fc90.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057362510>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_fc8f6be7c971a8b2ce111582cb89a4e9.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff064b43cd0>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_73b3c89492e550c086035bd232aab815.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b
2026-04-27 08:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b, skipping ID generation
2026-04-27 08:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b with scrape type 1
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b sending to next pipeline
2026-04-27 08:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b, identifier: NU36495
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0c90>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_44aa44830cd31705436ab223aa560e0c.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3fcd0>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_63e1ea03a0d5c1fdce7ca58e041d6c87.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_577beb3072f9e67675cc7b4e16725fcd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN76944> (referer: https://www.auto1.com/v1/car-details-view/UN76944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b with identifier: NU36495
2026-04-27 08:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b with identifier: NU36495
2026-04-27 08:04:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b with identifier: NU36495 to the API
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_73b3c89492e550c086035bd232aab815.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Albacete',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:16:35Z',
'fuel_type': 'diesel',
'id': 'd0d3795d-3cba-5dd4-bf2e-9a49e0dd803b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 38.9953,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU36495',
'listing': 'auction',
'location': 'Albacete',
'location_confidence': 'geocoded',
'longitude': -1.8525,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 147177,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_fc8f6be7c971a8b2ce111582cb89a4e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_99e8bef2a1f93f4e32ca00747996fc90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_73b3c89492e550c086035bd232aab815.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_ddab236fb4920bb2467845eb9bf52276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_328a4703f1ad13a2fc7b38416c9677cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_d976e7ede2c06ec61cbe22ba1137897e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_28eb66a3502e6a10b03de9aca78a3991.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_86395680f1bd96410ab4ef0e1032047b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_7c880b638e0906c0dac1be381c79be27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b/d0d3795d-3cba-5dd4-bf2e-9a49e0dd803b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/1e/6d1e6c5a0d075a62038a5343ccff13ad/pa/NU36495_b4bc9da11ed1551db0e2aea4a56693cb.jpg',
'Width': 800}],
'postal_code': '02001',
'price': 0,
'price_includes_vat': True,
'province': 'Albacete',
'province_code': 'ES-AB',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2016-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2016}
2026-04-27 08:04:26 [auto1.es] INFO: Saving data for NU36495: {'created_time': 1777277066.317479, 'last_price_update_time': 1777277066.317493, 'has_photos': True, 'auction_closing_time': 1777302995.0}
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_afcce91d37ed94a48ccecabb0f56baaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_6994cc90a3d8727691a225e6ed2408d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_552c0a59866a53228cb9066a0cff3c2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_6d4eb72ebf2eba0ee7d760c75bb4ce2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_4192bd90fecaf02777a3cd4dba91201e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ee350>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_5550a6539168fc50827983fc6ad18c25.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3587e421-b9fc-53b6-9474-4e8081b12d80 with identifier: UE59735
2026-04-27 08:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3587e421-b9fc-53b6-9474-4e8081b12d80 with scrape type 1
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_68d426d1dfe9f8da9d45037bc521ab3d.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_ab843d9cc2256cd5f161e46c6e0680dd.jpg not downloaded yet
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048758f90>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_577beb3072f9e67675cc7b4e16725fcd.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24303877-2e60-58bb-8a6f-1022dbd0012c
2026-04-27 08:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24303877-2e60-58bb-8a6f-1022dbd0012c, skipping ID generation
2026-04-27 08:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24303877-2e60-58bb-8a6f-1022dbd0012c with scrape type 1
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24303877-2e60-58bb-8a6f-1022dbd0012c sending to next pipeline
2026-04-27 08:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24303877-2e60-58bb-8a6f-1022dbd0012c, identifier: BM51968
2026-04-27 08:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 with identifier: UN76944
2026-04-27 08:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 with scrape type 1
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ba24c32331593c5686bae06bfbce243a.jpg not downloaded yet
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_74bdb29e51184f7e56ae0cee3ecaf043.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24303877-2e60-58bb-8a6f-1022dbd0012c with identifier: BM51968
2026-04-27 08:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24303877-2e60-58bb-8a6f-1022dbd0012c with identifier: BM51968
2026-04-27 08:04:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24303877-2e60-58bb-8a6f-1022dbd0012c with identifier: BM51968 to the API
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_577beb3072f9e67675cc7b4e16725fcd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:43:03Z',
'fuel_type': 'diesel',
'id': '24303877-2e60-58bb-8a6f-1022dbd0012c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM51968',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Transit Connect',
'odometer': 266510,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_577beb3072f9e67675cc7b4e16725fcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_a4cfda678768ac2a4cc63958a4923568.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_bc57228bef0c3278a3e1972342fa04c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_92e3c2be53e627d39af7a4ce28656aee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_c987e8cddeadebbb90cb535d471d8a14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_b4cd6d08c23422c9ef1dff82a064ed98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_eaff32489418e7e00fa8c6e12fd2cd6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_5e5e5cf2da12d81e10bfe5fd4bc158ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_de0130f966f02590a4ecd96f431bdc96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24303877-2e60-58bb-8a6f-1022dbd0012c/24303877-2e60-58bb-8a6f-1022dbd0012c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/68/136808f67393f294cc2d64144693f041/pa/BM51968_68ac694b5e7f22b73d4bdea2c0525962.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-02-23',
'seats_number': 2,
'seller_name': None,
'title': 'Ford Transit Connect 1.5 TDCi EcoBlue 240 L2 Trend',
'transmission': 'manual',
'trim': '240 L2 Trend',
'year': 2022}
2026-04-27 08:04:27 [auto1.es] INFO: Saving data for BM51968: {'created_time': 1777277067.034481, 'last_price_update_time': 1777277067.034494, 'has_photos': True, 'auction_closing_time': 1777304583.0}
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894c1d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_afcce91d37ed94a48ccecabb0f56baaa.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 489c970a-e03b-56f3-9d03-c842a1fbdb58
2026-04-27 08:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 489c970a-e03b-56f3-9d03-c842a1fbdb58, skipping ID generation
2026-04-27 08:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 489c970a-e03b-56f3-9d03-c842a1fbdb58 with scrape type 1
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 489c970a-e03b-56f3-9d03-c842a1fbdb58 sending to next pipeline
2026-04-27 08:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 489c970a-e03b-56f3-9d03-c842a1fbdb58, identifier: KN83337
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824e750>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_6994cc90a3d8727691a225e6ed2408d3.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_facac25671e5e51c1b58256d5f757c3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_a0ea72546e4fb7d836f7f586b5c481e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_466d02ffaf3050ede0f39ebb61e8306a.jpg not downloaded yet
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_7ca9f9073cc28c7a141e74d8a3c82f9f.jpg not downloaded yet
2026-04-27 08:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 489c970a-e03b-56f3-9d03-c842a1fbdb58 with identifier: KN83337
2026-04-27 08:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 489c970a-e03b-56f3-9d03-c842a1fbdb58 with identifier: KN83337
2026-04-27 08:04:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 489c970a-e03b-56f3-9d03-c842a1fbdb58 with identifier: KN83337 to the API
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_afcce91d37ed94a48ccecabb0f56baaa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Granyanella',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-04-27T15:23:27Z',
'fuel_type': 'diesel',
'id': '489c970a-e03b-56f3-9d03-c842a1fbdb58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN83337',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 98290,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_147dd8a401f690c500d28557425a575e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_d110a1b90715fd997d59e1357ce93572.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_6942e6e779b44c3290d669d51ff21f21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_e345f1733a4ae50847084f4b45479279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_03c31943bff5ac2c3ac602375a040fbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_ef42172e519612d218956a3963831440.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_b275e0e80ecdb332a447f2c27840d01e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_44aa44830cd31705436ab223aa560e0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_63e1ea03a0d5c1fdce7ca58e041d6c87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_489c970a-e03b-56f3-9d03-c842a1fbdb58/489c970a-e03b-56f3-9d03-c842a1fbdb58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/66/d86606b2ca7cdcff50d752e5d2e61c8c/pa/KN83337_afcce91d37ed94a48ccecabb0f56baaa.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2017-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2017}
2026-04-27 08:04:27 [auto1.es] INFO: Saving data for KN83337: {'created_time': 1777277067.630607, 'last_price_update_time': 1777277067.630617, 'has_photos': True, 'auction_closing_time': 1777303407.0}
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d85d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_552c0a59866a53228cb9066a0cff3c2b.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487b80d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_6d4eb72ebf2eba0ee7d760c75bb4ce2a.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_c8a47b089347014cb6e82fd025e86c15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0c9991205c614ba8fb2adbb5deb20188.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837f090>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_4192bd90fecaf02777a3cd4dba91201e.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_b08c47f3d7de49b2456bc0b12eab4f3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_94b8aaaa77d662092fd5beae4e178acb.jpg not downloaded yet
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ad6762ed6ee480f8b9988f19e19535a7.jpg not downloaded yet
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487804d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_74bdb29e51184f7e56ae0cee3ecaf043.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db4a8de3-9a72-57c5-9529-8540d7ddd79e
2026-04-27 08:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db4a8de3-9a72-57c5-9529-8540d7ddd79e, skipping ID generation
2026-04-27 08:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4a8de3-9a72-57c5-9529-8540d7ddd79e with scrape type 1
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db4a8de3-9a72-57c5-9529-8540d7ddd79e sending to next pipeline
2026-04-27 08:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db4a8de3-9a72-57c5-9529-8540d7ddd79e, identifier: NH85653
2026-04-27 08:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db4a8de3-9a72-57c5-9529-8540d7ddd79e with identifier: NH85653
2026-04-27 08:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db4a8de3-9a72-57c5-9529-8540d7ddd79e with identifier: NH85653
2026-04-27 08:04:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db4a8de3-9a72-57c5-9529-8540d7ddd79e with identifier: NH85653 to the API
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_74bdb29e51184f7e56ae0cee3ecaf043.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Carpio',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:56:52Z',
'fuel_type': 'diesel',
'id': 'db4a8de3-9a72-57c5-9529-8540d7ddd79e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.9409,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH85653',
'listing': 'auction',
'location': 'ES, El Carpio',
'location_confidence': 'geocoded',
'longitude': -4.4966,
'make': 'Audi',
'model': 'A6',
'odometer': 276100,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_d86a15aa5df8334001412d590446310c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_61346b5c2e0b8012f595552d5d6fc0f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_5550a6539168fc50827983fc6ad18c25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_552c0a59866a53228cb9066a0cff3c2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_6d4eb72ebf2eba0ee7d760c75bb4ce2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db4a8de3-9a72-57c5-9529-8540d7ddd79e/db4a8de3-9a72-57c5-9529-8540d7ddd79e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/86/2586d5657d7559505e813cc7a7ced68c/pa/NH85653_74bdb29e51184f7e56ae0cee3ecaf043.jpg',
'Width': 800}],
'postal_code': '14620',
'price': 0,
'price_includes_vat': True,
'province': 'Córdoba',
'province_code': 'ES-CO',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2006-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-04-27 08:04:28 [auto1.es] INFO: Saving data for NH85653: {'created_time': 1777277068.35858, 'last_price_update_time': 1777277068.358591, 'has_photos': True, 'auction_closing_time': 1777305412.0}
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048166b10>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_facac25671e5e51c1b58256d5f757c3c.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048521990>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_a0ea72546e4fb7d836f7f586b5c481e4.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_68d426d1dfe9f8da9d45037bc521ab3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_c03b46ee166fc3e4b70e9e57ace8e043.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_117a2e0b05d87734aed55d48888e1b14.jpg not downloaded yet
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ba24c32331593c5686bae06bfbce243a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_ab843d9cc2256cd5f161e46c6e0680dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482514d0>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_c8a47b089347014cb6e82fd025e86c15.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048782590>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0c9991205c614ba8fb2adbb5deb20188.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048850190>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_b08c47f3d7de49b2456bc0b12eab4f3c.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 059de279-ee4c-59de-b645-32a17cbb958e
2026-04-27 08:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 059de279-ee4c-59de-b645-32a17cbb958e, skipping ID generation
2026-04-27 08:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059de279-ee4c-59de-b645-32a17cbb958e with scrape type 1
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 059de279-ee4c-59de-b645-32a17cbb958e sending to next pipeline
2026-04-27 08:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 059de279-ee4c-59de-b645-32a17cbb958e, identifier: VZ06023
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0e4511f917bd7cf5b53e4c19f9e1b957.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_2097f37972789a91052e3d1a475e2500.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_0830071685f0df84acc891550d13e707.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 059de279-ee4c-59de-b645-32a17cbb958e with identifier: VZ06023
2026-04-27 08:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 059de279-ee4c-59de-b645-32a17cbb958e with identifier: VZ06023
2026-04-27 08:04:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 059de279-ee4c-59de-b645-32a17cbb958e with identifier: VZ06023 to the API
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_b08c47f3d7de49b2456bc0b12eab4f3c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Hellin',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:36:40Z',
'fuel_type': 'diesel',
'id': '059de279-ee4c-59de-b645-32a17cbb958e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.5106,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ06023',
'listing': 'auction',
'location': 'ES, Hellin',
'location_confidence': 'geocoded',
'longitude': -1.701,
'make': 'Hyundai',
'model': 'i30',
'odometer': 191250,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_c8a47b089347014cb6e82fd025e86c15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_b08c47f3d7de49b2456bc0b12eab4f3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_2851f221edfb83f4ea6a567aa06ddddb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_856139eea38d53bd267dd4dfe678fad7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_8643a93f4a32550c3c7fb569746baeaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_4192bd90fecaf02777a3cd4dba91201e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_6994cc90a3d8727691a225e6ed2408d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_19345534dc8e052c0bbb392ab97d53bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_bc085499d0b29e05ed4fd16b6ec37e05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_059de279-ee4c-59de-b645-32a17cbb958e/059de279-ee4c-59de-b645-32a17cbb958e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f5/b7f505111a8172f9fde02fa6a4fc2d61/pa/VZ06023_68630608ea32c7e0ea4c184cf39d0b94.jpg',
'Width': 800}],
'postal_code': '02400',
'price': 0,
'price_includes_vat': True,
'province': 'Albacete',
'province_code': 'ES-AB',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2015-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi Tecno Bluedrive',
'transmission': 'manual',
'trim': 'Tecno Bluedrive',
'year': 2015}
2026-04-27 08:04:29 [auto1.es] INFO: Saving data for VZ06023: {'created_time': 1777277069.144671, 'last_price_update_time': 1777277069.14468, 'has_photos': True, 'auction_closing_time': 1777304200.0}
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_7ca9f9073cc28c7a141e74d8a3c82f9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_d761e790ede58cf7dcb4ee29564d0dc2.jpg not downloaded yet
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e01fbdb00cc139039cfd225a0b79d100.jpg not downloaded yet
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487b9190>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_68d426d1dfe9f8da9d45037bc521ab3d.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a95550>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ba24c32331593c5686bae06bfbce243a.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e8ad0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_ab843d9cc2256cd5f161e46c6e0680dd.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ad6762ed6ee480f8b9988f19e19535a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_94b8aaaa77d662092fd5beae4e178acb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_cda81cb094ce9d9d56b6b0d10adef459.jpg not downloaded yet
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_2b71ac257a6c38ab17a8777eb7817488.jpg not downloaded yet
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484193d0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0e4511f917bd7cf5b53e4c19f9e1b957.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_117a2e0b05d87734aed55d48888e1b14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM75877/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_466d02ffaf3050ede0f39ebb61e8306a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_c03b46ee166fc3e4b70e9e57ace8e043.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_42321ada4c1b3665c7d3e476d9348e9c.jpg not downloaded yet
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_a15835362f286f6215763b46e27bee9f.jpg not downloaded yet
2026-04-27 08:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870ff10>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_7ca9f9073cc28c7a141e74d8a3c82f9f.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_3e5b7df3b7be50e98fbcb29bcf71be8b.jpg not downloaded yet
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e2d1498a8341e10c83a945bca6624c72.jpg not downloaded yet
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e01fbdb00cc139039cfd225a0b79d100.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a0050>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ad6762ed6ee480f8b9988f19e19535a7.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048512390>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_94b8aaaa77d662092fd5beae4e178acb.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_da2a168af314dd8a5d2d4569c767c4aa.jpg not downloaded yet
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_cda81cb094ce9d9d56b6b0d10adef459.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_0830071685f0df84acc891550d13e707.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048510090>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_117a2e0b05d87734aed55d48888e1b14.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880fe90>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_466d02ffaf3050ede0f39ebb61e8306a.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a84e490>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_c03b46ee166fc3e4b70e9e57ace8e043.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_d761e790ede58cf7dcb4ee29564d0dc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_2b71ac257a6c38ab17a8777eb7817488.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048827890>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e01fbdb00cc139039cfd225a0b79d100.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e99d0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_cda81cb094ce9d9d56b6b0d10adef459.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880f050>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_0830071685f0df84acc891550d13e707.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_2097f37972789a91052e3d1a475e2500.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_3e5b7df3b7be50e98fbcb29bcf71be8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_da2a168af314dd8a5d2d4569c767c4aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057b5d510>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_d761e790ede58cf7dcb4ee29564d0dc2.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a829290>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_2b71ac257a6c38ab17a8777eb7817488.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_a15835362f286f6215763b46e27bee9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eeb90>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_2097f37972789a91052e3d1a475e2500.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e2d1498a8341e10c83a945bca6624c72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880c650>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_3e5b7df3b7be50e98fbcb29bcf71be8b.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048164d50>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_da2a168af314dd8a5d2d4569c767c4aa.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_51de3f1279aa99a99033cb342177a175.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_e46649e55915615355575f093df5e754.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_44854c343b3651bc00e7369b650b06b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_42321ada4c1b3665c7d3e476d9348e9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_56eeaeb8a5c974c012c13df28cb6d78a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048865e50>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_a15835362f286f6215763b46e27bee9f.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048852a50>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e2d1498a8341e10c83a945bca6624c72.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6
2026-04-27 08:04:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6, skipping ID generation
2026-04-27 08:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 with scrape type 1
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 sending to next pipeline
2026-04-27 08:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6, identifier: UN76944
2026-04-27 08:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 with identifier: UN76944
2026-04-27 08:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 with identifier: UN76944
2026-04-27 08:04:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 939277f9-8b42-5fa4-a30b-a4d71b3ea9a6 with identifier: UN76944 to the API
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e2d1498a8341e10c83a945bca6624c72.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Pedrola',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:06:00Z',
'fuel_type': 'diesel',
'id': '939277f9-8b42-5fa4-a30b-a4d71b3ea9a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN76944',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'MINI',
'model': 'Countryman',
'odometer': 116839,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ba24c32331593c5686bae06bfbce243a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_7ca9f9073cc28c7a141e74d8a3c82f9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_ad6762ed6ee480f8b9988f19e19535a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_117a2e0b05d87734aed55d48888e1b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_0830071685f0df84acc891550d13e707.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e01fbdb00cc139039cfd225a0b79d100.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_2b71ac257a6c38ab17a8777eb7817488.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_a15835362f286f6215763b46e27bee9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_e2d1498a8341e10c83a945bca6624c72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_939277f9-8b42-5fa4-a30b-a4d71b3ea9a6/939277f9-8b42-5fa4-a30b-a4d71b3ea9a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/78/8578e704d2190afd166bc63085e360fb/pa/UN76944_da2a168af314dd8a5d2d4569c767c4aa.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2012-08-22',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper D ALL4',
'transmission': 'manual',
'trim': 'ALL4',
'year': 2012}
2026-04-27 08:04:30 [auto1.es] INFO: Saving data for UN76944: {'created_time': 1777277070.655718, 'last_price_update_time': 1777277070.655729, 'has_photos': True, 'auction_closing_time': 1777302360.0}
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_f06726737221d2f7a15badb173d755da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_9aac115743eeca0ecdb3b041eb09332a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_3c16e01a3dd8f9d540b114901e0db5bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_13259a1806c6a2ce7179387c995294b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF85973> (referer: https://www.auto1.com/v1/car-details-view/SF85973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY57124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048564a50>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_51de3f1279aa99a99033cb342177a175.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c36d0>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_e46649e55915615355575f093df5e754.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482bb910>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_44854c343b3651bc00e7369b650b06b1.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483bbc90>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_42321ada4c1b3665c7d3e476d9348e9c.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3587e421-b9fc-53b6-9474-4e8081b12d80
2026-04-27 08:04:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3587e421-b9fc-53b6-9474-4e8081b12d80, skipping ID generation
2026-04-27 08:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3587e421-b9fc-53b6-9474-4e8081b12d80 with scrape type 1
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3587e421-b9fc-53b6-9474-4e8081b12d80 sending to next pipeline
2026-04-27 08:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3587e421-b9fc-53b6-9474-4e8081b12d80, identifier: UE59735
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048383450>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_56eeaeb8a5c974c012c13df28cb6d78a.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3587e421-b9fc-53b6-9474-4e8081b12d80 with identifier: UE59735
2026-04-27 08:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3587e421-b9fc-53b6-9474-4e8081b12d80 with identifier: UE59735
2026-04-27 08:04:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3587e421-b9fc-53b6-9474-4e8081b12d80 with identifier: UE59735 to the API
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_42321ada4c1b3665c7d3e476d9348e9c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Madrid',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:09:03Z',
'fuel_type': 'diesel',
'id': '3587e421-b9fc-53b6-9474-4e8081b12d80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE59735',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 72052,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_68d426d1dfe9f8da9d45037bc521ab3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_ab843d9cc2256cd5f161e46c6e0680dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_466d02ffaf3050ede0f39ebb61e8306a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_94b8aaaa77d662092fd5beae4e178acb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_c03b46ee166fc3e4b70e9e57ace8e043.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_2097f37972789a91052e3d1a475e2500.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_d761e790ede58cf7dcb4ee29564d0dc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_cda81cb094ce9d9d56b6b0d10adef459.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_42321ada4c1b3665c7d3e476d9348e9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3587e421-b9fc-53b6-9474-4e8081b12d80/3587e421-b9fc-53b6-9474-4e8081b12d80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/0c/f70c135e0d292cadeb3e264695b50aa7/pa/UE59735_3e5b7df3b7be50e98fbcb29bcf71be8b.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2014-08-10',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'BlueTEC AMG Line',
'year': 2014}
2026-04-27 08:04:31 [auto1.es] INFO: Saving data for UE59735: {'created_time': 1777277071.848398, 'last_price_update_time': 1777277071.848409, 'has_photos': True, 'auction_closing_time': 1777302543.0}
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_b729026e7c8ac29f4bda38841ba31930.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_151e2aab33d86503af770c048be23b5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b15d0>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_f06726737221d2f7a15badb173d755da.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894850>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_9aac115743eeca0ecdb3b041eb09332a.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ea2d0>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_3c16e01a3dd8f9d540b114901e0db5bb.jpg saved to cache
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894e90>
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_13259a1806c6a2ce7179387c995294b6.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 with identifier: SF85973
2026-04-27 08:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 with scrape type 1
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_5c509e4508990724c89c17db8ae048af.jpg not downloaded yet
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_1270c409c43380c43dd666b929446ee3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_38c8bb97aaede6e8e250488c7b40b70d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_727b7d61b0dd82917e3b77cab9849e8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_c07bf1aae2ded3e26656f5586d6ae6e6.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_adbb6a13e46e763e34f53a675b783f90.jpg not downloaded yet
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048856c10>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_b729026e7c8ac29f4bda38841ba31930.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048828d90>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_151e2aab33d86503af770c048be23b5d.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_4c3b39b7b5f26136b15038eb0b183d4d.jpg not downloaded yet
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486284d0>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_1270c409c43380c43dd666b929446ee3.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d336239-15a9-5d57-8386-c3301111d2a8
2026-04-27 08:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d336239-15a9-5d57-8386-c3301111d2a8, skipping ID generation
2026-04-27 08:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d336239-15a9-5d57-8386-c3301111d2a8 with scrape type 1
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d336239-15a9-5d57-8386-c3301111d2a8 sending to next pipeline
2026-04-27 08:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d336239-15a9-5d57-8386-c3301111d2a8, identifier: UJ65320
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6f90>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_38c8bb97aaede6e8e250488c7b40b70d.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd3bd009-8940-5699-8839-228f1a92d3a1
2026-04-27 08:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd3bd009-8940-5699-8839-228f1a92d3a1, skipping ID generation
2026-04-27 08:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3bd009-8940-5699-8839-228f1a92d3a1 with scrape type 1
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd3bd009-8940-5699-8839-228f1a92d3a1 sending to next pipeline
2026-04-27 08:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd3bd009-8940-5699-8839-228f1a92d3a1, identifier: WJ78547
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896ba10>
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_727b7d61b0dd82917e3b77cab9849e8b.jpg saved to cache
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf
2026-04-27 08:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf, skipping ID generation
2026-04-27 08:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf with scrape type 1
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf sending to next pipeline
2026-04-27 08:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf, identifier: EA09417
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_caf551b0f0475294f5c2e4d708ef5ebb.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d336239-15a9-5d57-8386-c3301111d2a8 with identifier: UJ65320
2026-04-27 08:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d336239-15a9-5d57-8386-c3301111d2a8 with identifier: UJ65320
2026-04-27 08:04:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d336239-15a9-5d57-8386-c3301111d2a8 with identifier: UJ65320 to the API
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_1270c409c43380c43dd666b929446ee3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:16:30Z',
'fuel_type': 'petrol',
'id': '9d336239-15a9-5d57-8386-c3301111d2a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ65320',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 84246,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_1270c409c43380c43dd666b929446ee3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_b729026e7c8ac29f4bda38841ba31930.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_13259a1806c6a2ce7179387c995294b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_9aac115743eeca0ecdb3b041eb09332a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_f06726737221d2f7a15badb173d755da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_56eeaeb8a5c974c012c13df28cb6d78a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_e46649e55915615355575f093df5e754.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_44854c343b3651bc00e7369b650b06b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_a0ea72546e4fb7d836f7f586b5c481e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d336239-15a9-5d57-8386-c3301111d2a8/9d336239-15a9-5d57-8386-c3301111d2a8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/22/4022d9fe3d49d94b2acaeb7667ec3f2e/pa/UJ65320_facac25671e5e51c1b58256d5f757c3c.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2022-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2022}
2026-04-27 08:04:32 [auto1.es] INFO: Saving data for UJ65320: {'created_time': 1777277072.927388, 'last_price_update_time': 1777277072.927399, 'has_photos': True, 'auction_closing_time': 1777302990.0}
2026-04-27 08:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd3bd009-8940-5699-8839-228f1a92d3a1 with identifier: WJ78547
2026-04-27 08:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd3bd009-8940-5699-8839-228f1a92d3a1 with identifier: WJ78547
2026-04-27 08:04:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd3bd009-8940-5699-8839-228f1a92d3a1 with identifier: WJ78547 to the API
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_38c8bb97aaede6e8e250488c7b40b70d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'category': None,
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 320,
'expiration_date': '2026-04-27T15:49:34Z',
'fuel_type': 'hybrid',
'id': 'dd3bd009-8940-5699-8839-228f1a92d3a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ78547',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 81128,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_38c8bb97aaede6e8e250488c7b40b70d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_151e2aab33d86503af770c048be23b5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_a48d50a8de7ffe17bfecfb66a0f8b8e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_3c16e01a3dd8f9d540b114901e0db5bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_22c3b74090dea685a67b379bfb8d1565.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_51de3f1279aa99a99033cb342177a175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_7fa0225fef662a1f97360d4b3e42a2ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0e4511f917bd7cf5b53e4c19f9e1b957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_eb928d7938d81e898d9c66f3d588c100.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd3bd009-8940-5699-8839-228f1a92d3a1/dd3bd009-8940-5699-8839-228f1a92d3a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/55/ef55e3ae1077b2fb59bae7c9dc324484/pa/WJ78547_0c9991205c614ba8fb2adbb5deb20188.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 de 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-04-27 08:04:33 [auto1.es] INFO: Saving data for WJ78547: {'created_time': 1777277073.30752, 'last_price_update_time': 1777277073.30753, 'has_photos': True, 'auction_closing_time': 1777304974.0}
2026-04-27 08:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf with identifier: EA09417
2026-04-27 08:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf with identifier: EA09417
2026-04-27 08:04:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf with identifier: EA09417 to the API
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_727b7d61b0dd82917e3b77cab9849e8b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'Esquivias',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:09:01Z',
'fuel_type': 'diesel',
'id': '34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA09417',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 84822,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57740,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_727b7d61b0dd82917e3b77cab9849e8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57740,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_461323fc44b3c8fbf05a57614a7d556a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56318,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_8c1b147ce6c6d70ba273cc10bd3a6939.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53957,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_28340bbfc4435504b7ca335d8b37344d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53969,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_078ef81f72d5f363b1a8bc9fadb6e9e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59748,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_ba974af8187f620671c1df050b38bf34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48936,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_d118bfc0f476db3317b84b85f4603816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60135,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_7818f276ba205c3593e7984e30b3b124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61336,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_6dbab68557a37fce0754c7c630b35387.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf/34cd5c1d-9d5d-5e8f-9214-065b98a0e1cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52102,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img79/6b/796b38e9e133b9aea156b0a68357afec/pa/EA09417_3e6da0c1d2444b823aaee1f4ed96dfb0.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2014-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 e-HDi Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2014}
2026-04-27 08:04:33 [auto1.es] INFO: Saving data for EA09417: {'created_time': 1777277073.627679, 'last_price_update_time': 1777277073.627691, 'has_photos': True, 'auction_closing_time': 1777302541.0}
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_ba34df1f82cc398e15ed106288985132.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_0a550dab2468fff5fc2cb9aed113a073.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b95b6513ad09c6aac576ce34d6e64cf4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_b890685f5010e067a324ac8eb9c51d7f.jpg not downloaded yet
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX06881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f1c50>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-04-27 08:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16f40dd9-f338-53dc-a570-18783f81aae3, skipping ID generation
2026-04-27 08:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f40dd9-f338-53dc-a570-18783f81aae3 with scrape type 1
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16f40dd9-f338-53dc-a570-18783f81aae3 sending to next pipeline
2026-04-27 08:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16f40dd9-f338-53dc-a570-18783f81aae3, identifier: ZK42012
2026-04-27 08:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG52049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012
2026-04-27 08:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012
2026-04-27 08:04:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012 to the API
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Colloto, Oviedo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:34:03Z',
'fuel_type': 'diesel',
'id': '16f40dd9-f338-53dc-a570-18783f81aae3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK42012',
'listing': 'auction',
'location': 'ES, Colloto, Oviedo',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X3',
'odometer': 361695,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-04-27 08:04:34 [auto1.es] INFO: Saving data for ZK42012: {'created_time': 1777277074.174788, 'last_price_update_time': 1777277074.174799, 'has_photos': True, 'auction_closing_time': 1777304043.0}
2026-04-27 08:04:34 [scrapy.extensions.logstats] INFO: Crawled 438 pages (at 42 pages/min), scraped 507 items (at 32 items/min)
2026-04-27 08:04:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_adbb6a13e46e763e34f53a675b783f90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057514350>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_ba34df1f82cc398e15ed106288985132.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0699ef3-3c5e-5730-8300-b41462709556
2026-04-27 08:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0699ef3-3c5e-5730-8300-b41462709556, skipping ID generation
2026-04-27 08:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0699ef3-3c5e-5730-8300-b41462709556 with scrape type 1
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0699ef3-3c5e-5730-8300-b41462709556 sending to next pipeline
2026-04-27 08:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d0699ef3-3c5e-5730-8300-b41462709556, identifier: JF88454
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482100d0>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_0a550dab2468fff5fc2cb9aed113a073.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b96d0>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b95b6513ad09c6aac576ce34d6e64cf4.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU27127> (referer: https://www.auto1.com/v1/car-details-view/TU27127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d0699ef3-3c5e-5730-8300-b41462709556 with identifier: JF88454
2026-04-27 08:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d0699ef3-3c5e-5730-8300-b41462709556 with identifier: JF88454
2026-04-27 08:04:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d0699ef3-3c5e-5730-8300-b41462709556 with identifier: JF88454 to the API
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_ba34df1f82cc398e15ed106288985132.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Calaf',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:17:12Z',
'fuel_type': 'petrol',
'id': 'd0699ef3-3c5e-5730-8300-b41462709556',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF88454',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Peugeot',
'model': '3008',
'odometer': 75845,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9b00c61b55da46644a02cbdfc53b72b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_ba34df1f82cc398e15ed106288985132.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_df9f2e6c726a90255226148c5d2e187e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_9a13f3fc830ca407043f531fd7c3e196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c5f1d506fcaa4268744376fe18b12f44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_4c257906bf4fc7e5654d195098ceaf2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_a9943479f63f4d2568d7dce26219cb89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_06de05c4af1ab7c7f84c6129783fb966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_c2ff52065c6b5dae418eab6f803a826b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0699ef3-3c5e-5730-8300-b41462709556/d0699ef3-3c5e-5730-8300-b41462709556_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/81/ca816745ee11690e9d92595e725b16a4/pa/JF88454_dbd2483cb71ce6d8e7ff9652c51c34bf.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2019-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 e-THP GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2019}
2026-04-27 08:04:34 [auto1.es] INFO: Saving data for JF88454: {'created_time': 1777277074.781962, 'last_price_update_time': 1777277074.781979, 'has_photos': True, 'auction_closing_time': 1777303032.0}
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_caf551b0f0475294f5c2e4d708ef5ebb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_b890685f5010e067a324ac8eb9c51d7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_5c509e4508990724c89c17db8ae048af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_4c3b39b7b5f26136b15038eb0b183d4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_c07bf1aae2ded3e26656f5586d6ae6e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN96024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048252f50>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_adbb6a13e46e763e34f53a675b783f90.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ee8c567-fdf5-5e75-a66c-5b921f57a183 with identifier: TU27127
2026-04-27 08:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183 with scrape type 1
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_d2bcff98a7c50737a212773d25466c15.jpg not downloaded yet
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_798c0c3d1a72107016e57ca9b8745fdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_81938f4c691eb848f2317e178bb3f2b8.jpg not downloaded yet
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c0910>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_caf551b0f0475294f5c2e4d708ef5ebb.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842b050>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_b890685f5010e067a324ac8eb9c51d7f.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572278d0>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_5c509e4508990724c89c17db8ae048af.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c8c50>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_4c3b39b7b5f26136b15038eb0b183d4d.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ecad0>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_c07bf1aae2ded3e26656f5586d6ae6e6.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25
2026-04-27 08:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ab4f442-fcb6-5e27-aeea-80aea6f6de25, skipping ID generation
2026-04-27 08:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 with scrape type 1
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 sending to next pipeline
2026-04-27 08:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4ab4f442-fcb6-5e27-aeea-80aea6f6de25, identifier: SF85973
2026-04-27 08:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 with identifier: SF85973
2026-04-27 08:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 with identifier: SF85973
2026-04-27 08:04:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4ab4f442-fcb6-5e27-aeea-80aea6f6de25 with identifier: SF85973 to the API
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_c07bf1aae2ded3e26656f5586d6ae6e6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '2.0L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:09:49Z',
'fuel_type': 'diesel',
'id': '4ab4f442-fcb6-5e27-aeea-80aea6f6de25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF85973',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Peugeot',
'model': '306',
'odometer': 224682,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_5c509e4508990724c89c17db8ae048af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_c07bf1aae2ded3e26656f5586d6ae6e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_adbb6a13e46e763e34f53a675b783f90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_4c3b39b7b5f26136b15038eb0b183d4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_caf551b0f0475294f5c2e4d708ef5ebb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ab4f442-fcb6-5e27-aeea-80aea6f6de25/4ab4f442-fcb6-5e27-aeea-80aea6f6de25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/e8/20e8d35c154a45ab1489e9129a1d0c6b/pa/SF85973_b890685f5010e067a324ac8eb9c51d7f.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2000-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 306 2.0 HDi XS',
'transmission': 'manual',
'trim': 'XS',
'year': 2000}
2026-04-27 08:04:35 [auto1.es] INFO: Saving data for SF85973: {'created_time': 1777277075.879109, 'last_price_update_time': 1777277075.879119, 'has_photos': True, 'auction_closing_time': 1777302589.0}
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_96e607072fb92773a694edaa5007a80f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_8a8638782a8e3967642e195df67fee43.jpg not downloaded yet
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_0e3c56edb11ba797044322619203e96c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_71b73b31dab68c25b07a042043f55f97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d4210>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_798c0c3d1a72107016e57ca9b8745fdb.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_e0f30682f886d83260581a527ec1d0b9.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_f6dab3d4c0291b3ae8c79f4f96f3e2c8.jpg not downloaded yet
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_4ec4d90f45f7955c31a3f357e3db91ce.jpg not downloaded yet
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6c90>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_96e607072fb92773a694edaa5007a80f.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7070970-120e-532a-9cdc-ae6509930565
2026-04-27 08:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7070970-120e-532a-9cdc-ae6509930565, skipping ID generation
2026-04-27 08:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7070970-120e-532a-9cdc-ae6509930565 with scrape type 1
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7070970-120e-532a-9cdc-ae6509930565 sending to next pipeline
2026-04-27 08:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7070970-120e-532a-9cdc-ae6509930565, identifier: MR50800
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7070970-120e-532a-9cdc-ae6509930565 with identifier: MR50800
2026-04-27 08:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7070970-120e-532a-9cdc-ae6509930565 with identifier: MR50800
2026-04-27 08:04:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7070970-120e-532a-9cdc-ae6509930565 with identifier: MR50800 to the API
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_96e607072fb92773a694edaa5007a80f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'Esquivias',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:31:55Z',
'fuel_type': 'diesel',
'id': 'f7070970-120e-532a-9cdc-ae6509930565',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR50800',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Opel',
'model': 'Mokka',
'odometer': 57773,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2079579e8556370e13efd7e290a759e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_ff6eff1bfb4cb7b2ad814678b2f5953e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_1c209889b3a7060d6f7418802bfc1af4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_538e4b0f5f9f00c05bdc5c9b31db7670.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_beaa4f98b9f7a937940bf84e56115142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_4768c17779551355c176fee8c9665ec4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_96e607072fb92773a694edaa5007a80f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_41908e2650480ac38edb002ebb880cdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_2623228dfd72e32aca91b44d386b08f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7070970-120e-532a-9cdc-ae6509930565/f7070970-120e-532a-9cdc-ae6509930565_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/bd/7ebd8b617f5592da0fe3691931b7ac06/pa/MR50800_b6c888c139bcc3a117ef2ed8565bd65d.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2015-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.6 CDTI DPF Excellence',
'transmission': 'manual',
'trim': 'Excellence',
'year': 2015}
2026-04-27 08:04:36 [auto1.es] INFO: Saving data for MR50800: {'created_time': 1777277076.474976, 'last_price_update_time': 1777277076.474986, 'has_photos': True, 'auction_closing_time': 1777303915.0}
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_81938f4c691eb848f2317e178bb3f2b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_d2bcff98a7c50737a212773d25466c15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_a5a5d90f4004c347b33d7dbef61a0e2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484eb090>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_0e3c56edb11ba797044322619203e96c.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049710c10>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_71b73b31dab68c25b07a042043f55f97.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c2b90>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_81938f4c691eb848f2317e178bb3f2b8.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048511190>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_d2bcff98a7c50737a212773d25466c15.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049711950>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_a5a5d90f4004c347b33d7dbef61a0e2b.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2
2026-04-27 08:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2, skipping ID generation
2026-04-27 08:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 with scrape type 1
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 sending to next pipeline
2026-04-27 08:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2, identifier: FM10376
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 with identifier: FM10376
2026-04-27 08:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 with identifier: FM10376
2026-04-27 08:04:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4da9ec4f-1a0c-55f7-b74b-ac3c38933de2 with identifier: FM10376 to the API
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_a5a5d90f4004c347b33d7dbef61a0e2b.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 250,
'expiration_date': '2026-04-27T15:25:35Z',
'fuel_type': 'petrol',
'id': '4da9ec4f-1a0c-55f7-b74b-ac3c38933de2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM10376',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 122195,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_4489aa07cb479a6aafd57da2cadd77f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_a5a5d90f4004c347b33d7dbef61a0e2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_6fd7d4b4c6ba7a0eada396021f7ba68f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_798c0c3d1a72107016e57ca9b8745fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_7052d47c9419887b7654da78fd2f3586.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_0a550dab2468fff5fc2cb9aed113a073.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b95b6513ad09c6aac576ce34d6e64cf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b3c570efcb37c734bb2793761e15a7f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_b9bcaea777a5a990a056ffed3e6a62bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da9ec4f-1a0c-55f7-b74b-ac3c38933de2/4da9ec4f-1a0c-55f7-b74b-ac3c38933de2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e54f4dc95c258050c5ba0008b82fb1/pa/FM10376_d72222136bcc63d8728d43987413369a.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2013-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 Turbo Sport 4x4',
'transmission': 'manual',
'trim': 'Sport 4x4',
'year': 2013}
2026-04-27 08:04:37 [auto1.es] INFO: Saving data for FM10376: {'created_time': 1777277077.163012, 'last_price_update_time': 1777277077.163021, 'has_photos': True, 'auction_closing_time': 1777303535.0}
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_4ec4d90f45f7955c31a3f357e3db91ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_e0f30682f886d83260581a527ec1d0b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_f6dab3d4c0291b3ae8c79f4f96f3e2c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_54eb3aa285813ec666a9b903f44b3d25.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_8a8638782a8e3967642e195df67fee43.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a35750>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_4ec4d90f45f7955c31a3f357e3db91ce.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824de50>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_e0f30682f886d83260581a527ec1d0b9.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_99c17298bf482e710a59cf91c96ac0e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_435c855a2d7660a7daf63faa0bc6b56d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d4e10>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_f6dab3d4c0291b3ae8c79f4f96f3e2c8.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488930d0>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_54eb3aa285813ec666a9b903f44b3d25.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_3f630637c5e356a7721cb941b8dd2037.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048864990>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_8a8638782a8e3967642e195df67fee43.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183
2026-04-27 08:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ee8c567-fdf5-5e75-a66c-5b921f57a183, skipping ID generation
2026-04-27 08:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183 with scrape type 1
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ee8c567-fdf5-5e75-a66c-5b921f57a183 sending to next pipeline
2026-04-27 08:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ee8c567-fdf5-5e75-a66c-5b921f57a183, identifier: TU27127
2026-04-27 08:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ee8c567-fdf5-5e75-a66c-5b921f57a183 with identifier: TU27127
2026-04-27 08:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ee8c567-fdf5-5e75-a66c-5b921f57a183 with identifier: TU27127
2026-04-27 08:04:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ee8c567-fdf5-5e75-a66c-5b921f57a183 with identifier: TU27127 to the API
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_8a8638782a8e3967642e195df67fee43.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'city': 'El Rebolledo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:05:22Z',
'fuel_type': 'diesel',
'id': '2ee8c567-fdf5-5e75-a66c-5b921f57a183',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU27127',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 208095,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_d2bcff98a7c50737a212773d25466c15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_81938f4c691eb848f2317e178bb3f2b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_8a8638782a8e3967642e195df67fee43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_e0f30682f886d83260581a527ec1d0b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_f6dab3d4c0291b3ae8c79f4f96f3e2c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ee8c567-fdf5-5e75-a66c-5b921f57a183/2ee8c567-fdf5-5e75-a66c-5b921f57a183_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/64/e764410b69b916ac466c3001fd62bd7f/pa/TU27127_4ec4d90f45f7955c31a3f357e3db91ce.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2009-06-16',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Classique',
'transmission': 'automatic',
'trim': 'Classique',
'year': 2009}
2026-04-27 08:04:37 [auto1.es] INFO: Saving data for TU27127: {'created_time': 1777277077.863588, 'last_price_update_time': 1777277077.863601, 'has_photos': True, 'auction_closing_time': 1777302322.0}
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_be9f30f3fe317c3668d2dac479ba4c90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483bb890>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_99c17298bf482e710a59cf91c96ac0e2.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d4bd0>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_435c855a2d7660a7daf63faa0bc6b56d.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52
2026-04-27 08:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75796c2c-b11f-5aaf-9668-fc8f5feeab52, skipping ID generation
2026-04-27 08:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with scrape type 1
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75796c2c-b11f-5aaf-9668-fc8f5feeab52 sending to next pipeline
2026-04-27 08:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75796c2c-b11f-5aaf-9668-fc8f5feeab52, identifier: WZ44927
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0fd0>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_3f630637c5e356a7721cb941b8dd2037.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 08:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927
2026-04-27 08:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927
2026-04-27 08:04:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75796c2c-b11f-5aaf-9668-fc8f5feeab52 with identifier: WZ44927 to the API
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_435c855a2d7660a7daf63faa0bc6b56d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'city': 'Aldaya',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 147,
'expiration_date': '2026-04-27T15:57:50Z',
'fuel_type': 'petrol',
'id': '75796c2c-b11f-5aaf-9668-fc8f5feeab52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ44927',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Verso',
'odometer': 210267,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_95e5fbad166dc109bedefd14d000ee32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_81ac26e20adc25916c85419f31a08f4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_ed4e9e815067f513d372c8dc48e65a0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_dd98526406a145bb13f95b1f1eb0776e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_2d49daf02370f847b08b982b8e9134c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_435c855a2d7660a7daf63faa0bc6b56d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_0e3c56edb11ba797044322619203e96c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_71b73b31dab68c25b07a042043f55f97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_a2be62596e76563e0729d104ab8cd0c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75796c2c-b11f-5aaf-9668-fc8f5feeab52/75796c2c-b11f-5aaf-9668-fc8f5feeab52_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/13/c313f44809347ded3dc388f6f77a3da3/pa/WZ44927_5fc8539620ecd615a7a692bffd22c565.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-05-07',
'seats_number': 7,
'seller_name': None,
'title': 'Toyota Verso 1.8 Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2017}
2026-04-27 08:04:38 [auto1.es] INFO: Saving data for WZ44927: {'created_time': 1777277078.589531, 'last_price_update_time': 1777277078.589541, 'has_photos': True, 'auction_closing_time': 1777305470.0}
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_e25b08573c8c0f79d2aba45fca1d4b0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048661d50>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_be9f30f3fe317c3668d2dac479ba4c90.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6261e719-0f4c-5239-998d-aa4ad793fe8e
2026-04-27 08:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6261e719-0f4c-5239-998d-aa4ad793fe8e, skipping ID generation
2026-04-27 08:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6261e719-0f4c-5239-998d-aa4ad793fe8e with scrape type 1
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6261e719-0f4c-5239-998d-aa4ad793fe8e sending to next pipeline
2026-04-27 08:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6261e719-0f4c-5239-998d-aa4ad793fe8e, identifier: VZ79262
2026-04-27 08:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262
2026-04-27 08:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262
2026-04-27 08:04:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262 to the API
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_be9f30f3fe317c3668d2dac479ba4c90.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Caldes De Malavella',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.5L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:20:22Z',
'fuel_type': 'diesel',
'id': '6261e719-0f4c-5239-998d-aa4ad793fe8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7743,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ79262',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'location_confidence': 'geocoded',
'longitude': 2.6451,
'make': 'Renault',
'model': 'Scenic',
'odometer': 224227,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_3b2822c98ad6f8a7e245dfeea10c2f26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_7cdf47086c406ab5fe91411c982af37f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_be9f30f3fe317c3668d2dac479ba4c90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_54eb3aa285813ec666a9b903f44b3d25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_8939539ab865e9f4d2abc57438077783.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6261e719-0f4c-5239-998d-aa4ad793fe8e/6261e719-0f4c-5239-998d-aa4ad793fe8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/2a/b82a43784910a5fa537cb913ed1df705/pa/VZ79262_98e43fa7b68994e90f76cb3fdb799e2c.jpg',
'Width': 800}],
'postal_code': '17455',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2007-07-03',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2007}
2026-04-27 08:04:39 [auto1.es] INFO: Saving data for VZ79262: {'created_time': 1777277079.112214, 'last_price_update_time': 1777277079.112224, 'has_photos': True, 'auction_closing_time': 1777303222.0}
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_bd54510e506b8cfd5c3be5b5ee381172.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488418d0>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_e25b08573c8c0f79d2aba45fca1d4b0e.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff05721bc50>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_bd54510e506b8cfd5c3be5b5ee381172.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_d34291e6a7e7c7a86c23c79df6062d2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_a3ac9e37649d15e235dee9d677fde38f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD74793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9f50>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_d34291e6a7e7c7a86c23c79df6062d2c.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_091791fe0eb3ea493b3d491847a0b8b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_974ffc4d531f664b3e57559580b4df17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a14d0>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_a3ac9e37649d15e235dee9d677fde38f.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_24842c09c60e24fdb1ce1175025f3b3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048593450>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_091791fe0eb3ea493b3d491847a0b8b2.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6
2026-04-27 08:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c4c72d8-eb33-5141-ad2c-fd53043480a6, skipping ID generation
2026-04-27 08:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6 with scrape type 1
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c4c72d8-eb33-5141-ad2c-fd53043480a6 sending to next pipeline
2026-04-27 08:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c4c72d8-eb33-5141-ad2c-fd53043480a6, identifier: YX28722
2026-04-27 08:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c4c72d8-eb33-5141-ad2c-fd53043480a6 with identifier: YX28722
2026-04-27 08:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c4c72d8-eb33-5141-ad2c-fd53043480a6 with identifier: YX28722
2026-04-27 08:04:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c4c72d8-eb33-5141-ad2c-fd53043480a6 with identifier: YX28722 to the API
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_091791fe0eb3ea493b3d491847a0b8b2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Araia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-04-27T15:42:36Z',
'fuel_type': 'diesel',
'id': '5c4c72d8-eb33-5141-ad2c-fd53043480a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX28722',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'BMW',
'model': '7er',
'odometer': 211029,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_091791fe0eb3ea493b3d491847a0b8b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_6cdc97d6594077d4a207d28ad43e341e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_e25b08573c8c0f79d2aba45fca1d4b0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_99c17298bf482e710a59cf91c96ac0e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_9063eef14d36135f7626b25271a5a117.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_ed2180a4b8829bdc7b11550dc67b50fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_bb2fb094bc0438cb433cf8ad08429576.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1165528fdfef5e8a3dea4173610c6bf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_1f196f8ac92df315e56eff024929af68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c4c72d8-eb33-5141-ad2c-fd53043480a6/5c4c72d8-eb33-5141-ad2c-fd53043480a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/54/8054eb9fb90b093cba5698c0f5a684ab/pa/YX28722_149df617713fcc6d43042df8337f0772.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2016-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 7er 730d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 08:04:39 [auto1.es] INFO: Saving data for YX28722: {'created_time': 1777277079.992745, 'last_price_update_time': 1777277079.992756, 'has_photos': True, 'auction_closing_time': 1777304556.0}
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_a59d35e04629b4fcc34d8d8048470eee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048641290>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_974ffc4d531f664b3e57559580b4df17.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05504285-24e6-5586-b288-13bc3c60da63
2026-04-27 08:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05504285-24e6-5586-b288-13bc3c60da63, skipping ID generation
2026-04-27 08:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05504285-24e6-5586-b288-13bc3c60da63 with scrape type 1
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05504285-24e6-5586-b288-13bc3c60da63 sending to next pipeline
2026-04-27 08:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05504285-24e6-5586-b288-13bc3c60da63, identifier: JT84996
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048841310>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_24842c09c60e24fdb1ce1175025f3b3f.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05504285-24e6-5586-b288-13bc3c60da63 with identifier: JT84996
2026-04-27 08:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05504285-24e6-5586-b288-13bc3c60da63 with identifier: JT84996
2026-04-27 08:04:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05504285-24e6-5586-b288-13bc3c60da63 with identifier: JT84996 to the API
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_974ffc4d531f664b3e57559580b4df17.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO N\\/A',
'engine': '3.2L',
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:23:07Z',
'fuel_type': 'diesel',
'id': '05504285-24e6-5586-b288-13bc3c60da63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT84996',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Mitsubishi',
'model': 'Pajero',
'odometer': 548181,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_974ffc4d531f664b3e57559580b4df17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_d34291e6a7e7c7a86c23c79df6062d2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_bd54510e506b8cfd5c3be5b5ee381172.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_3f630637c5e356a7721cb941b8dd2037.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_fa54c77d335094140ac0ca4661ad9200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_08c92f4bb5a56dd3406a2257f021ac4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_f0ad8cbeee64ebe308b9229d30ba692d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_1e1c520bbddc1c811fd3e5da967e3ced.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_824488681e47b9707e8b861cac0d2a07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05504285-24e6-5586-b288-13bc3c60da63/05504285-24e6-5586-b288-13bc3c60da63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/91/b991021b6108b32cc469b6582df6ccb1/pa/JT84996_a8efc15c50fcf103e2cb1c138cb8612f.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2007-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Pajero 3.2 DI-D Kaiteki',
'transmission': 'automatic',
'trim': 'Kaiteki',
'year': 2007}
2026-04-27 08:04:40 [auto1.es] INFO: Saving data for JT84996: {'created_time': 1777277080.510448, 'last_price_update_time': 1777277080.510462, 'has_photos': True, 'auction_closing_time': 1777303387.0}
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a19c90>
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_a59d35e04629b4fcc34d8d8048470eee.jpg saved to cache
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 08:04:40 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2031 | hits on page: 40
2026-04-27 08:04:40 [auto1.es] INFO: Found listing with ID: UP52460
2026-04-27 08:04:40 [auto1.es] INFO: Scrape type for UP52460: 0
2026-04-27 08:04:40 [auto1.es] INFO: Found listing with ID: EC08619
2026-04-27 08:04:40 [auto1.es] INFO: Scrape type for EC08619: 0
2026-04-27 08:04:40 [auto1.es] INFO: Found listing with ID: WT19992
2026-04-27 08:04:40 [auto1.es] INFO: Scrape type for WT19992: 0
2026-04-27 08:04:40 [auto1.es] INFO: Found listing with ID: YH52314
2026-04-27 08:04:40 [auto1.es] INFO: Scrape type for YH52314: 0
2026-04-27 08:04:40 [auto1.es] INFO: Found listing with ID: ZV04953
2026-04-27 08:04:40 [auto1.es] INFO: Scrape type for ZV04953: 2
2026-04-27 08:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe3209e-907d-54bc-914a-254c87fd458e with identifier: ZV04953
2026-04-27 08:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe3209e-907d-54bc-914a-254c87fd458e with scrape type 2
2026-04-27 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfe3209e-907d-54bc-914a-254c87fd458e with scrape type 2
2026-04-27 08:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfe3209e-907d-54bc-914a-254c87fd458e, identifier: ZV04953
2026-04-27 08:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfe3209e-907d-54bc-914a-254c87fd458e with identifier: ZV04953
2026-04-27 08:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfe3209e-907d-54bc-914a-254c87fd458e with identifier: ZV04953
2026-04-27 08:04:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bfe3209e-907d-54bc-914a-254c87fd458e with identifier: ZV04953 to the API
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:21:55Z',
'fuel_type': 'diesel',
'id': 'bfe3209e-907d-54bc-914a-254c87fd458e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV04953',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jeep',
'model': 'Renegade',
'odometer': 236876,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-05-27',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2015}
2026-04-27 08:04:41 [auto1.es] INFO: Saving data for ZV04953: {'auction_closing_time': 1777303315.0, 'created_time': 1777018296.444806, 'has_photos': True, 'last_price_update_time': 1777277081.030443}
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_f92d164f9cf1ba647b4770e5ed2023f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: ZG64756
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for ZG64756: 1
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_00097001e447f2fa43dd80a7825a1397.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: SJ06028
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for SJ06028: 2
2026-04-27 08:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73 with identifier: SJ06028
2026-04-27 08:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73 with scrape type 2
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73 with scrape type 2
2026-04-27 08:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73, identifier: SJ06028
2026-04-27 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX06881> (referer: https://www.auto1.com/v1/car-details-view/EX06881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73 with identifier: SJ06028
2026-04-27 08:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73 with identifier: SJ06028
2026-04-27 08:04:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73 with identifier: SJ06028 to the API
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:36:18Z',
'fuel_type': 'diesel',
'id': 'a461db4d-3c9e-5c0f-84a9-02f4b6a8ba73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ06028',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 186757,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-12-11',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2016}
2026-04-27 08:04:41 [auto1.es] INFO: Saving data for SJ06028: {'auction_closing_time': 1777304178.0, 'created_time': 1777018850.551288, 'has_photos': True, 'last_price_update_time': 1777277081.450814}
2026-04-27 08:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: HT01986
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for HT01986: 1
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048854b50>
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_f92d164f9cf1ba647b4770e5ed2023f5.jpg saved to cache
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dcbd0>
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_00097001e447f2fa43dd80a7825a1397.jpg saved to cache
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: ZW86985
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for ZW86985: 1
2026-04-27 08:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20f6a285-f842-59c9-91d0-23069a183cf2 with identifier: EX06881
2026-04-27 08:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f6a285-f842-59c9-91d0-23069a183cf2 with scrape type 1
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_c80b5a33755556c6e5428eaea5ab044b.jpg not downloaded yet
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: BA39577
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for BA39577: 1
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_2500716f82bad01cb81b585cd32c4029.jpg not downloaded yet
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: NR04430
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for NR04430: 1
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_87c3d50abd31c319c2586136776cc169.jpg not downloaded yet
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: VE80473
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for VE80473: 1
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_e1b4cba216219ae08579507ce7502704.jpg not downloaded yet
2026-04-27 08:04:41 [auto1.es] INFO: Found listing with ID: UE13603
2026-04-27 08:04:41 [auto1.es] INFO: Scrape type for UE13603: 2
2026-04-27 08:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0b52f2-b3d3-555d-a42a-dc698d806d72 with identifier: UE13603
2026-04-27 08:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0b52f2-b3d3-555d-a42a-dc698d806d72 with scrape type 2
2026-04-27 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0b52f2-b3d3-555d-a42a-dc698d806d72 with scrape type 2
2026-04-27 08:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b0b52f2-b3d3-555d-a42a-dc698d806d72, identifier: UE13603
2026-04-27 08:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b0b52f2-b3d3-555d-a42a-dc698d806d72 with identifier: UE13603
2026-04-27 08:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b0b52f2-b3d3-555d-a42a-dc698d806d72 with identifier: UE13603
2026-04-27 08:04:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b0b52f2-b3d3-555d-a42a-dc698d806d72 with identifier: UE13603 to the API
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:16:57Z',
'fuel_type': 'diesel',
'id': '6b0b52f2-b3d3-555d-a42a-dc698d806d72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE13603',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 185097,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-13',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': 'BlueTEC Avantgarde',
'year': 2016}
2026-04-27 08:04:42 [auto1.es] INFO: Saving data for UE13603: {'auction_closing_time': 1777303017.0, 'created_time': 1777018500.306229, 'has_photos': True, 'last_price_update_time': 1777277082.205574}
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_5a138b68f0036d6a6a53337ae12c08d1.jpg not downloaded yet
2026-04-27 08:04:42 [auto1.es] INFO: Found listing with ID: NC16015
2026-04-27 08:04:42 [auto1.es] INFO: Scrape type for NC16015: 1
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_711c53001c0d849edeff522fc485f615.jpg not downloaded yet
2026-04-27 08:04:42 [auto1.es] INFO: Found listing with ID: XA83192
2026-04-27 08:04:42 [auto1.es] INFO: Scrape type for XA83192: 1
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_23d6fc22b4844640a27ee6236e5ce617.jpg not downloaded yet
2026-04-27 08:04:42 [auto1.es] INFO: Found listing with ID: ZT17368
2026-04-27 08:04:42 [auto1.es] INFO: Scrape type for ZT17368: 2
2026-04-27 08:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640fe516-efac-5ecc-9ec6-0c971fde9457 with identifier: ZT17368
2026-04-27 08:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640fe516-efac-5ecc-9ec6-0c971fde9457 with scrape type 2
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 640fe516-efac-5ecc-9ec6-0c971fde9457 with scrape type 2
2026-04-27 08:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 640fe516-efac-5ecc-9ec6-0c971fde9457, identifier: ZT17368
2026-04-27 08:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 640fe516-efac-5ecc-9ec6-0c971fde9457 with identifier: ZT17368
2026-04-27 08:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 640fe516-efac-5ecc-9ec6-0c971fde9457 with identifier: ZT17368
2026-04-27 08:04:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 640fe516-efac-5ecc-9ec6-0c971fde9457 with identifier: ZT17368 to the API
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 203,
'expiration_date': '2026-04-27T15:01:25Z',
'fuel_type': 'hybrid',
'id': '640fe516-efac-5ecc-9ec6-0c971fde9457',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT17368',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 231536,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-07',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 PHEV Kaiteki 4WD',
'transmission': 'automatic',
'trim': 'Kaiteki 4WD',
'year': 2015}
2026-04-27 08:04:42 [auto1.es] INFO: Saving data for ZT17368: {'auction_closing_time': 1777302085.0, 'created_time': 1776940937.1064, 'has_photos': True, 'last_price_update_time': 1777277082.687931}
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_98555c9704d42cd07871372450e0d891.jpg not downloaded yet
2026-04-27 08:04:42 [auto1.es] INFO: Found listing with ID: DY05255
2026-04-27 08:04:42 [auto1.es] INFO: Scrape type for DY05255: 2
2026-04-27 08:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2beda17-2564-5563-889c-9c33b79fd805 with identifier: DY05255
2026-04-27 08:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2beda17-2564-5563-889c-9c33b79fd805 with scrape type 2
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2beda17-2564-5563-889c-9c33b79fd805 with scrape type 2
2026-04-27 08:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2beda17-2564-5563-889c-9c33b79fd805, identifier: DY05255
2026-04-27 08:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2beda17-2564-5563-889c-9c33b79fd805 with identifier: DY05255
2026-04-27 08:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2beda17-2564-5563-889c-9c33b79fd805 with identifier: DY05255
2026-04-27 08:04:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2beda17-2564-5563-889c-9c33b79fd805 with identifier: DY05255 to the API
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:13:53Z',
'fuel_type': 'diesel',
'id': 'f2beda17-2564-5563-889c-9c33b79fd805',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY05255',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 110043,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-03-11',
'seller_name': None,
'title': 'Ford Fiesta 1.6 TDCi Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-04-27 08:04:43 [auto1.es] INFO: Saving data for DY05255: {'auction_closing_time': 1777302833.0, 'created_time': 1777021718.067868, 'has_photos': True, 'last_price_update_time': 1777277083.138266}
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_dab2579982fa08b94fe41ae3b9f91d19.jpg not downloaded yet
2026-04-27 08:04:43 [auto1.es] INFO: Found listing with ID: WT85545
2026-04-27 08:04:43 [auto1.es] INFO: Scrape type for WT85545: 2
2026-04-27 08:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfe110ad-0fb6-5af2-937f-1eb20431da87 with identifier: WT85545
2026-04-27 08:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe110ad-0fb6-5af2-937f-1eb20431da87 with scrape type 2
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfe110ad-0fb6-5af2-937f-1eb20431da87 with scrape type 2
2026-04-27 08:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfe110ad-0fb6-5af2-937f-1eb20431da87, identifier: WT85545
2026-04-27 08:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfe110ad-0fb6-5af2-937f-1eb20431da87 with identifier: WT85545
2026-04-27 08:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfe110ad-0fb6-5af2-937f-1eb20431da87 with identifier: WT85545
2026-04-27 08:04:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dfe110ad-0fb6-5af2-937f-1eb20431da87 with identifier: WT85545 to the API
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 335,
'expiration_date': '2026-04-27T15:46:51Z',
'fuel_type': 'petrol',
'id': 'dfe110ad-0fb6-5af2-937f-1eb20431da87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT85545',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A8',
'odometer': 224245,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2003-05-12',
'seller_name': None,
'title': 'Audi A8 4.2 V8 quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2003}
2026-04-27 08:04:43 [auto1.es] INFO: Saving data for WT85545: {'auction_closing_time': 1777304811.0, 'created_time': 1777018539.481655, 'has_photos': True, 'last_price_update_time': 1777277083.642731}
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_3c13f1562748a852b7934c548d1f7b87.jpg not downloaded yet
2026-04-27 08:04:43 [auto1.es] INFO: Found listing with ID: HF69821
2026-04-27 08:04:43 [auto1.es] INFO: Scrape type for HF69821: 2
2026-04-27 08:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97452199-053f-5c06-bcca-919647d0e0f2 with identifier: HF69821
2026-04-27 08:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97452199-053f-5c06-bcca-919647d0e0f2 with scrape type 2
2026-04-27 08:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97452199-053f-5c06-bcca-919647d0e0f2 with scrape type 2
2026-04-27 08:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97452199-053f-5c06-bcca-919647d0e0f2, identifier: HF69821
2026-04-27 08:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97452199-053f-5c06-bcca-919647d0e0f2 with identifier: HF69821
2026-04-27 08:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97452199-053f-5c06-bcca-919647d0e0f2 with identifier: HF69821
2026-04-27 08:04:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97452199-053f-5c06-bcca-919647d0e0f2 with identifier: HF69821 to the API
2026-04-27 08:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:00:30Z',
'fuel_type': 'diesel',
'id': '97452199-053f-5c06-bcca-919647d0e0f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF69821',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 81389,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-12-20',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-04-27 08:04:44 [auto1.es] INFO: Saving data for HF69821: {'auction_closing_time': 1777302030.0, 'created_time': 1776940984.245663, 'has_photos': True, 'last_price_update_time': 1777277084.184758}
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: JA33031
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for JA33031: 1
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: BU73353
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for BU73353: 2
2026-04-27 08:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4aa3135-f790-5d10-a6b1-ff8c889b7af9 with identifier: BU73353
2026-04-27 08:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4aa3135-f790-5d10-a6b1-ff8c889b7af9 with scrape type 2
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4aa3135-f790-5d10-a6b1-ff8c889b7af9 with scrape type 2
2026-04-27 08:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4aa3135-f790-5d10-a6b1-ff8c889b7af9, identifier: BU73353
2026-04-27 08:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4aa3135-f790-5d10-a6b1-ff8c889b7af9 with identifier: BU73353
2026-04-27 08:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4aa3135-f790-5d10-a6b1-ff8c889b7af9 with identifier: BU73353
2026-04-27 08:04:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4aa3135-f790-5d10-a6b1-ff8c889b7af9 with identifier: BU73353 to the API
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-04-27T15:44:11Z',
'fuel_type': 'petrol',
'id': 'c4aa3135-f790-5d10-a6b1-ff8c889b7af9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU73353',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'i10',
'odometer': 43913,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-11-28',
'seller_name': None,
'title': 'Hyundai i10 1.0 Klass',
'transmission': 'manual',
'trim': 'Klass',
'year': 2022}
2026-04-27 08:04:44 [auto1.es] INFO: Saving data for BU73353: {'auction_closing_time': 1777304651.0, 'created_time': 1777018541.754962, 'has_photos': True, 'last_price_update_time': 1777277084.644911}
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: AU01953
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for AU01953: 1
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: WC74373
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for WC74373: 1
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: WS87061
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for WS87061: 1
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: YK45669
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for YK45669: 1
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: HT15109
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for HT15109: 1
2026-04-27 08:04:44 [auto1.es] INFO: Found listing with ID: JE02215
2026-04-27 08:04:44 [auto1.es] INFO: Scrape type for JE02215: 2
2026-04-27 08:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0 with identifier: JE02215
2026-04-27 08:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0 with scrape type 2
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0 with scrape type 2
2026-04-27 08:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0, identifier: JE02215
2026-04-27 08:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0 with identifier: JE02215
2026-04-27 08:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0 with identifier: JE02215
2026-04-27 08:04:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0 with identifier: JE02215 to the API
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:03:07Z',
'fuel_type': 'diesel',
'id': 'a7888e1c-bfae-5bbb-8e36-7d6bb72eb0a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE02215',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 180322,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-08-18',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Advance BlueMotion Tech',
'transmission': 'manual',
'trim': 'Advance BlueMotion Tech',
'year': 2011}
2026-04-27 08:04:45 [auto1.es] INFO: Saving data for JE02215: {'auction_closing_time': 1777302187.0, 'created_time': 1777020585.916268, 'has_photos': True, 'last_price_update_time': 1777277085.17328}
2026-04-27 08:04:45 [auto1.es] INFO: Found listing with ID: LA91649
2026-04-27 08:04:45 [auto1.es] INFO: Scrape type for LA91649: 1
2026-04-27 08:04:45 [auto1.es] INFO: Found listing with ID: TZ82632
2026-04-27 08:04:45 [auto1.es] INFO: Scrape type for TZ82632: 1
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ73279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:45 [auto1.es] INFO: Found listing with ID: MA92923
2026-04-27 08:04:45 [auto1.es] INFO: Scrape type for MA92923: 1
2026-04-27 08:04:45 [auto1.es] INFO: Found listing with ID: HD76049
2026-04-27 08:04:45 [auto1.es] INFO: Scrape type for HD76049: 2
2026-04-27 08:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f8f62b-ae6d-5f88-b21b-b5a529c044d2 with identifier: HD76049
2026-04-27 08:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f8f62b-ae6d-5f88-b21b-b5a529c044d2 with scrape type 2
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4f8f62b-ae6d-5f88-b21b-b5a529c044d2 with scrape type 2
2026-04-27 08:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4f8f62b-ae6d-5f88-b21b-b5a529c044d2, identifier: HD76049
2026-04-27 08:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4f8f62b-ae6d-5f88-b21b-b5a529c044d2 with identifier: HD76049
2026-04-27 08:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4f8f62b-ae6d-5f88-b21b-b5a529c044d2 with identifier: HD76049
2026-04-27 08:04:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4f8f62b-ae6d-5f88-b21b-b5a529c044d2 with identifier: HD76049 to the API
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:09:25Z',
'fuel_type': 'diesel',
'id': 'f4f8f62b-ae6d-5f88-b21b-b5a529c044d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD76049',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 205948,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-04-26',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-04-27 08:04:45 [auto1.es] INFO: Saving data for HD76049: {'auction_closing_time': 1777302565.0, 'created_time': 1777018202.399152, 'has_photos': True, 'last_price_update_time': 1777277085.637654}
2026-04-27 08:04:45 [auto1.es] INFO: Found listing with ID: HC61336
2026-04-27 08:04:45 [auto1.es] INFO: Scrape type for HC61336: 2
2026-04-27 08:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5 with identifier: HC61336
2026-04-27 08:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5 with scrape type 2
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5 with scrape type 2
2026-04-27 08:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5, identifier: HC61336
2026-04-27 08:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5 with identifier: HC61336
2026-04-27 08:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5 with identifier: HC61336
2026-04-27 08:04:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5 with identifier: HC61336 to the API
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:30:16Z',
'fuel_type': 'diesel',
'id': '4a6f5c28-dbb0-5c54-9241-a1bcd08cd0c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC61336',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 146075,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-11-26',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2009}
2026-04-27 08:04:46 [auto1.es] INFO: Saving data for HC61336: {'auction_closing_time': 1777303816.0, 'created_time': 1777020873.089125, 'has_photos': True, 'last_price_update_time': 1777277086.12764}
2026-04-27 08:04:46 [auto1.es] INFO: Found listing with ID: YK11876
2026-04-27 08:04:46 [auto1.es] INFO: Scrape type for YK11876: 1
2026-04-27 08:04:46 [auto1.es] INFO: Found listing with ID: MF48856
2026-04-27 08:04:46 [auto1.es] INFO: Scrape type for MF48856: 1
2026-04-27 08:04:46 [auto1.es] INFO: Found listing with ID: JD44548
2026-04-27 08:04:46 [auto1.es] INFO: Scrape type for JD44548: 2
2026-04-27 08:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3378d33a-ed4e-5b00-9b8b-776fd83035ea with identifier: JD44548
2026-04-27 08:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3378d33a-ed4e-5b00-9b8b-776fd83035ea with scrape type 2
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3378d33a-ed4e-5b00-9b8b-776fd83035ea with scrape type 2
2026-04-27 08:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3378d33a-ed4e-5b00-9b8b-776fd83035ea, identifier: JD44548
2026-04-27 08:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3378d33a-ed4e-5b00-9b8b-776fd83035ea with identifier: JD44548
2026-04-27 08:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3378d33a-ed4e-5b00-9b8b-776fd83035ea with identifier: JD44548
2026-04-27 08:04:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3378d33a-ed4e-5b00-9b8b-776fd83035ea with identifier: JD44548 to the API
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:44:58Z',
'fuel_type': 'petrol',
'id': '3378d33a-ed4e-5b00-9b8b-776fd83035ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD44548',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 187049,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-04-30',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-04-27 08:04:46 [auto1.es] INFO: Saving data for JD44548: {'auction_closing_time': 1777304698.0, 'created_time': 1777018656.630861, 'has_photos': True, 'last_price_update_time': 1777277086.610615}
2026-04-27 08:04:46 [auto1.es] INFO: Found listing with ID: AC38853
2026-04-27 08:04:46 [auto1.es] INFO: Scrape type for AC38853: 2
2026-04-27 08:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58527335-e83b-5c0e-9d05-08de24ce892d with identifier: AC38853
2026-04-27 08:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58527335-e83b-5c0e-9d05-08de24ce892d with scrape type 2
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58527335-e83b-5c0e-9d05-08de24ce892d with scrape type 2
2026-04-27 08:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58527335-e83b-5c0e-9d05-08de24ce892d, identifier: AC38853
2026-04-27 08:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58527335-e83b-5c0e-9d05-08de24ce892d with identifier: AC38853
2026-04-27 08:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58527335-e83b-5c0e-9d05-08de24ce892d with identifier: AC38853
2026-04-27 08:04:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58527335-e83b-5c0e-9d05-08de24ce892d with identifier: AC38853 to the API
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:26:05Z',
'fuel_type': 'diesel',
'id': '58527335-e83b-5c0e-9d05-08de24ce892d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC38853',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 138609,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-11-18',
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-04-27 08:04:47 [auto1.es] INFO: Saving data for AC38853: {'auction_closing_time': 1777303565.0, 'created_time': 1777020706.423133, 'has_photos': True, 'last_price_update_time': 1777277087.028153}
2026-04-27 08:04:47 [auto1.es] INFO: Found listing with ID: XY68429
2026-04-27 08:04:47 [auto1.es] INFO: Scrape type for XY68429: 1
2026-04-27 08:04:47 [auto1.es] INFO: Found listing with ID: DN61549
2026-04-27 08:04:47 [auto1.es] INFO: Scrape type for DN61549: 2
2026-04-27 08:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1db0aee-e7b1-5142-b2f6-051642ed53ca with identifier: DN61549
2026-04-27 08:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1db0aee-e7b1-5142-b2f6-051642ed53ca with scrape type 2
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1db0aee-e7b1-5142-b2f6-051642ed53ca with scrape type 2
2026-04-27 08:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1db0aee-e7b1-5142-b2f6-051642ed53ca, identifier: DN61549
2026-04-27 08:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1db0aee-e7b1-5142-b2f6-051642ed53ca with identifier: DN61549
2026-04-27 08:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1db0aee-e7b1-5142-b2f6-051642ed53ca with identifier: DN61549
2026-04-27 08:04:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1db0aee-e7b1-5142-b2f6-051642ed53ca with identifier: DN61549 to the API
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:10:50Z',
'fuel_type': 'diesel',
'id': 'd1db0aee-e7b1-5142-b2f6-051642ed53ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN61549',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 309107,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-08',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2015}
2026-04-27 08:04:47 [auto1.es] INFO: Saving data for DN61549: {'auction_closing_time': 1777302650.0, 'created_time': 1777018575.722155, 'has_photos': True, 'last_price_update_time': 1777277087.472152}
2026-04-27 08:04:47 [auto1.es] INFO: Found listing with ID: LN46363
2026-04-27 08:04:47 [auto1.es] INFO: Scrape type for LN46363: 2
2026-04-27 08:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba2b471-56c0-52d6-9a85-04c71b9bded1 with identifier: LN46363
2026-04-27 08:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba2b471-56c0-52d6-9a85-04c71b9bded1 with scrape type 2
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba2b471-56c0-52d6-9a85-04c71b9bded1 with scrape type 2
2026-04-27 08:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cba2b471-56c0-52d6-9a85-04c71b9bded1, identifier: LN46363
2026-04-27 08:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cba2b471-56c0-52d6-9a85-04c71b9bded1 with identifier: LN46363
2026-04-27 08:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cba2b471-56c0-52d6-9a85-04c71b9bded1 with identifier: LN46363
2026-04-27 08:04:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cba2b471-56c0-52d6-9a85-04c71b9bded1 with identifier: LN46363 to the API
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-04-27T15:12:41Z',
'fuel_type': 'hybrid',
'id': 'cba2b471-56c0-52d6-9a85-04c71b9bded1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN46363',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 196414,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-08',
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2016}
2026-04-27 08:04:47 [auto1.es] INFO: Saving data for LN46363: {'auction_closing_time': 1777302761.0, 'created_time': 1777021230.42828, 'has_photos': True, 'last_price_update_time': 1777277087.937122}
2026-04-27 08:04:47 [auto1.es] INFO: Found listing with ID: VJ64682
2026-04-27 08:04:47 [auto1.es] INFO: Scrape type for VJ64682: 2
2026-04-27 08:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ab3171-2597-59e5-89ad-b21a998c6063 with identifier: VJ64682
2026-04-27 08:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ab3171-2597-59e5-89ad-b21a998c6063 with scrape type 2
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ab3171-2597-59e5-89ad-b21a998c6063 with scrape type 2
2026-04-27 08:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20ab3171-2597-59e5-89ad-b21a998c6063, identifier: VJ64682
2026-04-27 08:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20ab3171-2597-59e5-89ad-b21a998c6063 with identifier: VJ64682
2026-04-27 08:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20ab3171-2597-59e5-89ad-b21a998c6063 with identifier: VJ64682
2026-04-27 08:04:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20ab3171-2597-59e5-89ad-b21a998c6063 with identifier: VJ64682 to the API
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:08:28Z',
'fuel_type': 'diesel',
'id': '20ab3171-2597-59e5-89ad-b21a998c6063',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ64682',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 154846,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-11-16',
'seller_name': None,
'title': 'Land Rover Evoque 2.2 Td4 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2014}
2026-04-27 08:04:48 [auto1.es] INFO: Saving data for VJ64682: {'auction_closing_time': 1777302508.0, 'created_time': 1777018477.59751, 'has_photos': True, 'last_price_update_time': 1777277088.348319}
2026-04-27 08:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC65194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY57124> (referer: https://www.auto1.com/v1/car-details-view/XY57124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4660707-9073-5a47-b843-1fa393d1cbe1 with identifier: XY57124
2026-04-27 08:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4660707-9073-5a47-b843-1fa393d1cbe1 with scrape type 1
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_8a81acd4114439c0f38fd1d2192f558e.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a5f7e6149a47fff70a239dd4b142e521.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_00a44ee5bb44aaba4f99bf8457b9744b.png not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_1af223dc527f9b59f9e0dfe8a3509851.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a81ab98a2b8f698fb8a8e2e67d97fadc.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_b72ad79b0934029219cd9c827004ed8b.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_4734ca1c1098760957fd6de5797a413e.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_bd744e7e181feac7b543d1aa1acb7950.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_574a1be285e67c5e0ed1507534943349.jpg not downloaded yet
2026-04-27 08:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_2c2b9e2dcf0108071c530b20efe95dde.jpg not downloaded yet
2026-04-27 08:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD33844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_2c2b9e2dcf0108071c530b20efe95dde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865b6d0>
2026-04-27 08:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_2c2b9e2dcf0108071c530b20efe95dde.jpg saved to cache
2026-04-27 08:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL04820> (referer: https://www.auto1.com/v1/car-details-view/BL04820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_574a1be285e67c5e0ed1507534943349.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbd6c415-2297-58b2-92c9-99ea2b1c3f35 with identifier: BL04820
2026-04-27 08:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35 with scrape type 1
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_941c312451c5ffe9fb135f6ae7a96199.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_11a8319a7887fe47ad4ca17436f5aa67.jpg not downloaded yet
2026-04-27 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_bd744e7e181feac7b543d1aa1acb7950.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_df42fc46b8232a57e7dc92d6829b86b9.jpg not downloaded yet
2026-04-27 08:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_0df96eafd87848cf76989c512280a861.jpg not downloaded yet
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_54bcf9c6edc695c642f2b6e0e31ffe63.jpg not downloaded yet
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c94d0>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_574a1be285e67c5e0ed1507534943349.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_c1d739c10b14fb4e6bcf9264623a68fd.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_941c312451c5ffe9fb135f6ae7a96199.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_563a83bbf4af8598e0d9a965fa6ba89e.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME50829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_37140c61b01756b88f28166a93917cf2.jpg not downloaded yet
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37950>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_bd744e7e181feac7b543d1aa1acb7950.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_e5023a698a3f725bd01075eec6bc500b.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_54bcf9c6edc695c642f2b6e0e31ffe63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_81373129074acd2e78d3e9eb8030e390.jpg not downloaded yet
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489686d0>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_941c312451c5ffe9fb135f6ae7a96199.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_563a83bbf4af8598e0d9a965fa6ba89e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662390>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_54bcf9c6edc695c642f2b6e0e31ffe63.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e9750>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_563a83bbf4af8598e0d9a965fa6ba89e.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_e5023a698a3f725bd01075eec6bc500b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_81373129074acd2e78d3e9eb8030e390.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b85d0>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_e5023a698a3f725bd01075eec6bc500b.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_37140c61b01756b88f28166a93917cf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048166dd0>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_81373129074acd2e78d3e9eb8030e390.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_c1d739c10b14fb4e6bcf9264623a68fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG52049> (referer: https://www.auto1.com/v1/car-details-view/VG52049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cb250>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_37140c61b01756b88f28166a93917cf2.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_0df96eafd87848cf76989c512280a861.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_df42fc46b8232a57e7dc92d6829b86b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048593350>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_c1d739c10b14fb4e6bcf9264623a68fd.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27341818-a1c3-5cb1-a17d-48a8c15f8baf with identifier: VG52049
2026-04-27 08:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf with scrape type 1
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_5fa719fd1cb3bf3d03b4e8de3251991d.jpg not downloaded yet
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a07a22f5b2761405a92b41f802d04232.jpg not downloaded yet
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_6394d210c9f0b72043b81bee958f7295.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_4734ca1c1098760957fd6de5797a413e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_f2338bb9675237488b417680b7abc5dc.jpg not downloaded yet
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662c90>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_0df96eafd87848cf76989c512280a861.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_fc646a7036272be8b77048927e8ca6ab.jpg not downloaded yet
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_14ed78aac42874576368767f4f9d2f41.jpg not downloaded yet
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ecc90>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_df42fc46b8232a57e7dc92d6829b86b9.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_3e30ded1e95fa349b3a6746e8da6ee3b.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_11a8319a7887fe47ad4ca17436f5aa67.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN96024> (referer: https://www.auto1.com/v1/car-details-view/DN96024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_91da1f7ec9f6cc5ca8869185095a6499.jpg not downloaded yet
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ef8d0>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_4734ca1c1098760957fd6de5797a413e.jpg saved to cache
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_aa993427c850e92d1097adf81ded0a32.jpg not downloaded yet
2026-04-27 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a3591766a6763d5fed160fb1e941f45f.jpg not downloaded yet
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_6394d210c9f0b72043b81bee958f7295.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD74793> (referer: https://www.auto1.com/v1/car-details-view/DD74793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048510c50>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_11a8319a7887fe47ad4ca17436f5aa67.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35
2026-04-27 08:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbd6c415-2297-58b2-92c9-99ea2b1c3f35, skipping ID generation
2026-04-27 08:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35 with scrape type 1
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbd6c415-2297-58b2-92c9-99ea2b1c3f35 sending to next pipeline
2026-04-27 08:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dbd6c415-2297-58b2-92c9-99ea2b1c3f35, identifier: BL04820
2026-04-27 08:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 with identifier: DN96024
2026-04-27 08:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 with scrape type 1
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_eba8d581a648bc6e84464d7c97f922c7.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dbd6c415-2297-58b2-92c9-99ea2b1c3f35 with identifier: BL04820
2026-04-27 08:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dbd6c415-2297-58b2-92c9-99ea2b1c3f35 with identifier: BL04820
2026-04-27 08:04:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dbd6c415-2297-58b2-92c9-99ea2b1c3f35 with identifier: BL04820 to the API
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_11a8319a7887fe47ad4ca17436f5aa67.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Esquivias',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:50:54Z',
'fuel_type': 'petrol',
'id': 'dbd6c415-2297-58b2-92c9-99ea2b1c3f35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL04820',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 93070,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_941c312451c5ffe9fb135f6ae7a96199.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_11a8319a7887fe47ad4ca17436f5aa67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_df42fc46b8232a57e7dc92d6829b86b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_0df96eafd87848cf76989c512280a861.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_54bcf9c6edc695c642f2b6e0e31ffe63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_c1d739c10b14fb4e6bcf9264623a68fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_563a83bbf4af8598e0d9a965fa6ba89e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_37140c61b01756b88f28166a93917cf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_e5023a698a3f725bd01075eec6bc500b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd6c415-2297-58b2-92c9-99ea2b1c3f35/dbd6c415-2297-58b2-92c9-99ea2b1c3f35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc8/10/c8101dd559c4d70519f5aac3a2932b0d/pa/BL04820_81373129074acd2e78d3e9eb8030e390.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe SL Trotamundos',
'transmission': 'manual',
'trim': 'SL Trotamundos',
'year': 2017}
2026-04-27 08:04:58 [auto1.es] INFO: Saving data for BL04820: {'created_time': 1777277098.637756, 'last_price_update_time': 1777277098.637767, 'has_photos': True, 'auction_closing_time': 1777305054.0}
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_64d968732e52bca788d66278061d069f.jpg not downloaded yet
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_14ed78aac42874576368767f4f9d2f41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_3e30ded1e95fa349b3a6746e8da6ee3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a3591766a6763d5fed160fb1e941f45f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487595d0>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_6394d210c9f0b72043b81bee958f7295.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793
2026-04-27 08:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d3407af-7fa5-5857-b442-d36a46bcfcab with scrape type 1
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_2295d1ab35e1ea3cc21a66bbf3ebd5e8.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_3bdc9696f47be7ff4561efe6016caa7c.jpg not downloaded yet
2026-04-27 08:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE50785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_e3f67b20c799f34fdce125ed2e6cd7ed.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_aae1099bdeed2f4698e1f4ea70c8de90.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_74b80666eff44852e74d7163c4fdae16.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_d823bb1200b07db92aa2996a18ecae2f.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_76ac759932939550efa96f85feca2242.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_9fefb4179210ecc6bc8fdd82d6927849.jpg not downloaded yet
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04862b410>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_14ed78aac42874576368767f4f9d2f41.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884da50>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_3e30ded1e95fa349b3a6746e8da6ee3b.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e210>
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a3591766a6763d5fed160fb1e941f45f.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:04:58 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2031 | hits on page: 40
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_eba8d581a648bc6e84464d7c97f922c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_aa993427c850e92d1097adf81ded0a32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_0035ddf36ea06ee9cd431b059f30b72c.jpg not downloaded yet
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_91da1f7ec9f6cc5ca8869185095a6499.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_2295d1ab35e1ea3cc21a66bbf3ebd5e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_1c4d3b323d3e64038f7e263a802ac138.jpg not downloaded yet
2026-04-27 08:04:59 [auto1.es] INFO: Found listing with ID: ZC32489
2026-04-27 08:04:59 [auto1.es] INFO: Scrape type for ZC32489: 2
2026-04-27 08:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa9d593-c8f9-5545-a7d5-0b30c89452cf with identifier: ZC32489
2026-04-27 08:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa9d593-c8f9-5545-a7d5-0b30c89452cf with scrape type 2
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa9d593-c8f9-5545-a7d5-0b30c89452cf with scrape type 2
2026-04-27 08:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8fa9d593-c8f9-5545-a7d5-0b30c89452cf, identifier: ZC32489
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_64d968732e52bca788d66278061d069f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_1540a9767d4971f552d76ddaa5cc8a2b.jpg not downloaded yet
2026-04-27 08:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8fa9d593-c8f9-5545-a7d5-0b30c89452cf with identifier: ZC32489
2026-04-27 08:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8fa9d593-c8f9-5545-a7d5-0b30c89452cf with identifier: ZC32489
2026-04-27 08:04:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8fa9d593-c8f9-5545-a7d5-0b30c89452cf with identifier: ZC32489 to the API
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:09:13Z',
'fuel_type': 'diesel',
'id': '8fa9d593-c8f9-5545-a7d5-0b30c89452cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC32489',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 286612,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-10-28',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-04-27 08:04:59 [auto1.es] INFO: Saving data for ZC32489: {'auction_closing_time': 1777302553.0, 'created_time': 1777018077.038412, 'has_photos': True, 'last_price_update_time': 1777277099.45646}
2026-04-27 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_fc646a7036272be8b77048927e8ca6ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_b15656a21d5e8c7158b0569d6645b564.jpg not downloaded yet
2026-04-27 08:04:59 [auto1.es] INFO: Found listing with ID: LC96908
2026-04-27 08:04:59 [auto1.es] INFO: Scrape type for LC96908: 2
2026-04-27 08:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636dbf5b-c656-5c39-9dcd-268fa2c2fccc with identifier: LC96908
2026-04-27 08:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636dbf5b-c656-5c39-9dcd-268fa2c2fccc with scrape type 2
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 636dbf5b-c656-5c39-9dcd-268fa2c2fccc with scrape type 2
2026-04-27 08:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 636dbf5b-c656-5c39-9dcd-268fa2c2fccc, identifier: LC96908
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_99a3577dca52f5bdc412100acb622a18.jpg not downloaded yet
2026-04-27 08:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 636dbf5b-c656-5c39-9dcd-268fa2c2fccc with identifier: LC96908
2026-04-27 08:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 636dbf5b-c656-5c39-9dcd-268fa2c2fccc with identifier: LC96908
2026-04-27 08:04:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 636dbf5b-c656-5c39-9dcd-268fa2c2fccc with identifier: LC96908 to the API
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:56:40Z',
'fuel_type': 'diesel',
'id': '636dbf5b-c656-5c39-9dcd-268fa2c2fccc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC96908',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Panda',
'odometer': 166049,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-10-23',
'seller_name': None,
'title': 'Fiat Panda 1.3 JTD Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2011}
2026-04-27 08:04:59 [auto1.es] INFO: Saving data for LC96908: {'auction_closing_time': 1777305400.0, 'created_time': 1777018302.356813, 'has_photos': True, 'last_price_update_time': 1777277099.898126}
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842abd0>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_eba8d581a648bc6e84464d7c97f922c7.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931e50>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_aa993427c850e92d1097adf81ded0a32.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884c190>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_91da1f7ec9f6cc5ca8869185095a6499.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048933390>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_2295d1ab35e1ea3cc21a66bbf3ebd5e8.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_76ac759932939550efa96f85feca2242.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_c849d5f6e8ab53c599f969644cf70b3f.jpg not downloaded yet
2026-04-27 08:05:00 [auto1.es] INFO: Found listing with ID: CG39677
2026-04-27 08:05:00 [auto1.es] INFO: Scrape type for CG39677: 2
2026-04-27 08:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2335f5d3-f329-5344-aff8-d007d71fb42e with identifier: CG39677
2026-04-27 08:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2335f5d3-f329-5344-aff8-d007d71fb42e with scrape type 2
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2335f5d3-f329-5344-aff8-d007d71fb42e with scrape type 2
2026-04-27 08:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2335f5d3-f329-5344-aff8-d007d71fb42e, identifier: CG39677
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_0035ddf36ea06ee9cd431b059f30b72c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_9fefb4179210ecc6bc8fdd82d6927849.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_a2160340a090f57313043f3d0f0ae27e.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2335f5d3-f329-5344-aff8-d007d71fb42e with identifier: CG39677
2026-04-27 08:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2335f5d3-f329-5344-aff8-d007d71fb42e with identifier: CG39677
2026-04-27 08:05:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2335f5d3-f329-5344-aff8-d007d71fb42e with identifier: CG39677 to the API
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-04-27T15:14:11Z',
'fuel_type': 'petrol',
'id': '2335f5d3-f329-5344-aff8-d007d71fb42e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG39677',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 59915,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-08-23',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 VTi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2016}
2026-04-27 08:05:00 [auto1.es] INFO: Saving data for CG39677: {'auction_closing_time': 1777302851.0, 'created_time': 1777018116.406123, 'has_photos': True, 'last_price_update_time': 1777277100.876929}
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048679950>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_64d968732e52bca788d66278061d069f.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a37010>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_fc646a7036272be8b77048927e8ca6ab.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_d823bb1200b07db92aa2996a18ecae2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_33ed9a084b19bbc36b706c6433f2f6e6.jpg not downloaded yet
2026-04-27 08:05:00 [auto1.es] INFO: Found listing with ID: EA16216
2026-04-27 08:05:00 [auto1.es] INFO: Scrape type for EA16216: 1
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_1c4d3b323d3e64038f7e263a802ac138.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_b0d5ca75d62602084ef8c9b310037ae7.jpg not downloaded yet
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487afcd0>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_76ac759932939550efa96f85feca2242.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:01 [auto1.es] INFO: Found listing with ID: CA96851
2026-04-27 08:05:01 [auto1.es] INFO: Scrape type for CA96851: 1
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04839bc10>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_0035ddf36ea06ee9cd431b059f30b72c.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048782a50>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_9fefb4179210ecc6bc8fdd82d6927849.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_5b01a6e3475ec801a602c9b6e204f820.jpg not downloaded yet
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_99a3577dca52f5bdc412100acb622a18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [auto1.es] INFO: Found listing with ID: LT78270
2026-04-27 08:05:01 [auto1.es] INFO: Scrape type for LT78270: 2
2026-04-27 08:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7315832-b760-5123-a337-415ab0bd4b63 with identifier: LT78270
2026-04-27 08:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7315832-b760-5123-a337-415ab0bd4b63 with scrape type 2
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7315832-b760-5123-a337-415ab0bd4b63 with scrape type 2
2026-04-27 08:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7315832-b760-5123-a337-415ab0bd4b63, identifier: LT78270
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_b15656a21d5e8c7158b0569d6645b564.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7315832-b760-5123-a337-415ab0bd4b63 with identifier: LT78270
2026-04-27 08:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7315832-b760-5123-a337-415ab0bd4b63 with identifier: LT78270
2026-04-27 08:05:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7315832-b760-5123-a337-415ab0bd4b63 with identifier: LT78270 to the API
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:00:18Z',
'fuel_type': 'diesel',
'id': 'e7315832-b760-5123-a337-415ab0bd4b63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT78270',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ssangyong',
'model': 'Rodius',
'odometer': 195879,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-12-28',
'seller_name': None,
'title': 'Ssangyong Rodius 270 Xdi',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-04-27 08:05:01 [auto1.es] INFO: Saving data for LT78270: {'auction_closing_time': 1777302018.0, 'created_time': 1776940898.932889, 'has_photos': True, 'last_price_update_time': 1777277101.663243}
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_a2160340a090f57313043f3d0f0ae27e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [auto1.es] INFO: Found listing with ID: VY24399
2026-04-27 08:05:01 [auto1.es] INFO: Scrape type for VY24399: 1
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894390>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_d823bb1200b07db92aa2996a18ecae2f.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876c850>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_1c4d3b323d3e64038f7e263a802ac138.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_c849d5f6e8ab53c599f969644cf70b3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235690>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_99a3577dca52f5bdc412100acb622a18.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:01 [auto1.es] INFO: Found listing with ID: ZX77903
2026-04-27 08:05:01 [auto1.es] INFO: Scrape type for ZX77903: 2
2026-04-27 08:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2334998-adee-53b9-8dfe-419bfe357e58 with identifier: ZX77903
2026-04-27 08:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2334998-adee-53b9-8dfe-419bfe357e58 with scrape type 2
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2334998-adee-53b9-8dfe-419bfe357e58 with scrape type 2
2026-04-27 08:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2334998-adee-53b9-8dfe-419bfe357e58, identifier: ZX77903
2026-04-27 08:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2334998-adee-53b9-8dfe-419bfe357e58 with identifier: ZX77903
2026-04-27 08:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2334998-adee-53b9-8dfe-419bfe357e58 with identifier: ZX77903
2026-04-27 08:05:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2334998-adee-53b9-8dfe-419bfe357e58 with identifier: ZX77903 to the API
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:27:49Z',
'fuel_type': 'petrol',
'id': 'f2334998-adee-53b9-8dfe-419bfe357e58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX77903',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 262031,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-09-11',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Progression',
'transmission': 'manual',
'trim': 'Progression',
'year': 2013}
2026-04-27 08:05:02 [auto1.es] INFO: Saving data for ZX77903: {'auction_closing_time': 1777303669.0, 'created_time': 1777020629.22435, 'has_photos': True, 'last_price_update_time': 1777277102.324301}
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA91649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048694990>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_b15656a21d5e8c7158b0569d6645b564.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_5b01a6e3475ec801a602c9b6e204f820.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [auto1.es] INFO: Found listing with ID: PL00701
2026-04-27 08:05:02 [auto1.es] INFO: Scrape type for PL00701: 1
2026-04-27 08:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a35690>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_a2160340a090f57313043f3d0f0ae27e.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d0990>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_c849d5f6e8ab53c599f969644cf70b3f.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_b0d5ca75d62602084ef8c9b310037ae7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [auto1.es] INFO: Found listing with ID: KD12896
2026-04-27 08:05:02 [auto1.es] INFO: Scrape type for KD12896: 2
2026-04-27 08:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb5690c-be33-5522-bdbd-583b75c90ef9 with identifier: KD12896
2026-04-27 08:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb5690c-be33-5522-bdbd-583b75c90ef9 with scrape type 2
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb5690c-be33-5522-bdbd-583b75c90ef9 with scrape type 2
2026-04-27 08:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cb5690c-be33-5522-bdbd-583b75c90ef9, identifier: KD12896
2026-04-27 08:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cb5690c-be33-5522-bdbd-583b75c90ef9 with identifier: KD12896
2026-04-27 08:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cb5690c-be33-5522-bdbd-583b75c90ef9 with identifier: KD12896
2026-04-27 08:05:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7cb5690c-be33-5522-bdbd-583b75c90ef9 with identifier: KD12896 to the API
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 121,
'expiration_date': '2026-04-27T15:57:40Z',
'fuel_type': 'petrol',
'id': '7cb5690c-be33-5522-bdbd-583b75c90ef9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD12896',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mazda',
'model': 'CX-3',
'odometer': 111293,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-05-22',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Skyactiv-G Evolution',
'transmission': 'manual',
'trim': 'Evolution',
'year': 2019}
2026-04-27 08:05:02 [auto1.es] INFO: Saving data for KD12896: {'auction_closing_time': 1777305460.0, 'created_time': 1777021958.614292, 'has_photos': True, 'last_price_update_time': 1777277102.882465}
2026-04-27 08:05:02 [auto1.es] INFO: Found listing with ID: UD45790
2026-04-27 08:05:02 [auto1.es] INFO: Scrape type for UD45790: 1
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_33ed9a084b19bbc36b706c6433f2f6e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [auto1.es] INFO: Found listing with ID: AT47654
2026-04-27 08:05:02 [auto1.es] INFO: Scrape type for AT47654: 1
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP09139/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1fd0>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_5b01a6e3475ec801a602c9b6e204f820.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486115d0>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_b0d5ca75d62602084ef8c9b310037ae7.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:03 [auto1.es] INFO: Found listing with ID: NC98579
2026-04-27 08:05:03 [auto1.es] INFO: Scrape type for NC98579: 2
2026-04-27 08:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237 with identifier: NC98579
2026-04-27 08:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237 with scrape type 2
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237 with scrape type 2
2026-04-27 08:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237, identifier: NC98579
2026-04-27 08:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237 with identifier: NC98579
2026-04-27 08:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237 with identifier: NC98579
2026-04-27 08:05:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d9cbbaf-803d-5ea0-9ca4-7df09edbe237 with identifier: NC98579 to the API
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:31:15Z',
'fuel_type': 'diesel',
'id': '2d9cbbaf-803d-5ea0-9ca4-7df09edbe237',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC98579',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 120482,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-08-21',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Performance Line',
'transmission': 'automatic',
'trim': 'Performance Line',
'year': 2018}
2026-04-27 08:05:03 [auto1.es] INFO: Saving data for NC98579: {'auction_closing_time': 1777303875.0, 'created_time': 1777018392.244773, 'has_photos': True, 'last_price_update_time': 1777277103.441046}
2026-04-27 08:05:03 [auto1.es] INFO: Found listing with ID: MU15660
2026-04-27 08:05:03 [auto1.es] INFO: Scrape type for MU15660: 2
2026-04-27 08:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3 with identifier: MU15660
2026-04-27 08:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3 with scrape type 2
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3 with scrape type 2
2026-04-27 08:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3, identifier: MU15660
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_1540a9767d4971f552d76ddaa5cc8a2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3 with identifier: MU15660
2026-04-27 08:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3 with identifier: MU15660
2026-04-27 08:05:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92527e9b-8d4d-5641-9c3b-8c0d1eb538a3 with identifier: MU15660 to the API
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:33:33Z',
'fuel_type': 'diesel',
'id': '92527e9b-8d4d-5641-9c3b-8c0d1eb538a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU15660',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Corsa',
'odometer': 153579,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-09-30',
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2007}
2026-04-27 08:05:03 [auto1.es] INFO: Saving data for MU15660: {'auction_closing_time': 1777304013.0, 'created_time': 1777020833.864052, 'has_photos': True, 'last_price_update_time': 1777277103.963532}
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC65194> (referer: https://www.auto1.com/v1/car-details-view/GC65194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a1b750>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_33ed9a084b19bbc36b706c6433f2f6e6.jpg saved to cache
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:05:04 [auto1.es] INFO: Found listing with ID: YW28562
2026-04-27 08:05:04 [auto1.es] INFO: Scrape type for YW28562: 2
2026-04-27 08:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca with identifier: YW28562
2026-04-27 08:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca with scrape type 2
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca with scrape type 2
2026-04-27 08:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca, identifier: YW28562
2026-04-27 08:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY46229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca with identifier: YW28562
2026-04-27 08:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca with identifier: YW28562
2026-04-27 08:05:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca with identifier: YW28562 to the API
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-04-27T15:15:57Z',
'fuel_type': 'petrol',
'id': '0331bf49-90d8-5ce5-bcf9-c8bf5b5f16ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW28562',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jeep',
'model': 'Renegade',
'odometer': 14149,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-02-27',
'seller_name': None,
'title': 'Jeep Renegade 1.5 GSE T4 e-Hybrid Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2023}
2026-04-27 08:05:04 [auto1.es] INFO: Saving data for YW28562: {'auction_closing_time': 1777302957.0, 'created_time': 1777018412.92353, 'has_photos': True, 'last_price_update_time': 1777277104.418733}
2026-04-27 08:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:04 [auto1.es] INFO: Found listing with ID: YM25578
2026-04-27 08:05:04 [auto1.es] INFO: Scrape type for YM25578: 2
2026-04-27 08:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a606c8-38e6-5757-bc9f-225d81746a3c with identifier: YM25578
2026-04-27 08:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a606c8-38e6-5757-bc9f-225d81746a3c with scrape type 2
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a606c8-38e6-5757-bc9f-225d81746a3c with scrape type 2
2026-04-27 08:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f1a606c8-38e6-5757-bc9f-225d81746a3c, identifier: YM25578
2026-04-27 08:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f1a606c8-38e6-5757-bc9f-225d81746a3c with identifier: YM25578
2026-04-27 08:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f1a606c8-38e6-5757-bc9f-225d81746a3c with identifier: YM25578
2026-04-27 08:05:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f1a606c8-38e6-5757-bc9f-225d81746a3c with identifier: YM25578 to the API
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-04-27T15:44:40Z',
'fuel_type': 'petrol',
'id': 'f1a606c8-38e6-5757-bc9f-225d81746a3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM25578',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Juke',
'odometer': 197881,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-12-08',
'seller_name': None,
'title': 'Nissan Juke 1.6 Tekna Sport',
'transmission': 'manual',
'trim': 'Tekna Sport',
'year': 2010}
2026-04-27 08:05:04 [auto1.es] INFO: Saving data for YM25578: {'auction_closing_time': 1777304680.0, 'created_time': 1776940943.666578, 'has_photos': True, 'last_price_update_time': 1777277104.833487}
2026-04-27 08:05:04 [auto1.es] INFO: Found listing with ID: LN73643
2026-04-27 08:05:04 [auto1.es] INFO: Scrape type for LN73643: 2
2026-04-27 08:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850b3c93-a201-5270-a5ac-159f7182bd71 with identifier: LN73643
2026-04-27 08:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850b3c93-a201-5270-a5ac-159f7182bd71 with scrape type 2
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850b3c93-a201-5270-a5ac-159f7182bd71 with scrape type 2
2026-04-27 08:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 850b3c93-a201-5270-a5ac-159f7182bd71, identifier: LN73643
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048253d50>
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_1540a9767d4971f552d76ddaa5cc8a2b.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c98e9b62-a45f-5f57-ac0c-006e5ab153ba with identifier: GC65194
2026-04-27 08:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba with scrape type 1
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_367f90636db9233e291fc19c5b46cc5a.jpg not downloaded yet
2026-04-27 08:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 850b3c93-a201-5270-a5ac-159f7182bd71 with identifier: LN73643
2026-04-27 08:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 850b3c93-a201-5270-a5ac-159f7182bd71 with identifier: LN73643
2026-04-27 08:05:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 850b3c93-a201-5270-a5ac-159f7182bd71 with identifier: LN73643 to the API
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:32:39Z',
'fuel_type': 'diesel',
'id': '850b3c93-a201-5270-a5ac-159f7182bd71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN73643',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 240641,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-04-05',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Edition BlueMotion',
'transmission': 'automatic',
'trim': 'Edition BlueMotion',
'year': 2018}
2026-04-27 08:05:05 [auto1.es] INFO: Saving data for LN73643: {'auction_closing_time': 1777303959.0, 'created_time': 1776940936.290644, 'has_photos': True, 'last_price_update_time': 1777277105.357188}
2026-04-27 08:05:05 [auto1.es] INFO: Found listing with ID: BU99298
2026-04-27 08:05:05 [auto1.es] INFO: Scrape type for BU99298: 2
2026-04-27 08:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 403cf283-7048-525d-a9b3-3e0beea0090c with identifier: BU99298
2026-04-27 08:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 403cf283-7048-525d-a9b3-3e0beea0090c with scrape type 2
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 403cf283-7048-525d-a9b3-3e0beea0090c with scrape type 2
2026-04-27 08:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 403cf283-7048-525d-a9b3-3e0beea0090c, identifier: BU99298
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_f3a4618622d4bff182b861699e558e63.jpg not downloaded yet
2026-04-27 08:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 403cf283-7048-525d-a9b3-3e0beea0090c with identifier: BU99298
2026-04-27 08:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 403cf283-7048-525d-a9b3-3e0beea0090c with identifier: BU99298
2026-04-27 08:05:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 403cf283-7048-525d-a9b3-3e0beea0090c with identifier: BU99298 to the API
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:53:30Z',
'fuel_type': 'diesel',
'id': '403cf283-7048-525d-a9b3-3e0beea0090c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU99298',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 121565,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-01-25',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 d lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2021}
2026-04-27 08:05:05 [auto1.es] INFO: Saving data for BU99298: {'auction_closing_time': 1777305210.0, 'created_time': 1777018103.636972, 'has_photos': True, 'last_price_update_time': 1777277105.793983}
2026-04-27 08:05:05 [auto1.es] INFO: Found listing with ID: VD24782
2026-04-27 08:05:05 [auto1.es] INFO: Scrape type for VD24782: 2
2026-04-27 08:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261a430f-a7ff-5ba1-a1ae-8fbeae48a017 with identifier: VD24782
2026-04-27 08:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261a430f-a7ff-5ba1-a1ae-8fbeae48a017 with scrape type 2
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261a430f-a7ff-5ba1-a1ae-8fbeae48a017 with scrape type 2
2026-04-27 08:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 261a430f-a7ff-5ba1-a1ae-8fbeae48a017, identifier: VD24782
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_d4aa97b277663c34410dfa897b3441dd.jpg not downloaded yet
2026-04-27 08:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 261a430f-a7ff-5ba1-a1ae-8fbeae48a017 with identifier: VD24782
2026-04-27 08:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 261a430f-a7ff-5ba1-a1ae-8fbeae48a017 with identifier: VD24782
2026-04-27 08:05:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 261a430f-a7ff-5ba1-a1ae-8fbeae48a017 with identifier: VD24782 to the API
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:59:25Z',
'fuel_type': 'diesel',
'id': '261a430f-a7ff-5ba1-a1ae-8fbeae48a017',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD24782',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 352204,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-07-26',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Advance Plus',
'transmission': 'automatic',
'trim': 'Advance Plus',
'year': 2010}
2026-04-27 08:05:06 [auto1.es] INFO: Saving data for VD24782: {'auction_closing_time': 1777305565.0, 'created_time': 1777021239.367439, 'has_photos': True, 'last_price_update_time': 1777277106.262071}
2026-04-27 08:05:06 [auto1.es] INFO: Found listing with ID: BL38185
2026-04-27 08:05:06 [auto1.es] INFO: Scrape type for BL38185: 1
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_784639def12784006a002911eeb4ee9f.jpg not downloaded yet
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD33844> (referer: https://www.auto1.com/v1/car-details-view/HD33844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME50829> (referer: https://www.auto1.com/v1/car-details-view/ME50829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:06 [auto1.es] INFO: Found listing with ID: AG88258
2026-04-27 08:05:06 [auto1.es] INFO: Scrape type for AG88258: 2
2026-04-27 08:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15df5ada-8219-514d-80dc-af67fb4e55b8 with identifier: AG88258
2026-04-27 08:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15df5ada-8219-514d-80dc-af67fb4e55b8 with scrape type 2
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15df5ada-8219-514d-80dc-af67fb4e55b8 with scrape type 2
2026-04-27 08:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15df5ada-8219-514d-80dc-af67fb4e55b8, identifier: AG88258
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_31e5b53c8ab7d44a52beaabc58247649.jpg not downloaded yet
2026-04-27 08:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY68429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH13326> (referer: https://www.auto1.com/v1/car-details-view/YH13326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15df5ada-8219-514d-80dc-af67fb4e55b8 with identifier: AG88258
2026-04-27 08:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15df5ada-8219-514d-80dc-af67fb4e55b8 with identifier: AG88258
2026-04-27 08:05:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15df5ada-8219-514d-80dc-af67fb4e55b8 with identifier: AG88258 to the API
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:26:53Z',
'fuel_type': 'petrol',
'id': '15df5ada-8219-514d-80dc-af67fb4e55b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG88258',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X4',
'odometer': 121002,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-06-27',
'seller_name': None,
'title': 'BMW X4 xDrive 20i xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2017}
2026-04-27 08:05:06 [auto1.es] INFO: Saving data for AG88258: {'auction_closing_time': 1777303613.0, 'created_time': 1777021864.556085, 'has_photos': True, 'last_price_update_time': 1777277106.70418}
2026-04-27 08:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:06 [auto1.es] INFO: Found listing with ID: LA76545
2026-04-27 08:05:06 [auto1.es] INFO: Scrape type for LA76545: 2
2026-04-27 08:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6300ea80-50a7-567e-878e-dc048e155229 with identifier: LA76545
2026-04-27 08:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6300ea80-50a7-567e-878e-dc048e155229 with scrape type 2
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6300ea80-50a7-567e-878e-dc048e155229 with scrape type 2
2026-04-27 08:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6300ea80-50a7-567e-878e-dc048e155229, identifier: LA76545
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_cb3d97bd3a504a195d328e46677fdc45.jpg not downloaded yet
2026-04-27 08:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6300ea80-50a7-567e-878e-dc048e155229 with identifier: LA76545
2026-04-27 08:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6300ea80-50a7-567e-878e-dc048e155229 with identifier: LA76545
2026-04-27 08:05:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6300ea80-50a7-567e-878e-dc048e155229 with identifier: LA76545 to the API
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:26:11Z',
'fuel_type': 'petrol',
'id': '6300ea80-50a7-567e-878e-dc048e155229',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA76545',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Corsa',
'odometer': 75681,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-12-25',
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo GS',
'transmission': 'manual',
'trim': 'GS',
'year': 2023}
2026-04-27 08:05:07 [auto1.es] INFO: Saving data for LA76545: {'auction_closing_time': 1777303571.0, 'created_time': 1776940863.122694, 'has_photos': True, 'last_price_update_time': 1777277107.123469}
2026-04-27 08:05:07 [auto1.es] INFO: Found listing with ID: SS90788
2026-04-27 08:05:07 [auto1.es] INFO: Scrape type for SS90788: 1
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_b8b8d434e838aefc31223d4fede82c04.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51ac9b0e-f6a2-589a-abb4-f66f816d82bd with identifier: HD33844
2026-04-27 08:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd with scrape type 1
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1aebc6c984cfb0a488b8161f6005cef4.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 921e4265-44d9-5c55-8432-8b2cdc345b9f with identifier: ME50829
2026-04-27 08:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921e4265-44d9-5c55-8432-8b2cdc345b9f with scrape type 1
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_de7c743c274aadcdd2609d54d8c9492d.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7cdc90c-9441-5cb8-b621-7a85be4952ba with identifier: YH13326
2026-04-27 08:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cdc90c-9441-5cb8-b621-7a85be4952ba with scrape type 1
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_4c83acf1cd9af47ef0229fec859527e0.jpg not downloaded yet
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_784639def12784006a002911eeb4ee9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_f3a4618622d4bff182b861699e558e63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_d4aa97b277663c34410dfa897b3441dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [auto1.es] INFO: Found listing with ID: DR58121
2026-04-27 08:05:07 [auto1.es] INFO: Scrape type for DR58121: 1
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_8eb116767b29f908ce2a37bff5238199.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_145157bc24832d2bee1fb64cd2004319.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_d6ce2147cf505f4f80625161d280cb61.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_8eb7d9a045b635f5a2b7775d3f3bba5e.jpg not downloaded yet
2026-04-27 08:05:07 [auto1.es] INFO: Found listing with ID: FV03945
2026-04-27 08:05:07 [auto1.es] INFO: Scrape type for FV03945: 1
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_4949a8c2ee1a97a8f619167c080568b8.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_a101873eac6c4d77ae1799d3b77a6ba2.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b46626680d83132b47df7ce0ca081e44.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_d3fb783e421909a12ca14c973f883a70.jpg not downloaded yet
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04814cd90>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_784639def12784006a002911eeb4ee9f.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837ae90>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_f3a4618622d4bff182b861699e558e63.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a3c5d0>
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_d4aa97b277663c34410dfa897b3441dd.jpg saved to cache
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_4c83acf1cd9af47ef0229fec859527e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [auto1.es] INFO: Found listing with ID: SG47159
2026-04-27 08:05:07 [auto1.es] INFO: Scrape type for SG47159: 2
2026-04-27 08:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9002eae2-242e-50b5-aff9-5c1327ed3703 with identifier: SG47159
2026-04-27 08:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9002eae2-242e-50b5-aff9-5c1327ed3703 with scrape type 2
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9002eae2-242e-50b5-aff9-5c1327ed3703 with scrape type 2
2026-04-27 08:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9002eae2-242e-50b5-aff9-5c1327ed3703, identifier: SG47159
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_41d8e98ca77dd5f087f250c88d3afa82.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_0993318fafdb2b18b6416da06c2d98d5.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_1a4e11fdeab30d682e9d42f94206a97d.jpg not downloaded yet
2026-04-27 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_753a1410c0c989e3e3eb85ac270243a7.jpg not downloaded yet
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_de7c743c274aadcdd2609d54d8c9492d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9002eae2-242e-50b5-aff9-5c1327ed3703 with identifier: SG47159
2026-04-27 08:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9002eae2-242e-50b5-aff9-5c1327ed3703 with identifier: SG47159
2026-04-27 08:05:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9002eae2-242e-50b5-aff9-5c1327ed3703 with identifier: SG47159 to the API
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:27:06Z',
'fuel_type': 'petrol',
'id': '9002eae2-242e-50b5-aff9-5c1327ed3703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG47159',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'MINI',
'odometer': 187505,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-03-27',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-04-27 08:05:08 [auto1.es] INFO: Saving data for SG47159: {'auction_closing_time': 1777303626.0, 'created_time': 1777019759.012387, 'has_photos': True, 'last_price_update_time': 1777277108.007139}
2026-04-27 08:05:08 [auto1.es] INFO: Found listing with ID: WD85467
2026-04-27 08:05:08 [auto1.es] INFO: Scrape type for WD85467: 1
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1b297c82bcaed1754d026a7333e83691.jpg not downloaded yet
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bd8d5a3f44018437bed784dd76d61cc7.jpg not downloaded yet
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_22b7ffe08d1a094984ea184450580628.jpg not downloaded yet
2026-04-27 08:05:08 [auto1.es] INFO: Found listing with ID: SB25570
2026-04-27 08:05:08 [auto1.es] INFO: Scrape type for SB25570: 2
2026-04-27 08:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55edaead-a6de-5a71-a91e-0315d5a38ffd with identifier: SB25570
2026-04-27 08:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55edaead-a6de-5a71-a91e-0315d5a38ffd with scrape type 2
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55edaead-a6de-5a71-a91e-0315d5a38ffd with scrape type 2
2026-04-27 08:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55edaead-a6de-5a71-a91e-0315d5a38ffd, identifier: SB25570
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_56853152e327b8264bcda558d16f0531.jpg not downloaded yet
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_917530580a8d0adef7074848b40bff41.jpg not downloaded yet
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_f9713d3e3187ec74e6030f879003c65f.jpg not downloaded yet
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ae110>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_4c83acf1cd9af47ef0229fec859527e0.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a18ad0>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_de7c743c274aadcdd2609d54d8c9492d.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55edaead-a6de-5a71-a91e-0315d5a38ffd with identifier: SB25570
2026-04-27 08:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55edaead-a6de-5a71-a91e-0315d5a38ffd with identifier: SB25570
2026-04-27 08:05:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 55edaead-a6de-5a71-a91e-0315d5a38ffd with identifier: SB25570 to the API
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:50:04Z',
'fuel_type': 'diesel',
'id': '55edaead-a6de-5a71-a91e-0315d5a38ffd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB25570',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Panda',
'odometer': 102415,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-03-21',
'seller_name': None,
'title': 'Fiat Panda 1.3 M-Jet Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2016}
2026-04-27 08:05:08 [auto1.es] INFO: Saving data for SB25570: {'auction_closing_time': 1777305004.0, 'created_time': 1777020906.768922, 'has_photos': True, 'last_price_update_time': 1777277108.748396}
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_d3fb783e421909a12ca14c973f883a70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [auto1.es] INFO: Found listing with ID: ZE84098
2026-04-27 08:05:08 [auto1.es] INFO: Scrape type for ZE84098: 2
2026-04-27 08:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f40481-5d73-57ad-9b7f-b8d6d86f963c with identifier: ZE84098
2026-04-27 08:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f40481-5d73-57ad-9b7f-b8d6d86f963c with scrape type 2
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1f40481-5d73-57ad-9b7f-b8d6d86f963c with scrape type 2
2026-04-27 08:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1f40481-5d73-57ad-9b7f-b8d6d86f963c, identifier: ZE84098
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_94f78a5cd3b6e0e1bbb2328a5040f82a.jpg not downloaded yet
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bb1373b5b53262b73f631878f1ba8904.jpg not downloaded yet
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_2e1116f3563ba0bcff04a8c03dafe40f.jpg not downloaded yet
2026-04-27 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b46626680d83132b47df7ce0ca081e44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1f40481-5d73-57ad-9b7f-b8d6d86f963c with identifier: ZE84098
2026-04-27 08:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1f40481-5d73-57ad-9b7f-b8d6d86f963c with identifier: ZE84098
2026-04-27 08:05:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1f40481-5d73-57ad-9b7f-b8d6d86f963c with identifier: ZE84098 to the API
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:36:22Z',
'fuel_type': 'diesel',
'id': 'c1f40481-5d73-57ad-9b7f-b8d6d86f963c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE84098',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 152774,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-01-14',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Advance BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Advance BlueMotion Tech',
'year': 2015}
2026-04-27 08:05:09 [auto1.es] INFO: Saving data for ZE84098: {'auction_closing_time': 1777304182.0, 'created_time': 1777021482.914877, 'has_photos': True, 'last_price_update_time': 1777277109.246359}
2026-04-27 08:05:09 [auto1.es] INFO: Found listing with ID: NW52091
2026-04-27 08:05:09 [auto1.es] INFO: Scrape type for NW52091: 1
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_337d127c81f792773a4ea26e6409b8b7.jpg not downloaded yet
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b160b10cb4cd0a6677e037a2bc9d150e.jpg not downloaded yet
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_388c4b972f4c1e27233ebd5f31b7e5f7.jpg not downloaded yet
2026-04-27 08:05:09 [auto1.es] INFO: Found listing with ID: TK39895
2026-04-27 08:05:09 [auto1.es] INFO: Scrape type for TK39895: 2
2026-04-27 08:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989f3206-80d8-5e57-8337-56267efad80d with identifier: TK39895
2026-04-27 08:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989f3206-80d8-5e57-8337-56267efad80d with scrape type 2
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989f3206-80d8-5e57-8337-56267efad80d with scrape type 2
2026-04-27 08:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 989f3206-80d8-5e57-8337-56267efad80d, identifier: TK39895
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_186f67397079dcafdf4d9cdd445caff0.jpg not downloaded yet
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_a42d4220fe7d8a758803c66f3edf7f01.jpg not downloaded yet
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_c683371ac9fabfc18264dd179824a533.jpg not downloaded yet
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482d4710>
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_d3fb783e421909a12ca14c973f883a70.jpg saved to cache
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cb1d0>
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b46626680d83132b47df7ce0ca081e44.jpg saved to cache
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 989f3206-80d8-5e57-8337-56267efad80d with identifier: TK39895
2026-04-27 08:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 989f3206-80d8-5e57-8337-56267efad80d with identifier: TK39895
2026-04-27 08:05:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 989f3206-80d8-5e57-8337-56267efad80d with identifier: TK39895 to the API
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 252,
'expiration_date': '2026-04-27T15:45:29Z',
'fuel_type': 'hybrid',
'id': '989f3206-80d8-5e57-8337-56267efad80d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK39895',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 237674,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-08-30',
'seller_name': None,
'title': 'BMW 3er 330e',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 08:05:09 [auto1.es] INFO: Saving data for TK39895: {'auction_closing_time': 1777304729.0, 'created_time': 1776940970.167238, 'has_photos': True, 'last_price_update_time': 1777277109.897275}
2026-04-27 08:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_f9713d3e3187ec74e6030f879003c65f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:09 [auto1.es] INFO: Found listing with ID: SG84832
2026-04-27 08:05:09 [auto1.es] INFO: Scrape type for SG84832: 2
2026-04-27 08:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832
2026-04-27 08:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with scrape type 2
2026-04-27 08:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with scrape type 2
2026-04-27 08:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e, identifier: SG84832
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_f8ae554a7190e7e3d74d126fde61d152.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_5a1cfcb4aa077a9ef309e9aa7bdc271a.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_903af2b0bb9bc1f0bea7e0b32661f68d.jpg not downloaded yet
2026-04-27 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_917530580a8d0adef7074848b40bff41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832
2026-04-27 08:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832
2026-04-27 08:05:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832 to the API
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 99,
'expiration_date': '2026-04-27T15:39:53Z',
'fuel_type': 'diesel',
'id': 'c20f10ad-b73a-5089-9d6a-1bb3eec5e65e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG84832',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 191932,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-03-27',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Aniversario Edition',
'transmission': 'manual',
'trim': '20 Aniversario Edition',
'year': 2018}
2026-04-27 08:05:10 [auto1.es] INFO: Saving data for SG84832: {'auction_closing_time': 1777304393.0, 'created_time': 1777018020.311493, 'has_photos': True, 'last_price_update_time': 1777277110.426742}
2026-04-27 08:05:10 [auto1.es] INFO: Found listing with ID: FJ33791
2026-04-27 08:05:10 [auto1.es] INFO: Scrape type for FJ33791: 2
2026-04-27 08:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 249f1cdb-b185-50f7-bd4b-f73608d55a70 with identifier: FJ33791
2026-04-27 08:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 249f1cdb-b185-50f7-bd4b-f73608d55a70 with scrape type 2
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 249f1cdb-b185-50f7-bd4b-f73608d55a70 with scrape type 2
2026-04-27 08:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 249f1cdb-b185-50f7-bd4b-f73608d55a70, identifier: FJ33791
2026-04-27 08:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 249f1cdb-b185-50f7-bd4b-f73608d55a70 with identifier: FJ33791
2026-04-27 08:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 249f1cdb-b185-50f7-bd4b-f73608d55a70 with identifier: FJ33791
2026-04-27 08:05:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 249f1cdb-b185-50f7-bd4b-f73608d55a70 with identifier: FJ33791 to the API
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 275,
'expiration_date': '2026-04-27T15:08:40Z',
'fuel_type': 'petrol',
'id': '249f1cdb-b185-50f7-bd4b-f73608d55a70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ33791',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'i30',
'odometer': 74685,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-03-25',
'seller_name': None,
'title': 'Hyundai i30 2.0 TGDI N Performance',
'transmission': 'manual',
'trim': 'N Performance',
'year': 2019}
2026-04-27 08:05:10 [auto1.es] INFO: Saving data for FJ33791: {'auction_closing_time': 1777302520.0, 'created_time': 1776940970.948145, 'has_photos': True, 'last_price_update_time': 1777277110.824349}
2026-04-27 08:05:10 [auto1.es] INFO: Found listing with ID: YZ25761
2026-04-27 08:05:10 [auto1.es] INFO: Scrape type for YZ25761: 2
2026-04-27 08:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1304fc77-43d2-555a-88e7-7e1a778d6ca3 with identifier: YZ25761
2026-04-27 08:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1304fc77-43d2-555a-88e7-7e1a778d6ca3 with scrape type 2
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1304fc77-43d2-555a-88e7-7e1a778d6ca3 with scrape type 2
2026-04-27 08:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1304fc77-43d2-555a-88e7-7e1a778d6ca3, identifier: YZ25761
2026-04-27 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL00701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869d450>
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_f9713d3e3187ec74e6030f879003c65f.jpg saved to cache
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843ce90>
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_917530580a8d0adef7074848b40bff41.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1304fc77-43d2-555a-88e7-7e1a778d6ca3 with identifier: YZ25761
2026-04-27 08:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1304fc77-43d2-555a-88e7-7e1a778d6ca3 with identifier: YZ25761
2026-04-27 08:05:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1304fc77-43d2-555a-88e7-7e1a778d6ca3 with identifier: YZ25761 to the API
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:35:07Z',
'fuel_type': 'diesel',
'id': '1304fc77-43d2-555a-88e7-7e1a778d6ca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ25761',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 157394,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-04-29',
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 08:05:11 [auto1.es] INFO: Saving data for YZ25761: {'auction_closing_time': 1777304107.0, 'created_time': 1777020949.37043, 'has_photos': True, 'last_price_update_time': 1777277111.301828}
2026-04-27 08:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_a42d4220fe7d8a758803c66f3edf7f01.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_c683371ac9fabfc18264dd179824a533.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [auto1.es] INFO: Found listing with ID: VH40587
2026-04-27 08:05:11 [auto1.es] INFO: Scrape type for VH40587: 2
2026-04-27 08:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3bd40a8-dbb2-555c-b608-526cde0ce487 with identifier: VH40587
2026-04-27 08:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3bd40a8-dbb2-555c-b608-526cde0ce487 with scrape type 2
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3bd40a8-dbb2-555c-b608-526cde0ce487 with scrape type 2
2026-04-27 08:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d3bd40a8-dbb2-555c-b608-526cde0ce487, identifier: VH40587
2026-04-27 08:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d3bd40a8-dbb2-555c-b608-526cde0ce487 with identifier: VH40587
2026-04-27 08:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d3bd40a8-dbb2-555c-b608-526cde0ce487 with identifier: VH40587
2026-04-27 08:05:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d3bd40a8-dbb2-555c-b608-526cde0ce487 with identifier: VH40587 to the API
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:06:24Z',
'fuel_type': 'diesel',
'id': 'd3bd40a8-dbb2-555c-b608-526cde0ce487',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH40587',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 168415,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-05-16',
'seller_name': None,
'title': 'Chevrolet Captiva 2.2 Diesel D LT 2WD',
'transmission': 'manual',
'trim': 'D LT 2WD',
'year': 2013}
2026-04-27 08:05:11 [auto1.es] INFO: Saving data for VH40587: {'auction_closing_time': 1777302384.0, 'created_time': 1776940890.207644, 'has_photos': True, 'last_price_update_time': 1777277111.716231}
2026-04-27 08:05:11 [auto1.es] INFO: Found listing with ID: XK19551
2026-04-27 08:05:11 [auto1.es] INFO: Scrape type for XK19551: 1
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_903af2b0bb9bc1f0bea7e0b32661f68d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c1a10>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_a42d4220fe7d8a758803c66f3edf7f01.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6e90>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_c683371ac9fabfc18264dd179824a533.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:05:11 [auto1.es] INFO: Found listing with ID: DV62535
2026-04-27 08:05:11 [auto1.es] INFO: Scrape type for DV62535: 2
2026-04-27 08:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6348166-c98c-5f57-be73-0a47f4747330 with identifier: DV62535
2026-04-27 08:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6348166-c98c-5f57-be73-0a47f4747330 with scrape type 2
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6348166-c98c-5f57-be73-0a47f4747330 with scrape type 2
2026-04-27 08:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c6348166-c98c-5f57-be73-0a47f4747330, identifier: DV62535
2026-04-27 08:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c6348166-c98c-5f57-be73-0a47f4747330 with identifier: DV62535
2026-04-27 08:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c6348166-c98c-5f57-be73-0a47f4747330 with identifier: DV62535
2026-04-27 08:05:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c6348166-c98c-5f57-be73-0a47f4747330 with identifier: DV62535 to the API
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:20:31Z',
'fuel_type': 'diesel',
'id': 'c6348166-c98c-5f57-be73-0a47f4747330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV62535',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 63297,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-12',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-04-27 08:05:12 [auto1.es] INFO: Saving data for DV62535: {'auction_closing_time': 1777303231.0, 'created_time': 1777018400.725898, 'has_photos': True, 'last_price_update_time': 1777277112.254026}
2026-04-27 08:05:12 [auto1.es] INFO: Found listing with ID: DG04263
2026-04-27 08:05:12 [auto1.es] INFO: Scrape type for DG04263: 1
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_f8ae554a7190e7e3d74d126fde61d152.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_5a1cfcb4aa077a9ef309e9aa7bdc271a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_186f67397079dcafdf4d9cdd445caff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [auto1.es] INFO: Found listing with ID: UE25004
2026-04-27 08:05:12 [auto1.es] INFO: Scrape type for UE25004: 1
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA16216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a1350>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_903af2b0bb9bc1f0bea7e0b32661f68d.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:12 [auto1.es] INFO: Found listing with ID: AY32609
2026-04-27 08:05:12 [auto1.es] INFO: Scrape type for AY32609: 1
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048161f10>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_f8ae554a7190e7e3d74d126fde61d152.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572fa790>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_5a1cfcb4aa077a9ef309e9aa7bdc271a.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482b8f50>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_186f67397079dcafdf4d9cdd445caff0.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT47654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:22 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2031 | hits on page: 40
2026-04-27 08:05:22 [auto1.es] INFO: Found listing with ID: SX57904
2026-04-27 08:05:22 [auto1.es] INFO: Scrape type for SX57904: 2
2026-04-27 08:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0081443-b5db-5de7-b32c-53a2ac368c68 with identifier: SX57904
2026-04-27 08:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0081443-b5db-5de7-b32c-53a2ac368c68 with scrape type 2
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0081443-b5db-5de7-b32c-53a2ac368c68 with scrape type 2
2026-04-27 08:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0081443-b5db-5de7-b32c-53a2ac368c68, identifier: SX57904
2026-04-27 08:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0081443-b5db-5de7-b32c-53a2ac368c68 with identifier: SX57904
2026-04-27 08:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0081443-b5db-5de7-b32c-53a2ac368c68 with identifier: SX57904
2026-04-27 08:05:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0081443-b5db-5de7-b32c-53a2ac368c68 with identifier: SX57904 to the API
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:04:50Z',
'fuel_type': 'petrol',
'id': 'b0081443-b5db-5de7-b32c-53a2ac368c68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX57904',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 154846,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-07-31',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-04-27 08:05:23 [auto1.es] INFO: Saving data for SX57904: {'auction_closing_time': 1777302290.0, 'created_time': 1776940911.562317, 'has_photos': True, 'last_price_update_time': 1777277123.254622}
2026-04-27 08:05:23 [auto1.es] INFO: Found listing with ID: PA54206
2026-04-27 08:05:23 [auto1.es] INFO: Scrape type for PA54206: 2
2026-04-27 08:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206
2026-04-27 08:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24736fc-7265-5e35-a0fb-c84fdc36cf1b with scrape type 2
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24736fc-7265-5e35-a0fb-c84fdc36cf1b with scrape type 2
2026-04-27 08:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c24736fc-7265-5e35-a0fb-c84fdc36cf1b, identifier: PA54206
2026-04-27 08:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206
2026-04-27 08:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206
2026-04-27 08:05:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c24736fc-7265-5e35-a0fb-c84fdc36cf1b with identifier: PA54206 to the API
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:09:49Z',
'fuel_type': 'diesel',
'id': 'c24736fc-7265-5e35-a0fb-c84fdc36cf1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA54206',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 326310,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-02-16',
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
'transmission': 'manual',
'trim': 'Kinetic 2WD',
'year': 2016}
2026-04-27 08:05:23 [auto1.es] INFO: Saving data for PA54206: {'auction_closing_time': 1777302589.0, 'created_time': 1777020516.396562, 'has_photos': True, 'last_price_update_time': 1777277123.669898}
2026-04-27 08:05:23 [auto1.es] INFO: Found listing with ID: UN73139
2026-04-27 08:05:23 [auto1.es] INFO: Scrape type for UN73139: 2
2026-04-27 08:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63dc0750-97f5-52cd-8dbd-8d863294b7d0 with identifier: UN73139
2026-04-27 08:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63dc0750-97f5-52cd-8dbd-8d863294b7d0 with scrape type 2
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63dc0750-97f5-52cd-8dbd-8d863294b7d0 with scrape type 2
2026-04-27 08:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 63dc0750-97f5-52cd-8dbd-8d863294b7d0, identifier: UN73139
2026-04-27 08:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 63dc0750-97f5-52cd-8dbd-8d863294b7d0 with identifier: UN73139
2026-04-27 08:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 63dc0750-97f5-52cd-8dbd-8d863294b7d0 with identifier: UN73139
2026-04-27 08:05:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 63dc0750-97f5-52cd-8dbd-8d863294b7d0 with identifier: UN73139 to the API
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-04-27T15:09:45Z',
'fuel_type': 'petrol',
'id': '63dc0750-97f5-52cd-8dbd-8d863294b7d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN73139',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC40',
'odometer': 7171,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-12-29',
'seller_name': None,
'title': 'Volvo XC40 1.5 T2 Core 2WD',
'transmission': 'automatic',
'trim': 'Core 2WD',
'year': 2022}
2026-04-27 08:05:24 [auto1.es] INFO: Saving data for UN73139: {'auction_closing_time': 1777302585.0, 'created_time': 1777021822.733811, 'has_photos': True, 'last_price_update_time': 1777277124.148465}
2026-04-27 08:05:24 [auto1.es] INFO: Found listing with ID: BL42593
2026-04-27 08:05:24 [auto1.es] INFO: Scrape type for BL42593: 2
2026-04-27 08:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33586567-8b63-5d43-b12f-5c36c1af6bae with identifier: BL42593
2026-04-27 08:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33586567-8b63-5d43-b12f-5c36c1af6bae with scrape type 2
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33586567-8b63-5d43-b12f-5c36c1af6bae with scrape type 2
2026-04-27 08:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33586567-8b63-5d43-b12f-5c36c1af6bae, identifier: BL42593
2026-04-27 08:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33586567-8b63-5d43-b12f-5c36c1af6bae with identifier: BL42593
2026-04-27 08:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33586567-8b63-5d43-b12f-5c36c1af6bae with identifier: BL42593
2026-04-27 08:05:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33586567-8b63-5d43-b12f-5c36c1af6bae with identifier: BL42593 to the API
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:35:17Z',
'fuel_type': 'diesel',
'id': '33586567-8b63-5d43-b12f-5c36c1af6bae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL42593',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Mondeo',
'odometer': 278239,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-01-31',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-04-27 08:05:24 [auto1.es] INFO: Saving data for BL42593: {'auction_closing_time': 1777304117.0, 'created_time': 1777018105.651646, 'has_photos': True, 'last_price_update_time': 1777277124.566226}
2026-04-27 08:05:24 [auto1.es] INFO: Found listing with ID: UJ28703
2026-04-27 08:05:24 [auto1.es] INFO: Scrape type for UJ28703: 1
2026-04-27 08:05:24 [auto1.es] INFO: Found listing with ID: MK70823
2026-04-27 08:05:24 [auto1.es] INFO: Scrape type for MK70823: 1
2026-04-27 08:05:24 [auto1.es] INFO: Found listing with ID: RN36901
2026-04-27 08:05:24 [auto1.es] INFO: Scrape type for RN36901: 1
2026-04-27 08:05:24 [auto1.es] INFO: Found listing with ID: UG58096
2026-04-27 08:05:24 [auto1.es] INFO: Scrape type for UG58096: 2
2026-04-27 08:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83be856a-4266-50c3-bf87-d49869fa7ea0 with identifier: UG58096
2026-04-27 08:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83be856a-4266-50c3-bf87-d49869fa7ea0 with scrape type 2
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83be856a-4266-50c3-bf87-d49869fa7ea0 with scrape type 2
2026-04-27 08:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83be856a-4266-50c3-bf87-d49869fa7ea0, identifier: UG58096
2026-04-27 08:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83be856a-4266-50c3-bf87-d49869fa7ea0 with identifier: UG58096
2026-04-27 08:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83be856a-4266-50c3-bf87-d49869fa7ea0 with identifier: UG58096
2026-04-27 08:05:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83be856a-4266-50c3-bf87-d49869fa7ea0 with identifier: UG58096 to the API
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-04-27T15:59:36Z',
'fuel_type': 'diesel',
'id': '83be856a-4266-50c3-bf87-d49869fa7ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG58096',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'XF',
'odometer': 134457,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-12-02',
'seller_name': None,
'title': 'Jaguar XF 2.2 D',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 08:05:25 [auto1.es] INFO: Saving data for UG58096: {'auction_closing_time': 1777305576.0, 'created_time': 1777021471.839677, 'has_photos': True, 'last_price_update_time': 1777277125.026958}
2026-04-27 08:05:25 [auto1.es] INFO: Found listing with ID: FG81749
2026-04-27 08:05:25 [auto1.es] INFO: Scrape type for FG81749: 1
2026-04-27 08:05:25 [auto1.es] INFO: Found listing with ID: BP74290
2026-04-27 08:05:25 [auto1.es] INFO: Scrape type for BP74290: 1
2026-04-27 08:05:25 [auto1.es] INFO: Found listing with ID: NZ66576
2026-04-27 08:05:25 [auto1.es] INFO: Scrape type for NZ66576: 2
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e982b41-ace4-5bb3-b29b-6b466c8cdf10 with identifier: NZ66576
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e982b41-ace4-5bb3-b29b-6b466c8cdf10 with scrape type 2
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e982b41-ace4-5bb3-b29b-6b466c8cdf10 with scrape type 2
2026-04-27 08:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e982b41-ace4-5bb3-b29b-6b466c8cdf10, identifier: NZ66576
2026-04-27 08:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e982b41-ace4-5bb3-b29b-6b466c8cdf10 with identifier: NZ66576
2026-04-27 08:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e982b41-ace4-5bb3-b29b-6b466c8cdf10 with identifier: NZ66576
2026-04-27 08:05:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e982b41-ace4-5bb3-b29b-6b466c8cdf10 with identifier: NZ66576 to the API
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:16:43Z',
'fuel_type': 'petrol',
'id': '9e982b41-ace4-5bb3-b29b-6b466c8cdf10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ66576',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 322683,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-01-31',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2007}
2026-04-27 08:05:25 [auto1.es] INFO: Saving data for NZ66576: {'auction_closing_time': 1777303003.0, 'created_time': 1777021874.603131, 'has_photos': True, 'last_price_update_time': 1777277125.689388}
2026-04-27 08:05:25 [auto1.es] INFO: Found listing with ID: SG16505
2026-04-27 08:05:25 [auto1.es] INFO: Scrape type for SG16505: 1
2026-04-27 08:05:25 [auto1.es] INFO: Found listing with ID: FY07244
2026-04-27 08:05:25 [auto1.es] INFO: Scrape type for FY07244: 1
2026-04-27 08:05:25 [auto1.es] INFO: Found listing with ID: KK08201
2026-04-27 08:05:25 [auto1.es] INFO: Scrape type for KK08201: 2
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889337ca-ae94-5323-a0c5-4a32fafd091b with identifier: KK08201
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889337ca-ae94-5323-a0c5-4a32fafd091b with scrape type 2
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 889337ca-ae94-5323-a0c5-4a32fafd091b with scrape type 2
2026-04-27 08:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 889337ca-ae94-5323-a0c5-4a32fafd091b, identifier: KK08201
2026-04-27 08:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 889337ca-ae94-5323-a0c5-4a32fafd091b with identifier: KK08201
2026-04-27 08:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 889337ca-ae94-5323-a0c5-4a32fafd091b with identifier: KK08201
2026-04-27 08:05:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 889337ca-ae94-5323-a0c5-4a32fafd091b with identifier: KK08201 to the API
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 305,
'expiration_date': '2026-04-27T15:20:20Z',
'fuel_type': 'petrol',
'id': '889337ca-ae94-5323-a0c5-4a32fafd091b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK08201',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 209282,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-09-02',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 500 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2002}
2026-04-27 08:05:26 [auto1.es] INFO: Saving data for KK08201: {'auction_closing_time': 1777303220.0, 'created_time': 1777020950.763209, 'has_photos': True, 'last_price_update_time': 1777277126.137182}
2026-04-27 08:05:26 [auto1.es] INFO: Found listing with ID: DJ62430
2026-04-27 08:05:26 [auto1.es] INFO: Scrape type for DJ62430: 1
2026-04-27 08:05:26 [auto1.es] INFO: Found listing with ID: LS25075
2026-04-27 08:05:26 [auto1.es] INFO: Scrape type for LS25075: 1
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP09139> (referer: https://www.auto1.com/v1/car-details-view/HP09139/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD45790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA91649> (referer: https://www.auto1.com/v1/car-details-view/LA91649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:26 [auto1.es] INFO: Found listing with ID: CL26716
2026-04-27 08:05:26 [auto1.es] INFO: Scrape type for CL26716: 1
2026-04-27 08:05:26 [auto1.es] INFO: Found listing with ID: CZ41335
2026-04-27 08:05:26 [auto1.es] INFO: Scrape type for CZ41335: 2
2026-04-27 08:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f506b80-63d5-5a41-811a-06172c41a53c with identifier: CZ41335
2026-04-27 08:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f506b80-63d5-5a41-811a-06172c41a53c with scrape type 2
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f506b80-63d5-5a41-811a-06172c41a53c with scrape type 2
2026-04-27 08:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f506b80-63d5-5a41-811a-06172c41a53c, identifier: CZ41335
2026-04-27 08:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f506b80-63d5-5a41-811a-06172c41a53c with identifier: CZ41335
2026-04-27 08:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f506b80-63d5-5a41-811a-06172c41a53c with identifier: CZ41335
2026-04-27 08:05:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f506b80-63d5-5a41-811a-06172c41a53c with identifier: CZ41335 to the API
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-04-27T15:49:04Z',
'fuel_type': 'diesel',
'id': '4f506b80-63d5-5a41-811a-06172c41a53c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ41335',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC90',
'odometer': 288348,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-18',
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2015}
2026-04-27 08:05:26 [auto1.es] INFO: Saving data for CZ41335: {'auction_closing_time': 1777304944.0, 'created_time': 1777020844.962281, 'has_photos': True, 'last_price_update_time': 1777277126.61616}
2026-04-27 08:05:26 [auto1.es] INFO: Found listing with ID: HZ39020
2026-04-27 08:05:26 [auto1.es] INFO: Scrape type for HZ39020: 1
2026-04-27 08:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f with identifier: HP09139
2026-04-27 08:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f with scrape type 1
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_40ff861b6b570a39263e4806573680cd.jpg not downloaded yet
2026-04-27 08:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 with identifier: LA91649
2026-04-27 08:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 with scrape type 1
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_16180fb877b4cc9fa0ff4fecdccabdaa.jpg not downloaded yet
2026-04-27 08:05:26 [auto1.es] INFO: Found listing with ID: TD03777
2026-04-27 08:05:26 [auto1.es] INFO: Scrape type for TD03777: 2
2026-04-27 08:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 153a8ee7-e7f9-5c77-9604-5d7578439a50 with identifier: TD03777
2026-04-27 08:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 153a8ee7-e7f9-5c77-9604-5d7578439a50 with scrape type 2
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 153a8ee7-e7f9-5c77-9604-5d7578439a50 with scrape type 2
2026-04-27 08:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 153a8ee7-e7f9-5c77-9604-5d7578439a50, identifier: TD03777
2026-04-27 08:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 153a8ee7-e7f9-5c77-9604-5d7578439a50 with identifier: TD03777
2026-04-27 08:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 153a8ee7-e7f9-5c77-9604-5d7578439a50 with identifier: TD03777
2026-04-27 08:05:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 153a8ee7-e7f9-5c77-9604-5d7578439a50 with identifier: TD03777 to the API
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:43:53Z',
'fuel_type': 'diesel',
'id': '153a8ee7-e7f9-5c77-9604-5d7578439a50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD03777',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Carnival',
'odometer': 267790,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-06-27',
'seller_name': None,
'title': 'Kia Carnival 2.9 CRDi VGT Emotion',
'transmission': 'manual',
'trim': 'VGT Emotion',
'year': 2007}
2026-04-27 08:05:27 [auto1.es] INFO: Saving data for TD03777: {'auction_closing_time': 1777304633.0, 'created_time': 1777020966.237507, 'has_photos': True, 'last_price_update_time': 1777277127.115474}
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_530c676e681d24bd1f0141804dc06781.jpg not downloaded yet
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_92fd61ab8c3c7cac855dbc1a7407de9b.jpg not downloaded yet
2026-04-27 08:05:27 [auto1.es] INFO: Found listing with ID: SL49556
2026-04-27 08:05:27 [auto1.es] INFO: Scrape type for SL49556: 2
2026-04-27 08:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556
2026-04-27 08:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with scrape type 2
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with scrape type 2
2026-04-27 08:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fc6a6ea-554a-59aa-b47a-7e41c24af371, identifier: SL49556
2026-04-27 08:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556
2026-04-27 08:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556
2026-04-27 08:05:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556 to the API
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:29:11Z',
'fuel_type': 'diesel',
'id': '9fc6a6ea-554a-59aa-b47a-7e41c24af371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL49556',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 133505,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-01-13',
'seller_name': None,
'title': 'Jaguar E-Pace D180 S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2019}
2026-04-27 08:05:27 [auto1.es] INFO: Saving data for SL49556: {'auction_closing_time': 1777303751.0, 'created_time': 1777018194.553199, 'has_photos': True, 'last_price_update_time': 1777277127.677193}
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_b9efee2bfcfefdcd3ef336436c20a5ac.jpg not downloaded yet
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_298d166b6c9cd8e256e547300a0c86b3.jpg not downloaded yet
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA96851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:27 [auto1.es] INFO: Found listing with ID: JU90571
2026-04-27 08:05:27 [auto1.es] INFO: Scrape type for JU90571: 1
2026-04-27 08:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_fe4b30910593e6de9506c2ac765d1993.jpg not downloaded yet
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_d4ecb3ac385a0925e7e52aadd719ff05.jpg not downloaded yet
2026-04-27 08:05:27 [auto1.es] INFO: Found listing with ID: AJ35719
2026-04-27 08:05:27 [auto1.es] INFO: Scrape type for AJ35719: 2
2026-04-27 08:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97cc6afd-9c94-5797-b531-47967b7e3992 with identifier: AJ35719
2026-04-27 08:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97cc6afd-9c94-5797-b531-47967b7e3992 with scrape type 2
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97cc6afd-9c94-5797-b531-47967b7e3992 with scrape type 2
2026-04-27 08:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97cc6afd-9c94-5797-b531-47967b7e3992, identifier: AJ35719
2026-04-27 08:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97cc6afd-9c94-5797-b531-47967b7e3992 with identifier: AJ35719
2026-04-27 08:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97cc6afd-9c94-5797-b531-47967b7e3992 with identifier: AJ35719
2026-04-27 08:05:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97cc6afd-9c94-5797-b531-47967b7e3992 with identifier: AJ35719 to the API
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:39:02Z',
'fuel_type': 'petrol',
'id': '97cc6afd-9c94-5797-b531-47967b7e3992',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ35719',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jeep',
'model': 'Compass',
'odometer': 76919,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-12-15',
'seller_name': None,
'title': 'Jeep Compass 1.3 T-GDi Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2022}
2026-04-27 08:05:28 [auto1.es] INFO: Saving data for AJ35719: {'auction_closing_time': 1777304342.0, 'created_time': 1777018040.828744, 'has_photos': True, 'last_price_update_time': 1777277128.200804}
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_ae4ab6d64145c587bfcfb9476cba34f4.jpg not downloaded yet
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_21f3f15cb02a5395fbedf2e7a7c1f968.jpg not downloaded yet
2026-04-27 08:05:28 [auto1.es] INFO: Found listing with ID: GZ37047
2026-04-27 08:05:28 [auto1.es] INFO: Scrape type for GZ37047: 1
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_92fd61ab8c3c7cac855dbc1a7407de9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_90a4fdd942f5ca34403653cc0eed21b3.jpg not downloaded yet
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_a13d0dcec6f774597cebfacda524b401.jpg not downloaded yet
2026-04-27 08:05:28 [auto1.es] INFO: Found listing with ID: WX54724
2026-04-27 08:05:28 [auto1.es] INFO: Scrape type for WX54724: 1
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_4f1f09a3cfa8dbd0af58b087c1a5721f.jpg not downloaded yet
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE50785> (referer: https://www.auto1.com/v1/car-details-view/VE50785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:28 [auto1.es] INFO: Found listing with ID: FS02897
2026-04-27 08:05:28 [auto1.es] INFO: Scrape type for FS02897: 2
2026-04-27 08:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c17f8568-f48f-5a2f-b2d0-f4b96702d2b6 with identifier: FS02897
2026-04-27 08:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17f8568-f48f-5a2f-b2d0-f4b96702d2b6 with scrape type 2
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c17f8568-f48f-5a2f-b2d0-f4b96702d2b6 with scrape type 2
2026-04-27 08:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c17f8568-f48f-5a2f-b2d0-f4b96702d2b6, identifier: FS02897
2026-04-27 08:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c17f8568-f48f-5a2f-b2d0-f4b96702d2b6 with identifier: FS02897
2026-04-27 08:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c17f8568-f48f-5a2f-b2d0-f4b96702d2b6 with identifier: FS02897
2026-04-27 08:05:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c17f8568-f48f-5a2f-b2d0-f4b96702d2b6 with identifier: FS02897 to the API
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:21:42Z',
'fuel_type': 'diesel',
'id': 'c17f8568-f48f-5a2f-b2d0-f4b96702d2b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS02897',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'Partner',
'odometer': 156017,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-10-31',
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi Combi Plus',
'transmission': 'manual',
'trim': 'Combi Plus',
'year': 2007}
2026-04-27 08:05:28 [auto1.es] INFO: Saving data for FS02897: {'auction_closing_time': 1777303302.0, 'created_time': 1777018169.077744, 'has_photos': True, 'last_price_update_time': 1777277128.778627}
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_92744ac74c6d5ccb6e9b582b85484b0c.jpg not downloaded yet
2026-04-27 08:05:28 [auto1.es] INFO: Found listing with ID: AC83489
2026-04-27 08:05:28 [auto1.es] INFO: Scrape type for AC83489: 1
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_21f3f15cb02a5395fbedf2e7a7c1f968.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_856972aa06b682025e9d867e4e5da953.jpg not downloaded yet
2026-04-27 08:05:28 [auto1.es] INFO: Found listing with ID: CK41460
2026-04-27 08:05:28 [auto1.es] INFO: Scrape type for CK41460: 2
2026-04-27 08:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19dc961-6817-5a40-a380-b0d7e6df6860 with identifier: CK41460
2026-04-27 08:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19dc961-6817-5a40-a380-b0d7e6df6860 with scrape type 2
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d19dc961-6817-5a40-a380-b0d7e6df6860 with scrape type 2
2026-04-27 08:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d19dc961-6817-5a40-a380-b0d7e6df6860, identifier: CK41460
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL38185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487afb10>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_92fd61ab8c3c7cac855dbc1a7407de9b.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785
2026-04-27 08:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc3b72b-65a0-5714-81e4-858b5087659a with scrape type 1
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_44d3932124e645186f17b506890fa0ff.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d19dc961-6817-5a40-a380-b0d7e6df6860 with identifier: CK41460
2026-04-27 08:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d19dc961-6817-5a40-a380-b0d7e6df6860 with identifier: CK41460
2026-04-27 08:05:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d19dc961-6817-5a40-a380-b0d7e6df6860 with identifier: CK41460 to the API
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:55:34Z',
'fuel_type': 'diesel',
'id': 'd19dc961-6817-5a40-a380-b0d7e6df6860',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK41460',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 341905,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-07',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-04-27 08:05:29 [auto1.es] INFO: Saving data for CK41460: {'auction_closing_time': 1777305334.0, 'created_time': 1777018150.646806, 'has_photos': True, 'last_price_update_time': 1777277129.315472}
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_885cebddc676b23a534c49f1159cc4c2.jpg not downloaded yet
2026-04-27 08:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:29 [auto1.es] INFO: Found listing with ID: GC01902
2026-04-27 08:05:29 [auto1.es] INFO: Scrape type for GC01902: 1
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_484df36370e44c5053c9fdbe061c6f63.jpg not downloaded yet
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_92744ac74c6d5ccb6e9b582b85484b0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [auto1.es] INFO: Found listing with ID: YT40358
2026-04-27 08:05:29 [auto1.es] INFO: Scrape type for YT40358: 2
2026-04-27 08:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768f9c2c-aa38-51f0-b395-4ede2078ee6e with identifier: YT40358
2026-04-27 08:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768f9c2c-aa38-51f0-b395-4ede2078ee6e with scrape type 2
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768f9c2c-aa38-51f0-b395-4ede2078ee6e with scrape type 2
2026-04-27 08:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 768f9c2c-aa38-51f0-b395-4ede2078ee6e, identifier: YT40358
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_91dfad30774b2a51846038f1888630ee.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 768f9c2c-aa38-51f0-b395-4ede2078ee6e with identifier: YT40358
2026-04-27 08:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 768f9c2c-aa38-51f0-b395-4ede2078ee6e with identifier: YT40358
2026-04-27 08:05:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 768f9c2c-aa38-51f0-b395-4ede2078ee6e with identifier: YT40358 to the API
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:31:54Z',
'fuel_type': 'diesel',
'id': '768f9c2c-aa38-51f0-b395-4ede2078ee6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT40358',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 209955,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi Tecno 4WD',
'transmission': 'manual',
'trim': 'Tecno 4WD',
'year': 2016}
2026-04-27 08:05:29 [auto1.es] INFO: Saving data for YT40358: {'auction_closing_time': 1777303914.0, 'created_time': 1777018408.204469, 'has_photos': True, 'last_price_update_time': 1777277129.90905}
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e2c10>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_21f3f15cb02a5395fbedf2e7a7c1f968.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:05:29 [auto1.es] INFO: Found listing with ID: VE04719
2026-04-27 08:05:29 [auto1.es] INFO: Scrape type for VE04719: 2
2026-04-27 08:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719
2026-04-27 08:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49f5c77-59d6-519a-ae1b-52e51ef55b19 with scrape type 2
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d49f5c77-59d6-519a-ae1b-52e51ef55b19 with scrape type 2
2026-04-27 08:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d49f5c77-59d6-519a-ae1b-52e51ef55b19, identifier: VE04719
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_2b0de32a3335e79a8f80b5645c608694.jpg not downloaded yet
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_44d3932124e645186f17b506890fa0ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719
2026-04-27 08:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719
2026-04-27 08:05:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719 to the API
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 408,
'expiration_date': '2026-04-27T15:56:03Z',
'fuel_type': 'hybrid',
'id': 'd49f5c77-59d6-519a-ae1b-52e51ef55b19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE04719',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'XC60',
'odometer': 245757,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-03-27',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2018}
2026-04-27 08:05:31 [auto1.es] INFO: Saving data for VE04719: {'auction_closing_time': 1777305363.0, 'created_time': 1777018222.107443, 'has_photos': True, 'last_price_update_time': 1777277131.619986}
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY68429> (referer: https://www.auto1.com/v1/car-details-view/XY68429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:31 [auto1.es] INFO: Found listing with ID: MT58185
2026-04-27 08:05:31 [auto1.es] INFO: Scrape type for MT58185: 2
2026-04-27 08:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185
2026-04-27 08:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with scrape type 2
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with scrape type 2
2026-04-27 08:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6, identifier: MT58185
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6ca59e0c3583c32fae158470fc239c3a.jpg not downloaded yet
2026-04-27 08:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG04263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04864a050>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_92744ac74c6d5ccb6e9b582b85484b0c.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185
2026-04-27 08:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185
2026-04-27 08:05:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185 to the API
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:09:22Z',
'fuel_type': 'diesel',
'id': '00bed97e-a2c4-5304-a9f7-6128c6fa76d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT58185',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A5',
'odometer': 126242,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-08-16',
'seller_name': None,
'title': 'Audi A5 2.0 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2016}
2026-04-27 08:05:32 [auto1.es] INFO: Saving data for MT58185: {'auction_closing_time': 1777302562.0, 'created_time': 1777018256.945379, 'has_photos': True, 'last_price_update_time': 1777277132.325379}
2026-04-27 08:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_484df36370e44c5053c9fdbe061c6f63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:32 [auto1.es] INFO: Found listing with ID: FF66391
2026-04-27 08:05:32 [auto1.es] INFO: Scrape type for FF66391: 1
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b69cc824eb2b7d67f0df5dda2ef6a6b4.jpg not downloaded yet
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK19551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048781e90>
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_44d3932124e645186f17b506890fa0ff.jpg saved to cache
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636435c0-f56f-51b4-86b9-7f246d150e4c with identifier: XY68429
2026-04-27 08:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636435c0-f56f-51b4-86b9-7f246d150e4c with scrape type 1
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_6d4b17c734e7ba7baa4d5a4ef51c97b2.jpg not downloaded yet
2026-04-27 08:05:32 [auto1.es] INFO: Found listing with ID: EG01111
2026-04-27 08:05:32 [auto1.es] INFO: Scrape type for EG01111: 2
2026-04-27 08:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d9b64f-d44d-5300-8f12-021edb508550 with identifier: EG01111
2026-04-27 08:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d9b64f-d44d-5300-8f12-021edb508550 with scrape type 2
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72d9b64f-d44d-5300-8f12-021edb508550 with scrape type 2
2026-04-27 08:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72d9b64f-d44d-5300-8f12-021edb508550, identifier: EG01111
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_e02eb5c2da27d3e6080fd9edc808593e.jpg not downloaded yet
2026-04-27 08:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72d9b64f-d44d-5300-8f12-021edb508550 with identifier: EG01111
2026-04-27 08:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72d9b64f-d44d-5300-8f12-021edb508550 with identifier: EG01111
2026-04-27 08:05:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72d9b64f-d44d-5300-8f12-021edb508550 with identifier: EG01111 to the API
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:37:57Z',
'fuel_type': 'diesel',
'id': '72d9b64f-d44d-5300-8f12-021edb508550',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG01111',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 70579,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': 'BlueTEC Avantgarde',
'year': 2017}
2026-04-27 08:05:32 [auto1.es] INFO: Saving data for EG01111: {'auction_closing_time': 1777304277.0, 'created_time': 1777018091.742182, 'has_photos': True, 'last_price_update_time': 1777277132.851403}
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_d8fe74227b46ffc2c51da3edb5ebca90.jpg not downloaded yet
2026-04-27 08:05:32 [auto1.es] INFO: Found listing with ID: NR68963
2026-04-27 08:05:32 [auto1.es] INFO: Scrape type for NR68963: 1
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_5307f214d7b00d13b329397826aee1aa.jpg not downloaded yet
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_2b0de32a3335e79a8f80b5645c608694.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_492d05d32d0bd50896db80b2ac7897fd.jpg not downloaded yet
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6ca59e0c3583c32fae158470fc239c3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_91dfad30774b2a51846038f1888630ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:32 [auto1.es] INFO: Found listing with ID: MM99362
2026-04-27 08:05:32 [auto1.es] INFO: Scrape type for MM99362: 2
2026-04-27 08:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c2df28-0762-5470-8a9b-fcda82210edc with identifier: MM99362
2026-04-27 08:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c2df28-0762-5470-8a9b-fcda82210edc with scrape type 2
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35c2df28-0762-5470-8a9b-fcda82210edc with scrape type 2
2026-04-27 08:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35c2df28-0762-5470-8a9b-fcda82210edc, identifier: MM99362
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b94cb43afab2a37d70be10f290328c10.jpg not downloaded yet
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e6f90>
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_484df36370e44c5053c9fdbe061c6f63.jpg saved to cache
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35c2df28-0762-5470-8a9b-fcda82210edc with identifier: MM99362
2026-04-27 08:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35c2df28-0762-5470-8a9b-fcda82210edc with identifier: MM99362
2026-04-27 08:05:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35c2df28-0762-5470-8a9b-fcda82210edc with identifier: MM99362 to the API
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:22:15Z',
'fuel_type': 'diesel',
'id': '35c2df28-0762-5470-8a9b-fcda82210edc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM99362',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 220287,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-12-31',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2012}
2026-04-27 08:05:33 [auto1.es] INFO: Saving data for MM99362: {'auction_closing_time': 1777303335.0, 'created_time': 1777018416.56036, 'has_photos': True, 'last_price_update_time': 1777277133.388381}
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_f6a6e65973154a6b89dced6c0e385581.jpg not downloaded yet
2026-04-27 08:05:33 [auto1.es] INFO: Found listing with ID: FA34637
2026-04-27 08:05:33 [auto1.es] INFO: Scrape type for FA34637: 1
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6379ccc94727409431480c6a5957a770.jpg not downloaded yet
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_89849246bd223e6cd7b4dcaaa287d17b.jpg not downloaded yet
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048208c50>
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_2b0de32a3335e79a8f80b5645c608694.jpg saved to cache
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048564550>
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6ca59e0c3583c32fae158470fc239c3a.jpg saved to cache
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048804d50>
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_91dfad30774b2a51846038f1888630ee.jpg saved to cache
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:33 [auto1.es] INFO: Found listing with ID: NW38370
2026-04-27 08:05:33 [auto1.es] INFO: Scrape type for NW38370: 2
2026-04-27 08:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b5b4d3-4aa4-53ba-aa08-9641332d9af1 with identifier: NW38370
2026-04-27 08:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b5b4d3-4aa4-53ba-aa08-9641332d9af1 with scrape type 2
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09b5b4d3-4aa4-53ba-aa08-9641332d9af1 with scrape type 2
2026-04-27 08:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09b5b4d3-4aa4-53ba-aa08-9641332d9af1, identifier: NW38370
2026-04-27 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE25004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09b5b4d3-4aa4-53ba-aa08-9641332d9af1 with identifier: NW38370
2026-04-27 08:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09b5b4d3-4aa4-53ba-aa08-9641332d9af1 with identifier: NW38370
2026-04-27 08:05:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 09b5b4d3-4aa4-53ba-aa08-9641332d9af1 with identifier: NW38370 to the API
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:24:57Z',
'fuel_type': 'diesel',
'id': '09b5b4d3-4aa4-53ba-aa08-9641332d9af1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW38370',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A1',
'odometer': 70081,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-01-31',
'seller_name': None,
'title': 'Audi A1 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-04-27 08:05:33 [auto1.es] INFO: Saving data for NW38370: {'auction_closing_time': 1777303497.0, 'created_time': 1777021881.852591, 'has_photos': True, 'last_price_update_time': 1777277133.94605}
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_2974fae29ec8f0d0273d71c220f29eb5.jpg not downloaded yet
2026-04-27 08:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:33 [scrapy.extensions.logstats] INFO: Crawled 473 pages (at 35 pages/min), scraped 576 items (at 69 items/min)
2026-04-27 08:05:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:05:33 [auto1.es] INFO: Found listing with ID: CD83035
2026-04-27 08:05:33 [auto1.es] INFO: Scrape type for CD83035: 2
2026-04-27 08:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1e13c6c-7a10-5cd7-b64c-ae87debe2956 with identifier: CD83035
2026-04-27 08:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1e13c6c-7a10-5cd7-b64c-ae87debe2956 with scrape type 2
2026-04-27 08:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1e13c6c-7a10-5cd7-b64c-ae87debe2956 with scrape type 2
2026-04-27 08:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1e13c6c-7a10-5cd7-b64c-ae87debe2956, identifier: CD83035
2026-04-27 08:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_5307f214d7b00d13b329397826aee1aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1e13c6c-7a10-5cd7-b64c-ae87debe2956 with identifier: CD83035
2026-04-27 08:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1e13c6c-7a10-5cd7-b64c-ae87debe2956 with identifier: CD83035
2026-04-27 08:05:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1e13c6c-7a10-5cd7-b64c-ae87debe2956 with identifier: CD83035 to the API
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:15:08Z',
'fuel_type': 'diesel',
'id': 'c1e13c6c-7a10-5cd7-b64c-ae87debe2956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD83035',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Meriva',
'odometer': 105677,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-11-25',
'seller_name': None,
'title': 'Opel Meriva 1.7 CDTI Enjoy',
'transmission': 'automatic',
'trim': 'Enjoy',
'year': 2010}
2026-04-27 08:05:34 [auto1.es] INFO: Saving data for CD83035: {'auction_closing_time': 1777302908.0, 'created_time': 1777021924.716421, 'has_photos': True, 'last_price_update_time': 1777277134.41409}
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_3adc3aa54e3bd8ae34cb6750b5bcba55.jpg not downloaded yet
2026-04-27 08:05:34 [auto1.es] INFO: Found listing with ID: VM06943
2026-04-27 08:05:34 [auto1.es] INFO: Scrape type for VM06943: 2
2026-04-27 08:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943
2026-04-27 08:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae10540-fbab-561b-a6f1-536f23699ace with scrape type 2
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ae10540-fbab-561b-a6f1-536f23699ace with scrape type 2
2026-04-27 08:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ae10540-fbab-561b-a6f1-536f23699ace, identifier: VM06943
2026-04-27 08:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA16216> (referer: https://www.auto1.com/v1/car-details-view/EA16216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943
2026-04-27 08:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943
2026-04-27 08:05:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943 to the API
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:31:52Z',
'fuel_type': 'diesel',
'id': '3ae10540-fbab-561b-a6f1-536f23699ace',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM06943',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Urban Cruiser',
'odometer': 123855,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-11-16',
'seller_name': None,
'title': 'Toyota Urban Cruiser 1.4 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-04-27 08:05:34 [auto1.es] INFO: Saving data for VM06943: {'auction_closing_time': 1777303912.0, 'created_time': 1777018097.322834, 'has_photos': True, 'last_price_update_time': 1777277134.829997}
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_217d01853a9586dab6dad53e03f498e4.jpg not downloaded yet
2026-04-27 08:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_89849246bd223e6cd7b4dcaaa287d17b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cbf90>
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_5307f214d7b00d13b329397826aee1aa.jpg saved to cache
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_09da8472978a5d826a089c1f27faccb6.jpg not downloaded yet
2026-04-27 08:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_2974fae29ec8f0d0273d71c220f29eb5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_7bbcb4c86da5529bf39fe04347a54c37.jpg not downloaded yet
2026-04-27 08:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 with identifier: EA16216
2026-04-27 08:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 with scrape type 1
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_5d8e84d3d7a9053445ea0c5099514e69.jpg not downloaded yet
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_df2cb74878564329a28d11b488a22951.jpg not downloaded yet
2026-04-27 08:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_d24cad7f28aca4352a077c5deb00599e.jpg not downloaded yet
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837c950>
2026-04-27 08:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_89849246bd223e6cd7b4dcaaa287d17b.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_abafe178cbdeb670653a89be504f3659.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_bf7c4852787cd86ba61024a268433b11.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_240f5c086667bebac2cdb11130c1c538.jpg not downloaded yet
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048826690>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_2974fae29ec8f0d0273d71c220f29eb5.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_1a92fd98b9d2b4f86492a9031498bd70.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9f4b4ca449686de6d320a44981aec436.jpg not downloaded yet
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_97bfaa25913764ede625bbf61c658324.jpg not downloaded yet
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_3adc3aa54e3bd8ae34cb6750b5bcba55.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9a5ca6f59760dfad22119ece927c38dc.jpg not downloaded yet
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_09da8472978a5d826a089c1f27faccb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486e25d0>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_3adc3aa54e3bd8ae34cb6750b5bcba55.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9a5ca6f59760dfad22119ece927c38dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fff10>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_09da8472978a5d826a089c1f27faccb6.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_97bfaa25913764ede625bbf61c658324.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9f4b4ca449686de6d320a44981aec436.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048648dd0>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9a5ca6f59760dfad22119ece927c38dc.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_240f5c086667bebac2cdb11130c1c538.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_1a92fd98b9d2b4f86492a9031498bd70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_bf7c4852787cd86ba61024a268433b11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a2a90>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_97bfaa25913764ede625bbf61c658324.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL00701> (referer: https://www.auto1.com/v1/car-details-view/PL00701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048541710>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9f4b4ca449686de6d320a44981aec436.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486974d0>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_240f5c086667bebac2cdb11130c1c538.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_abafe178cbdeb670653a89be504f3659.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_d24cad7f28aca4352a077c5deb00599e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ62430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d10d0>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_1a92fd98b9d2b4f86492a9031498bd70.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a4b590>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_bf7c4852787cd86ba61024a268433b11.jpg saved to cache
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af2fb51-f36b-5ddf-a590-7d77c1256c30 with identifier: PL00701
2026-04-27 08:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30 with scrape type 1
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8a2a2b7145dd3cd1c83448878302ba10.jpg not downloaded yet
2026-04-27 08:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_4e33b6cb987030bbd5888747032e0dba.jpg not downloaded yet
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_df2cb74878564329a28d11b488a22951.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG16505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f92f5d2fb8b71d914e3b38f274e0f862.jpg not downloaded yet
2026-04-27 08:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f90a8895522f975321f98024883aa011.jpg not downloaded yet
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884dbd0>
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_abafe178cbdeb670653a89be504f3659.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481dbe90>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_d24cad7f28aca4352a077c5deb00599e.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_5d8e84d3d7a9053445ea0c5099514e69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_9d94fd258b660cf8860da1ebb125cee4.jpg not downloaded yet
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_7bbcb4c86da5529bf39fe04347a54c37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_217d01853a9586dab6dad53e03f498e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8a2a2b7145dd3cd1c83448878302ba10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_4e33b6cb987030bbd5888747032e0dba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_a3210b93c9b3144bff15a5756331ef2a.jpg not downloaded yet
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY32609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848ef10>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_df2cb74878564329a28d11b488a22951.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8d48e41e92438723d6228bee782ba2ca.jpg not downloaded yet
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_c8e0ef4da5f93c8f2c081d2aac85d37d.jpg not downloaded yet
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_e91672ed089ed0d19136e993a1c7b9f2.jpg not downloaded yet
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931bd0>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_5d8e84d3d7a9053445ea0c5099514e69.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1
2026-04-27 08:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1, skipping ID generation
2026-04-27 08:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 with scrape type 1
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 sending to next pipeline
2026-04-27 08:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1, identifier: EA16216
2026-04-27 08:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 with identifier: EA16216
2026-04-27 08:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 with identifier: EA16216
2026-04-27 08:05:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8edd2d64-6ee6-5e1c-b53d-f3276cb507f1 with identifier: EA16216 to the API
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_5d8e84d3d7a9053445ea0c5099514e69.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Manresa',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 245,
'expiration_date': '2026-04-27T15:38:42Z',
'fuel_type': 'petrol',
'id': '8edd2d64-6ee6-5e1c-b53d-f3276cb507f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.725,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA16216',
'listing': 'auction',
'location': 'ES, Manresa',
'location_confidence': 'geocoded',
'longitude': 1.8266,
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 61733,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65957,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_5d8e84d3d7a9053445ea0c5099514e69.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65775,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_df2cb74878564329a28d11b488a22951.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59011,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_d24cad7f28aca4352a077c5deb00599e.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_abafe178cbdeb670653a89be504f3659.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60628,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_bf7c4852787cd86ba61024a268433b11.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_240f5c086667bebac2cdb11130c1c538.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_1a92fd98b9d2b4f86492a9031498bd70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9f4b4ca449686de6d320a44981aec436.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63665,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_97bfaa25913764ede625bbf61c658324.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8edd2d64-6ee6-5e1c-b53d-f3276cb507f1/8edd2d64-6ee6-5e1c-b53d-f3276cb507f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a5/1ba5c7dfdd06717e978e47f123436bba/pa/EA16216_9a5ca6f59760dfad22119ece927c38dc.jpg',
'Width': 800}],
'postal_code': '08240',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2021-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2021}
2026-04-27 08:05:36 [auto1.es] INFO: Saving data for EA16216: {'created_time': 1777277136.744591, 'last_price_update_time': 1777277136.744601, 'has_photos': True, 'auction_closing_time': 1777304322.0}
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f90a8895522f975321f98024883aa011.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_19477449c640df2ce4040fcd82c4db06.jpg not downloaded yet
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_9d94fd258b660cf8860da1ebb125cee4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f92f5d2fb8b71d914e3b38f274e0f862.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6379ccc94727409431480c6a5957a770.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY07244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048495a10>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_7bbcb4c86da5529bf39fe04347a54c37.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843ce10>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_217d01853a9586dab6dad53e03f498e4.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048162210>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8a2a2b7145dd3cd1c83448878302ba10.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486abd50>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_4e33b6cb987030bbd5888747032e0dba.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_e91672ed089ed0d19136e993a1c7b9f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209150>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f90a8895522f975321f98024883aa011.jpg saved to cache
2026-04-27 08:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824df10>
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_9d94fd258b660cf8860da1ebb125cee4.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04880dc90>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f92f5d2fb8b71d914e3b38f274e0f862.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484dfb50>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6379ccc94727409431480c6a5957a770.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_19477449c640df2ce4040fcd82c4db06.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833a750>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_e91672ed089ed0d19136e993a1c7b9f2.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_c8e0ef4da5f93c8f2c081d2aac85d37d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8d48e41e92438723d6228bee782ba2ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048976010>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_19477449c640df2ce4040fcd82c4db06.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872c990>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_c8e0ef4da5f93c8f2c081d2aac85d37d.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893690>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8d48e41e92438723d6228bee782ba2ca.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_a3210b93c9b3144bff15a5756331ef2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_f6a6e65973154a6b89dced6c0e385581.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a3590>
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_a3210b93c9b3144bff15a5756331ef2a.jpg saved to cache
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30
2026-04-27 08:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3af2fb51-f36b-5ddf-a590-7d77c1256c30, skipping ID generation
2026-04-27 08:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30 with scrape type 1
2026-04-27 08:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3af2fb51-f36b-5ddf-a590-7d77c1256c30 sending to next pipeline
2026-04-27 08:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3af2fb51-f36b-5ddf-a590-7d77c1256c30, identifier: PL00701
2026-04-27 08:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3af2fb51-f36b-5ddf-a590-7d77c1256c30 with identifier: PL00701
2026-04-27 08:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3af2fb51-f36b-5ddf-a590-7d77c1256c30 with identifier: PL00701
2026-04-27 08:05:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3af2fb51-f36b-5ddf-a590-7d77c1256c30 with identifier: PL00701 to the API
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_a3210b93c9b3144bff15a5756331ef2a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'city': 'Oiartzun',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 121,
'expiration_date': '2026-04-27T15:07:27Z',
'fuel_type': 'petrol',
'id': '3af2fb51-f36b-5ddf-a590-7d77c1256c30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 43.2983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL00701',
'listing': 'auction',
'location': 'ES, Oiartzun',
'location_confidence': 'geocoded',
'longitude': -1.8613,
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 242872,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8a2a2b7145dd3cd1c83448878302ba10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_4e33b6cb987030bbd5888747032e0dba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f92f5d2fb8b71d914e3b38f274e0f862.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_f90a8895522f975321f98024883aa011.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_9d94fd258b660cf8860da1ebb125cee4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_a3210b93c9b3144bff15a5756331ef2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_8d48e41e92438723d6228bee782ba2ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_c8e0ef4da5f93c8f2c081d2aac85d37d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_e91672ed089ed0d19136e993a1c7b9f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3af2fb51-f36b-5ddf-a590-7d77c1256c30/3af2fb51-f36b-5ddf-a590-7d77c1256c30_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/68/9a682be059d405153d7c74304a52e754/pa/PL00701_19477449c640df2ce4040fcd82c4db06.jpg',
'Width': 800}],
'postal_code': '20180',
'price': 0,
'price_includes_vat': True,
'province': 'Guipúzcoa',
'province_code': 'ES-SS',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2014-08-13',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 PHEV Motion 4WD',
'transmission': 'automatic',
'trim': 'Motion 4WD',
'year': 2014}
2026-04-27 08:05:38 [auto1.es] INFO: Saving data for PL00701: {'created_time': 1777277138.036145, 'last_price_update_time': 1777277138.036156, 'has_photos': True, 'auction_closing_time': 1777302447.0}
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b94cb43afab2a37d70be10f290328c10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a3850>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_f6a6e65973154a6b89dced6c0e385581.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893290>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b94cb43afab2a37d70be10f290328c10.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_492d05d32d0bd50896db80b2ac7897fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_d8fe74227b46ffc2c51da3edb5ebca90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488913d0>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_492d05d32d0bd50896db80b2ac7897fd.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a2210>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_d8fe74227b46ffc2c51da3edb5ebca90.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_e02eb5c2da27d3e6080fd9edc808593e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_6d4b17c734e7ba7baa4d5a4ef51c97b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048891d10>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_e02eb5c2da27d3e6080fd9edc808593e.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885eb50>
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_6d4b17c734e7ba7baa4d5a4ef51c97b2.jpg saved to cache
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 636435c0-f56f-51b4-86b9-7f246d150e4c
2026-04-27 08:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 636435c0-f56f-51b4-86b9-7f246d150e4c, skipping ID generation
2026-04-27 08:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636435c0-f56f-51b4-86b9-7f246d150e4c with scrape type 1
2026-04-27 08:05:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 636435c0-f56f-51b4-86b9-7f246d150e4c sending to next pipeline
2026-04-27 08:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 636435c0-f56f-51b4-86b9-7f246d150e4c, identifier: XY68429
2026-04-27 08:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 636435c0-f56f-51b4-86b9-7f246d150e4c with identifier: XY68429
2026-04-27 08:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 636435c0-f56f-51b4-86b9-7f246d150e4c with identifier: XY68429
2026-04-27 08:05:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 636435c0-f56f-51b4-86b9-7f246d150e4c with identifier: XY68429 to the API
2026-04-27 08:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_6d4b17c734e7ba7baa4d5a4ef51c97b2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': 'Rental',
'city': 'Aldaya',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:17:08Z',
'fuel_type': 'petrol',
'id': '636435c0-f56f-51b4-86b9-7f246d150e4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY68429',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'i30',
'odometer': 219121,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_6d4b17c734e7ba7baa4d5a4ef51c97b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_d8fe74227b46ffc2c51da3edb5ebca90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_492d05d32d0bd50896db80b2ac7897fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_f6a6e65973154a6b89dced6c0e385581.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_89849246bd223e6cd7b4dcaaa287d17b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_2974fae29ec8f0d0273d71c220f29eb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_3adc3aa54e3bd8ae34cb6750b5bcba55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_217d01853a9586dab6dad53e03f498e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_09da8472978a5d826a089c1f27faccb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_636435c0-f56f-51b4-86b9-7f246d150e4c/636435c0-f56f-51b4-86b9-7f246d150e4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/bf/7fbf6e24cc00ea1dca871ef6f7d26675/pa/XY68429_7bbcb4c86da5529bf39fe04347a54c37.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i30 1.4 Essence',
'transmission': 'manual',
'trim': 'Essence',
'year': 2016}
2026-04-27 08:05:39 [auto1.es] INFO: Saving data for XY68429: {'created_time': 1777277139.223954, 'last_price_update_time': 1777277139.223968, 'has_photos': True, 'auction_closing_time': 1777303028.0}
2026-04-27 08:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b69cc824eb2b7d67f0df5dda2ef6a6b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7c50>
2026-04-27 08:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b69cc824eb2b7d67f0df5dda2ef6a6b4.jpg saved to cache
2026-04-27 08:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fc3b72b-65a0-5714-81e4-858b5087659a
2026-04-27 08:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fc3b72b-65a0-5714-81e4-858b5087659a, skipping ID generation
2026-04-27 08:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc3b72b-65a0-5714-81e4-858b5087659a with scrape type 1
2026-04-27 08:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fc3b72b-65a0-5714-81e4-858b5087659a sending to next pipeline
2026-04-27 08:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4fc3b72b-65a0-5714-81e4-858b5087659a, identifier: VE50785
2026-04-27 08:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785
2026-04-27 08:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785
2026-04-27 08:05:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785 to the API
2026-04-27 08:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b69cc824eb2b7d67f0df5dda2ef6a6b4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Calaf',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.2L',
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:39:30Z',
'fuel_type': 'diesel',
'id': '4fc3b72b-65a0-5714-81e4-858b5087659a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE50785',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Lexus',
'model': 'IS-Serie',
'odometer': 160087,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_44d3932124e645186f17b506890fa0ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_484df36370e44c5053c9fdbe061c6f63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_91dfad30774b2a51846038f1888630ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_2b0de32a3335e79a8f80b5645c608694.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6ca59e0c3583c32fae158470fc239c3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b69cc824eb2b7d67f0df5dda2ef6a6b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_e02eb5c2da27d3e6080fd9edc808593e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_5307f214d7b00d13b329397826aee1aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_b94cb43afab2a37d70be10f290328c10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4fc3b72b-65a0-5714-81e4-858b5087659a/4fc3b72b-65a0-5714-81e4-858b5087659a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/c6/3ac6912f448936cb78b96f2a31671194/pa/VE50785_6379ccc94727409431480c6a5957a770.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2006-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus IS-Serie IS 220d Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2006}
2026-04-27 08:05:39 [auto1.es] INFO: Saving data for VE50785: {'created_time': 1777277139.813165, 'last_price_update_time': 1777277139.813177, 'has_photos': True, 'auction_closing_time': 1777304370.0}
2026-04-27 08:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG04263> (referer: https://www.auto1.com/v1/car-details-view/DG04263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b2d58f-b577-5c9a-838b-8e160c6a98c4 with identifier: DG04263
2026-04-27 08:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4 with scrape type 1
2026-04-27 08:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_04591f10bba5f386f8de2021163509e2.jpg not downloaded yet
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_a6dc5ab7e976ec3f472dcd830d2e6777.jpg not downloaded yet
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_9499d3b76d341a31bbe648f86c26d1a9.jpg not downloaded yet
2026-04-27 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_885cebddc676b23a534c49f1159cc4c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_12729ab687743f96ae7503e36c476b59.jpg not downloaded yet
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_69d169005f2960aad8f8e99c5a1f0416.jpg not downloaded yet
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_8468086282bd7dc14a85c36a23189d3e.jpg not downloaded yet
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893290>
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_885cebddc676b23a534c49f1159cc4c2.jpg saved to cache
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_9499d3b76d341a31bbe648f86c26d1a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892c50>
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_9499d3b76d341a31bbe648f86c26d1a9.jpg saved to cache
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_8468086282bd7dc14a85c36a23189d3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_69d169005f2960aad8f8e99c5a1f0416.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885da50>
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_8468086282bd7dc14a85c36a23189d3e.jpg saved to cache
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486100d0>
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_69d169005f2960aad8f8e99c5a1f0416.jpg saved to cache
2026-04-27 08:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_12729ab687743f96ae7503e36c476b59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0ed0>
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_12729ab687743f96ae7503e36c476b59.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_a6dc5ab7e976ec3f472dcd830d2e6777.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_04591f10bba5f386f8de2021163509e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ebed0>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_a6dc5ab7e976ec3f472dcd830d2e6777.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fe90>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_04591f10bba5f386f8de2021163509e2.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4
2026-04-27 08:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78b2d58f-b577-5c9a-838b-8e160c6a98c4, skipping ID generation
2026-04-27 08:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4 with scrape type 1
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78b2d58f-b577-5c9a-838b-8e160c6a98c4 sending to next pipeline
2026-04-27 08:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78b2d58f-b577-5c9a-838b-8e160c6a98c4, identifier: DG04263
2026-04-27 08:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78b2d58f-b577-5c9a-838b-8e160c6a98c4 with identifier: DG04263
2026-04-27 08:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78b2d58f-b577-5c9a-838b-8e160c6a98c4 with identifier: DG04263
2026-04-27 08:05:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78b2d58f-b577-5c9a-838b-8e160c6a98c4 with identifier: DG04263 to the API
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_04591f10bba5f386f8de2021163509e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Alicante',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO N\\/A',
'engine': '1.4L',
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:43:30Z',
'fuel_type': 'petrol',
'id': '78b2d58f-b577-5c9a-838b-8e160c6a98c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG04263',
'listing': 'auction',
'location': 'ES, Alicante',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'MINI',
'odometer': 131806,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_04591f10bba5f386f8de2021163509e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_a6dc5ab7e976ec3f472dcd830d2e6777.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_9499d3b76d341a31bbe648f86c26d1a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_12729ab687743f96ae7503e36c476b59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_69d169005f2960aad8f8e99c5a1f0416.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78b2d58f-b577-5c9a-838b-8e160c6a98c4/78b2d58f-b577-5c9a-838b-8e160c6a98c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46cf54ae8a213830fa2f6e322d408f7/pa/DG04263_8468086282bd7dc14a85c36a23189d3e.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-08-11',
'seats_number': 4,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-04-27 08:05:50 [auto1.es] INFO: Saving data for DG04263: {'created_time': 1777277150.874477, 'last_price_update_time': 1777277150.874488, 'has_photos': True, 'auction_closing_time': 1777304610.0}
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_856972aa06b682025e9d867e4e5da953.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE25004> (referer: https://www.auto1.com/v1/car-details-view/UE25004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833a5d0>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_856972aa06b682025e9d867e4e5da953.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_4f1f09a3cfa8dbd0af58b087c1a5721f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f303d8b-eb6e-5f54-94dd-e67edbf76464 with identifier: UE25004
2026-04-27 08:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464 with scrape type 1
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_83d8b3dc74c98b702b7e46d53d730af6.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_c0384dc98d00e08d0290c40904825532.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_f788f5fcafbf740ebb4764b3c8287246.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_707c729939ddcefedc400167fd021334.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_1937c88031a8d3a6661b9d5c3c1174f1.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_a1a4ccfe7defdcaf8d327b47dc6c1c34.jpg not downloaded yet
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c2d0>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_4f1f09a3cfa8dbd0af58b087c1a5721f.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_498c0c1115396be9839a319be39a1570.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_666bb4a3a7e37b6482131f1edae6b909.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_e7502b3b066eb44437c566c68b1f6d80.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_d6ddb1fe1d17cac2c0a7280ab2d44fbe.jpg not downloaded yet
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ62430> (referer: https://www.auto1.com/v1/car-details-view/DJ62430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6093ab5-7a4a-52b3-88fe-48be7203c0c2 with identifier: DJ62430
2026-04-27 08:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2 with scrape type 1
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_7a9066ff09b86da1575ec98dc8f05367.jpg not downloaded yet
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_fa4e36b09842a6e68ea9e52100f37428.jpg not downloaded yet
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_af5b040dc1ee5169e297f6f86c7ad1df.jpg not downloaded yet
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_ed6eedc179e4de7916347c34dcb47b50.jpg not downloaded yet
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_d6ddb1fe1d17cac2c0a7280ab2d44fbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_0d69c01daed6c25eaf4514744b5f5068.jpg not downloaded yet
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_cbd61113e7084d12870cec8f975c3f4f.jpg not downloaded yet
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_ed6eedc179e4de7916347c34dcb47b50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d7e90>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_d6ddb1fe1d17cac2c0a7280ab2d44fbe.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_cbd61113e7084d12870cec8f975c3f4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048661bd0>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_ed6eedc179e4de7916347c34dcb47b50.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_0d69c01daed6c25eaf4514744b5f5068.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a40210>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_cbd61113e7084d12870cec8f975c3f4f.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR68963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d7190>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_0d69c01daed6c25eaf4514744b5f5068.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_fa4e36b09842a6e68ea9e52100f37428.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_af5b040dc1ee5169e297f6f86c7ad1df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885d5d0>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_fa4e36b09842a6e68ea9e52100f37428.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898bd10>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_af5b040dc1ee5169e297f6f86c7ad1df.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_e7502b3b066eb44437c566c68b1f6d80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_7a9066ff09b86da1575ec98dc8f05367.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483eb1d0>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_e7502b3b066eb44437c566c68b1f6d80.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04814d190>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_7a9066ff09b86da1575ec98dc8f05367.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2
2026-04-27 08:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6093ab5-7a4a-52b3-88fe-48be7203c0c2, skipping ID generation
2026-04-27 08:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2 with scrape type 1
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6093ab5-7a4a-52b3-88fe-48be7203c0c2 sending to next pipeline
2026-04-27 08:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6093ab5-7a4a-52b3-88fe-48be7203c0c2, identifier: DJ62430
2026-04-27 08:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6093ab5-7a4a-52b3-88fe-48be7203c0c2 with identifier: DJ62430
2026-04-27 08:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6093ab5-7a4a-52b3-88fe-48be7203c0c2 with identifier: DJ62430
2026-04-27 08:05:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6093ab5-7a4a-52b3-88fe-48be7203c0c2 with identifier: DJ62430 to the API
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_7a9066ff09b86da1575ec98dc8f05367.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Rebolledo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO N\\/A',
'engine': '1.4L',
'engine_horse_power': 88,
'expiration_date': '2026-04-27T15:21:01Z',
'fuel_type': 'petrol',
'id': 'f6093ab5-7a4a-52b3-88fe-48be7203c0c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ62430',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Peugeot',
'model': '207',
'odometer': 101570,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_7a9066ff09b86da1575ec98dc8f05367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_fa4e36b09842a6e68ea9e52100f37428.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_af5b040dc1ee5169e297f6f86c7ad1df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_ed6eedc179e4de7916347c34dcb47b50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_0d69c01daed6c25eaf4514744b5f5068.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6093ab5-7a4a-52b3-88fe-48be7203c0c2/f6093ab5-7a4a-52b3-88fe-48be7203c0c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/7c/b37cb42316f0a37e7d795760cf96527a/pa/DJ62430_cbd61113e7084d12870cec8f975c3f4f.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2006-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 X Line',
'transmission': 'manual',
'trim': 'X Line',
'year': 2006}
2026-04-27 08:05:53 [auto1.es] INFO: Saving data for DJ62430: {'created_time': 1777277153.574555, 'last_price_update_time': 1777277153.574567, 'has_photos': True, 'auction_closing_time': 1777303261.0}
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_666bb4a3a7e37b6482131f1edae6b909.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA34637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG16505> (referer: https://www.auto1.com/v1/car-details-view/SG16505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b8d50>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_666bb4a3a7e37b6482131f1edae6b909.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f25c6a-b706-5c39-9d48-3d096dd7281b with identifier: SG16505
2026-04-27 08:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f25c6a-b706-5c39-9d48-3d096dd7281b with scrape type 1
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_5f0cc5f6b5aa6c85174cb59794873e09.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_556f3232483b80a1e78e4443aba33840.jpg not downloaded yet
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_a1a4ccfe7defdcaf8d327b47dc6c1c34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_1937c88031a8d3a6661b9d5c3c1174f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ea20425f3282bbc22c3efbef7f5d3d78.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_86879e463c33b7956e75c3d18b975b61.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_0e7c39f3fe15d54a48645462c3199e26.jpg not downloaded yet
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_498c0c1115396be9839a319be39a1570.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_9b68e81017318584712376c696ad8c3b.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_24d245fb0b24fe3cf47e03a24e05d050.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_7e22d58d85cbe98f0f2b8b9b255d053e.jpg not downloaded yet
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_5f0cc5f6b5aa6c85174cb59794873e09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ee862ac9b01b9987959b8a4f63afe56c.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_faa469eb220f5bbaf1c5c09959291411.jpg not downloaded yet
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a0a90>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_a1a4ccfe7defdcaf8d327b47dc6c1c34.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d6990>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_1937c88031a8d3a6661b9d5c3c1174f1.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_0e7c39f3fe15d54a48645462c3199e26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_7e22d58d85cbe98f0f2b8b9b255d053e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048656f90>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_498c0c1115396be9839a319be39a1570.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823d0d0>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_5f0cc5f6b5aa6c85174cb59794873e09.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d6b10>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_0e7c39f3fe15d54a48645462c3199e26.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e990>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_7e22d58d85cbe98f0f2b8b9b255d053e.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ee862ac9b01b9987959b8a4f63afe56c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_faa469eb220f5bbaf1c5c09959291411.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892e90>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ee862ac9b01b9987959b8a4f63afe56c.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b610>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_faa469eb220f5bbaf1c5c09959291411.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_24d245fb0b24fe3cf47e03a24e05d050.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_86879e463c33b7956e75c3d18b975b61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885c890>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_24d245fb0b24fe3cf47e03a24e05d050.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_9b68e81017318584712376c696ad8c3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893690>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_86879e463c33b7956e75c3d18b975b61.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483eba10>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_9b68e81017318584712376c696ad8c3b.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ea20425f3282bbc22c3efbef7f5d3d78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY32609> (referer: https://www.auto1.com/v1/car-details-view/AY32609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_556f3232483b80a1e78e4443aba33840.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a3150>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ea20425f3282bbc22c3efbef7f5d3d78.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88d1321-bf65-5665-9c48-de440cb94212 with identifier: AY32609
2026-04-27 08:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88d1321-bf65-5665-9c48-de440cb94212 with scrape type 1
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_54c218d7e0d129b63c5900bb9498339a.jpg not downloaded yet
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_804a509416f55453787f146eef6e249a.jpg not downloaded yet
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4ad679744c175f025a8fb3f77a05cfcb.jpg not downloaded yet
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4a51d4d18d2581a079a54a439d670c86.jpg not downloaded yet
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_707c729939ddcefedc400167fd021334.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f4b5e95bc86f4dd0aed147de4e48ddfe.jpg not downloaded yet
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_f788f5fcafbf740ebb4764b3c8287246.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f6a961283dbbb765ad880d70de0fa0bf.jpg not downloaded yet
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_8b13f2807356e40e51806ca8e6c1d307.jpg not downloaded yet
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a7950>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_556f3232483b80a1e78e4443aba33840.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78f25c6a-b706-5c39-9d48-3d096dd7281b
2026-04-27 08:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78f25c6a-b706-5c39-9d48-3d096dd7281b, skipping ID generation
2026-04-27 08:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f25c6a-b706-5c39-9d48-3d096dd7281b with scrape type 1
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78f25c6a-b706-5c39-9d48-3d096dd7281b sending to next pipeline
2026-04-27 08:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78f25c6a-b706-5c39-9d48-3d096dd7281b, identifier: SG16505
2026-04-27 08:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78f25c6a-b706-5c39-9d48-3d096dd7281b with identifier: SG16505
2026-04-27 08:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78f25c6a-b706-5c39-9d48-3d096dd7281b with identifier: SG16505
2026-04-27 08:05:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78f25c6a-b706-5c39-9d48-3d096dd7281b with identifier: SG16505 to the API
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_556f3232483b80a1e78e4443aba33840.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Barcelona',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-27T15:24:26Z',
'fuel_type': 'petrol',
'id': '78f25c6a-b706-5c39-9d48-3d096dd7281b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG16505',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Fiat',
'model': '500',
'odometer': 140237,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_5f0cc5f6b5aa6c85174cb59794873e09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_556f3232483b80a1e78e4443aba33840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ea20425f3282bbc22c3efbef7f5d3d78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_86879e463c33b7956e75c3d18b975b61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_0e7c39f3fe15d54a48645462c3199e26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_9b68e81017318584712376c696ad8c3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_24d245fb0b24fe3cf47e03a24e05d050.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_7e22d58d85cbe98f0f2b8b9b255d053e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_ee862ac9b01b9987959b8a4f63afe56c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_78f25c6a-b706-5c39-9d48-3d096dd7281b/78f25c6a-b706-5c39-9d48-3d096dd7281b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/88/6d88660e13601aef6c461d61a210d9f0/pa/SG16505_faa469eb220f5bbaf1c5c09959291411.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2017-06-26',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-04-27 08:05:55 [auto1.es] INFO: Saving data for SG16505: {'created_time': 1777277155.494217, 'last_price_update_time': 1777277155.49423, 'has_photos': True, 'auction_closing_time': 1777303466.0}
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_5199259118c39ee305054a37d02642e2.jpg not downloaded yet
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_c0384dc98d00e08d0290c40904825532.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4a51d4d18d2581a079a54a439d670c86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4ad679744c175f025a8fb3f77a05cfcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_edb8cd0582a047c5e22f554916c539a0.jpg not downloaded yet
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7a850>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_707c729939ddcefedc400167fd021334.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485922d0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_f788f5fcafbf740ebb4764b3c8287246.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_0953eca50aa3802060c36a3d01c69a7c.jpg not downloaded yet
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843c4d0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_c0384dc98d00e08d0290c40904825532.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048805c10>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4a51d4d18d2581a079a54a439d670c86.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d6450>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4ad679744c175f025a8fb3f77a05cfcb.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_8b13f2807356e40e51806ca8e6c1d307.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_5199259118c39ee305054a37d02642e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f6a961283dbbb765ad880d70de0fa0bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY07244> (referer: https://www.auto1.com/v1/car-details-view/FY07244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_0953eca50aa3802060c36a3d01c69a7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_edb8cd0582a047c5e22f554916c539a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f4b5e95bc86f4dd0aed147de4e48ddfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_804a509416f55453787f146eef6e249a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f52d0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_8b13f2807356e40e51806ca8e6c1d307.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_83d8b3dc74c98b702b7e46d53d730af6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_a13d0dcec6f774597cebfacda524b401.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff05712e8d0>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_5199259118c39ee305054a37d02642e2.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048871650>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f6a961283dbbb765ad880d70de0fa0bf.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19386e03-b0cb-53c1-ac74-0cceb4141507 with identifier: FY07244
2026-04-27 08:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19386e03-b0cb-53c1-ac74-0cceb4141507 with scrape type 1
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5d61242a94da0375274999e82215320a.jpg not downloaded yet
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_54c218d7e0d129b63c5900bb9498339a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_330927031180eea1143cc4ea464aa843.jpg not downloaded yet
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_90a4fdd942f5ca34403653cc0eed21b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520210>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_0953eca50aa3802060c36a3d01c69a7c.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852a050>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_edb8cd0582a047c5e22f554916c539a0.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872e710>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f4b5e95bc86f4dd0aed147de4e48ddfe.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486559d0>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_804a509416f55453787f146eef6e249a.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048338ed0>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_83d8b3dc74c98b702b7e46d53d730af6.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464
2026-04-27 08:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f303d8b-eb6e-5f54-94dd-e67edbf76464, skipping ID generation
2026-04-27 08:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464 with scrape type 1
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f303d8b-eb6e-5f54-94dd-e67edbf76464 sending to next pipeline
2026-04-27 08:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f303d8b-eb6e-5f54-94dd-e67edbf76464, identifier: UE25004
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048988790>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_a13d0dcec6f774597cebfacda524b401.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_ae4ab6d64145c587bfcfb9476cba34f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_930450e9b68960962a8fea41cbd9ecd1.jpg not downloaded yet
2026-04-27 08:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f303d8b-eb6e-5f54-94dd-e67edbf76464 with identifier: UE25004
2026-04-27 08:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f303d8b-eb6e-5f54-94dd-e67edbf76464 with identifier: UE25004
2026-04-27 08:05:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f303d8b-eb6e-5f54-94dd-e67edbf76464 with identifier: UE25004 to the API
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_83d8b3dc74c98b702b7e46d53d730af6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'city': 'Pamplona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:44:46Z',
'fuel_type': 'diesel',
'id': '3f303d8b-eb6e-5f54-94dd-e67edbf76464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE25004',
'listing': 'auction',
'location': 'ES, Pamplona',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '5008',
'odometer': 165151,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_83d8b3dc74c98b702b7e46d53d730af6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_c0384dc98d00e08d0290c40904825532.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_f788f5fcafbf740ebb4764b3c8287246.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_707c729939ddcefedc400167fd021334.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_1937c88031a8d3a6661b9d5c3c1174f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_a1a4ccfe7defdcaf8d327b47dc6c1c34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_498c0c1115396be9839a319be39a1570.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_666bb4a3a7e37b6482131f1edae6b909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_e7502b3b066eb44437c566c68b1f6d80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f303d8b-eb6e-5f54-94dd-e67edbf76464/3f303d8b-eb6e-5f54-94dd-e67edbf76464_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/e7/dae7557d8a990f3b65980a51d067f096/pa/UE25004_d6ddb1fe1d17cac2c0a7280ab2d44fbe.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-04-30',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 HDi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2012}
2026-04-27 08:05:57 [auto1.es] INFO: Saving data for UE25004: {'created_time': 1777277157.268315, 'last_price_update_time': 1777277157.268325, 'has_photos': True, 'auction_closing_time': 1777304686.0}
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK19551> (referer: https://www.auto1.com/v1/car-details-view/XK19551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_544e7ab315d6246095dac6d6aa153398.jpg not downloaded yet
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX54724/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048852010>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_54c218d7e0d129b63c5900bb9498339a.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e88d1321-bf65-5665-9c48-de440cb94212
2026-04-27 08:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e88d1321-bf65-5665-9c48-de440cb94212, skipping ID generation
2026-04-27 08:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88d1321-bf65-5665-9c48-de440cb94212 with scrape type 1
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e88d1321-bf65-5665-9c48-de440cb94212 sending to next pipeline
2026-04-27 08:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e88d1321-bf65-5665-9c48-de440cb94212, identifier: AY32609
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485428d0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_90a4fdd942f5ca34403653cc0eed21b3.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF66391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e88d1321-bf65-5665-9c48-de440cb94212 with identifier: AY32609
2026-04-27 08:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e88d1321-bf65-5665-9c48-de440cb94212 with identifier: AY32609
2026-04-27 08:05:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e88d1321-bf65-5665-9c48-de440cb94212 with identifier: AY32609 to the API
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_54c218d7e0d129b63c5900bb9498339a.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 400,
'expiration_date': '2026-04-27T15:31:21Z',
'fuel_type': 'diesel',
'id': 'e88d1321-bf65-5665-9c48-de440cb94212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY32609',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X7',
'odometer': 154977,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_54c218d7e0d129b63c5900bb9498339a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_804a509416f55453787f146eef6e249a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4ad679744c175f025a8fb3f77a05cfcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_4a51d4d18d2581a079a54a439d670c86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f4b5e95bc86f4dd0aed147de4e48ddfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_f6a961283dbbb765ad880d70de0fa0bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_8b13f2807356e40e51806ca8e6c1d307.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_5199259118c39ee305054a37d02642e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_edb8cd0582a047c5e22f554916c539a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e88d1321-bf65-5665-9c48-de440cb94212/e88d1321-bf65-5665-9c48-de440cb94212_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/e9/bce93c061e67346870e85a19958b09a4/pa/AY32609_0953eca50aa3802060c36a3d01c69a7c.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-11-28',
'seats_number': 7,
'seller_name': None,
'title': 'BMW X7 M50d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-04-27 08:05:57 [auto1.es] INFO: Saving data for AY32609: {'created_time': 1777277157.880346, 'last_price_update_time': 1777277157.880356, 'has_photos': True, 'auction_closing_time': 1777303881.0}
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ba410>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_ae4ab6d64145c587bfcfb9476cba34f4.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_c86227565df4af3dc7b4572748c43b5c.jpg not downloaded yet
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5d61242a94da0375274999e82215320a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_d4ecb3ac385a0925e7e52aadd719ff05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_330927031180eea1143cc4ea464aa843.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd4009f5-62a7-50e6-8582-0f08fd2ddd89 with identifier: XK19551
2026-04-27 08:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89 with scrape type 1
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_b0e11d32ef97ee9740835f80bea7763a.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_fd2b8f3e1e2ed95ac97cc85c960389a5.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_930450e9b68960962a8fea41cbd9ecd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_9e54951072350ef2cefcf80f0452e83b.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_f31ab671859f7a6665fb9cb30dfbff17.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_544e7ab315d6246095dac6d6aa153398.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_bfe2490bd22912f426a12a4f59bd1684.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5ac59878124d8048bf59398fe77ce044.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_b9efee2bfcfefdcd3ef336436c20a5ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5464ee05b1289738acb61bb20d17b064.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_298d166b6c9cd8e256e547300a0c86b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_691be1baff5c5ea1ccb60186770bcd77.jpg not downloaded yet
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483834d0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5d61242a94da0375274999e82215320a.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048610490>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_d4ecb3ac385a0925e7e52aadd719ff05.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841d990>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_330927031180eea1143cc4ea464aa843.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_e2f012711f2bce0d09c2a2e838302e73.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_fe4b30910593e6de9506c2ac765d1993.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_7ba7ace82d5b0a86a229293ee994738e.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_fed1372872a0fabe350b27962ca3f0a5.jpg not downloaded yet
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894250>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_930450e9b68960962a8fea41cbd9ecd1.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843e990>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_544e7ab315d6246095dac6d6aa153398.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207e90>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_b9efee2bfcfefdcd3ef336436c20a5ac.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a41150>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_298d166b6c9cd8e256e547300a0c86b3.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_9e54951072350ef2cefcf80f0452e83b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5b78ea9a73d17398b5908caa5a9bca45.jpg not downloaded yet
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5ac59878124d8048bf59398fe77ce044.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_bfe2490bd22912f426a12a4f59bd1684.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662290>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_fe4b30910593e6de9506c2ac765d1993.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_214b231e7d17ba5dc10e73c87b548c2a.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_f2f7c6cb0d7e6bff89aedc8b470bd4a7.jpg not downloaded yet
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_6408b8dc6933aabe423663d0ff20a5bb.jpg not downloaded yet
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485665d0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_9e54951072350ef2cefcf80f0452e83b.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_691be1baff5c5ea1ccb60186770bcd77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2150>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5ac59878124d8048bf59398fe77ce044.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ee190>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_bfe2490bd22912f426a12a4f59bd1684.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_7ba7ace82d5b0a86a229293ee994738e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_e2f012711f2bce0d09c2a2e838302e73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048339750>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_691be1baff5c5ea1ccb60186770bcd77.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_fed1372872a0fabe350b27962ca3f0a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fde50>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_7ba7ace82d5b0a86a229293ee994738e.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e3d10>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_e2f012711f2bce0d09c2a2e838302e73.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_214b231e7d17ba5dc10e73c87b548c2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04875aa50>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_fed1372872a0fabe350b27962ca3f0a5.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_6408b8dc6933aabe423663d0ff20a5bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_f2f7c6cb0d7e6bff89aedc8b470bd4a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c0250>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_214b231e7d17ba5dc10e73c87b548c2a.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5b78ea9a73d17398b5908caa5a9bca45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC83489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e3650>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_6408b8dc6933aabe423663d0ff20a5bb.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483deed0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_f2f7c6cb0d7e6bff89aedc8b470bd4a7.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_fd2b8f3e1e2ed95ac97cc85c960389a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_f31ab671859f7a6665fb9cb30dfbff17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5464ee05b1289738acb61bb20d17b064.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a425d0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5b78ea9a73d17398b5908caa5a9bca45.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_c86227565df4af3dc7b4572748c43b5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_b0e11d32ef97ee9740835f80bea7763a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_16180fb877b4cc9fa0ff4fecdccabdaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048565d90>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_fd2b8f3e1e2ed95ac97cc85c960389a5.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fc590>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_f31ab671859f7a6665fb9cb30dfbff17.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_40ff861b6b570a39263e4806573680cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488b8410>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5464ee05b1289738acb61bb20d17b064.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_530c676e681d24bd1f0141804dc06781.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0750>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_c86227565df4af3dc7b4572748c43b5c.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19386e03-b0cb-53c1-ac74-0cceb4141507
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19386e03-b0cb-53c1-ac74-0cceb4141507, skipping ID generation
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19386e03-b0cb-53c1-ac74-0cceb4141507 with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19386e03-b0cb-53c1-ac74-0cceb4141507 sending to next pipeline
2026-04-27 08:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 19386e03-b0cb-53c1-ac74-0cceb4141507, identifier: FY07244
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fb8d0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_b0e11d32ef97ee9740835f80bea7763a.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd4009f5-62a7-50e6-8582-0f08fd2ddd89, skipping ID generation
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89 with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd4009f5-62a7-50e6-8582-0f08fd2ddd89 sending to next pipeline
2026-04-27 08:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd4009f5-62a7-50e6-8582-0f08fd2ddd89, identifier: XK19551
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833a050>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_16180fb877b4cc9fa0ff4fecdccabdaa.jpg saved to cache
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8
2026-04-27 08:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8, skipping ID generation
2026-04-27 08:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 with scrape type 1
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 sending to next pipeline
2026-04-27 08:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8, identifier: LA91649
2026-04-27 08:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 19386e03-b0cb-53c1-ac74-0cceb4141507 with identifier: FY07244
2026-04-27 08:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 19386e03-b0cb-53c1-ac74-0cceb4141507 with identifier: FY07244
2026-04-27 08:06:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 19386e03-b0cb-53c1-ac74-0cceb4141507 with identifier: FY07244 to the API
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_c86227565df4af3dc7b4572748c43b5c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': 'Taxi',
'city': 'Araia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:18:44Z',
'fuel_type': 'diesel',
'id': '19386e03-b0cb-53c1-ac74-0cceb4141507',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY07244',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Skoda',
'model': 'Octavia',
'odometer': 42972,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5d61242a94da0375274999e82215320a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_330927031180eea1143cc4ea464aa843.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_930450e9b68960962a8fea41cbd9ecd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_544e7ab315d6246095dac6d6aa153398.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_c86227565df4af3dc7b4572748c43b5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_fd2b8f3e1e2ed95ac97cc85c960389a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_f31ab671859f7a6665fb9cb30dfbff17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_5ac59878124d8048bf59398fe77ce044.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_691be1baff5c5ea1ccb60186770bcd77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_19386e03-b0cb-53c1-ac74-0cceb4141507/19386e03-b0cb-53c1-ac74-0cceb4141507_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/22/0522d4fce0a3f119fa6c70413add6938/pa/FY07244_7ba7ace82d5b0a86a229293ee994738e.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2023-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-04-27 08:06:00 [auto1.es] INFO: Saving data for FY07244: {'created_time': 1777277160.557507, 'last_price_update_time': 1777277160.557517, 'has_photos': True, 'auction_closing_time': 1777303124.0}
2026-04-27 08:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd4009f5-62a7-50e6-8582-0f08fd2ddd89 with identifier: XK19551
2026-04-27 08:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd4009f5-62a7-50e6-8582-0f08fd2ddd89 with identifier: XK19551
2026-04-27 08:06:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd4009f5-62a7-50e6-8582-0f08fd2ddd89 with identifier: XK19551 to the API
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_b0e11d32ef97ee9740835f80bea7763a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-04-27T15:41:46Z',
'fuel_type': 'petrol',
'id': 'dd4009f5-62a7-50e6-8582-0f08fd2ddd89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK19551',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Ford',
'model': 'Ka+',
'odometer': 76093,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_b0e11d32ef97ee9740835f80bea7763a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_9e54951072350ef2cefcf80f0452e83b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_bfe2490bd22912f426a12a4f59bd1684.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5464ee05b1289738acb61bb20d17b064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_e2f012711f2bce0d09c2a2e838302e73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_fed1372872a0fabe350b27962ca3f0a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_5b78ea9a73d17398b5908caa5a9bca45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_214b231e7d17ba5dc10e73c87b548c2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_f2f7c6cb0d7e6bff89aedc8b470bd4a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd4009f5-62a7-50e6-8582-0f08fd2ddd89/dd4009f5-62a7-50e6-8582-0f08fd2ddd89_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/91/8591bdb8028ba25ff861b6bb47a3d465/pa/XK19551_6408b8dc6933aabe423663d0ff20a5bb.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2017-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ka+ 1.2 Ti-VCT Ultimate',
'transmission': 'manual',
'trim': 'Ultimate',
'year': 2017}
2026-04-27 08:06:00 [auto1.es] INFO: Saving data for XK19551: {'created_time': 1777277160.869064, 'last_price_update_time': 1777277160.869075, 'has_photos': True, 'auction_closing_time': 1777304506.0}
2026-04-27 08:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 with identifier: LA91649
2026-04-27 08:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 with identifier: LA91649
2026-04-27 08:06:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8 with identifier: LA91649 to the API
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_16180fb877b4cc9fa0ff4fecdccabdaa.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Aldaya',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.4L',
'engine_horse_power': 88,
'expiration_date': '2026-04-27T15:37:50Z',
'fuel_type': 'petrol',
'id': 'b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA91649',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '207',
'odometer': 115618,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_16180fb877b4cc9fa0ff4fecdccabdaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_92fd61ab8c3c7cac855dbc1a7407de9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_298d166b6c9cd8e256e547300a0c86b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_d4ecb3ac385a0925e7e52aadd719ff05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_21f3f15cb02a5395fbedf2e7a7c1f968.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8/b39e76a2-f44d-51d9-bd7e-44d8aec3e7d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/88/8288fbb53456c2b239081caa5693e45d/pa/LA91649_a13d0dcec6f774597cebfacda524b401.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 X Line',
'transmission': 'manual',
'trim': 'X Line',
'year': 2006}
2026-04-27 08:06:01 [auto1.es] INFO: Saving data for LA91649: {'created_time': 1777277161.209073, 'last_price_update_time': 1777277161.209083, 'has_photos': True, 'auction_closing_time': 1777304270.0}
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR68963> (referer: https://www.auto1.com/v1/car-details-view/NR68963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483de810>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_40ff861b6b570a39263e4806573680cd.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048715ed0>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_530c676e681d24bd1f0141804dc06781.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f
2026-04-27 08:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f, skipping ID generation
2026-04-27 08:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f with scrape type 1
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f sending to next pipeline
2026-04-27 08:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f, identifier: HP09139
2026-04-27 08:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f with identifier: HP09139
2026-04-27 08:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f with identifier: HP09139
2026-04-27 08:06:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 861c0ee0-649e-5ec4-ad62-f9914bdb8c2f with identifier: HP09139 to the API
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_530c676e681d24bd1f0141804dc06781.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Araia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:16:30Z',
'fuel_type': 'petrol',
'id': '861c0ee0-649e-5ec4-ad62-f9914bdb8c2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP09139',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Opel',
'model': 'Mokka',
'odometer': 115689,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_40ff861b6b570a39263e4806573680cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_530c676e681d24bd1f0141804dc06781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_b9efee2bfcfefdcd3ef336436c20a5ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_fe4b30910593e6de9506c2ac765d1993.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_ae4ab6d64145c587bfcfb9476cba34f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_90a4fdd942f5ca34403653cc0eed21b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_4f1f09a3cfa8dbd0af58b087c1a5721f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_92744ac74c6d5ccb6e9b582b85484b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_856972aa06b682025e9d867e4e5da953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_861c0ee0-649e-5ec4-ad62-f9914bdb8c2f/861c0ee0-649e-5ec4-ad62-f9914bdb8c2f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/10/4610941fe00c0c729fa6e84572b6cd1d/pa/HP09139_885cebddc676b23a534c49f1159cc4c2.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2013-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Cosmo 4x4',
'transmission': 'manual',
'trim': 'Cosmo 4x4',
'year': 2013}
2026-04-27 08:06:01 [auto1.es] INFO: Saving data for HP09139: {'created_time': 1777277161.862152, 'last_price_update_time': 1777277161.862162, 'has_photos': True, 'auction_closing_time': 1777302990.0}
2026-04-27 08:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea6867a-bcc7-5061-a9bb-0c92b64e3979 with identifier: NR68963
2026-04-27 08:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea6867a-bcc7-5061-a9bb-0c92b64e3979 with scrape type 1
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_f87875e9888b89edbf883bb3f118bffe.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_684b7ef78712aa6c27a9854978a6bcc4.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_9fae7f2d5e5593a00316cb9526df7136.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_7508a55641e1c82fb47ef1a0387be3e5.jpg not downloaded yet
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_56a3a4487ec6534817ae3da509ee379f.jpg not downloaded yet
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_b869abc4fd592d81cd49b71cca4d20c3.jpg not downloaded yet
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_954113f93594b7a22e98f10aea4bd5be.jpg not downloaded yet
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_a83097dece3156a60f310aed88b9ceb0.jpg not downloaded yet
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_39a4ced03e122c7e85c2a04edc0458dc.jpg not downloaded yet
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_c2ec65edab92a53939c67cc5b0d3a2be.jpg not downloaded yet
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG64756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_c2ec65edab92a53939c67cc5b0d3a2be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048873f10>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_c2ec65edab92a53939c67cc5b0d3a2be.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_39a4ced03e122c7e85c2a04edc0458dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048715dd0>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_39a4ced03e122c7e85c2a04edc0458dc.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU90571/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_a83097dece3156a60f310aed88b9ceb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ff210>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_a83097dece3156a60f310aed88b9ceb0.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA96851> (referer: https://www.auto1.com/v1/car-details-view/CA96851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 095aac09-d686-5b2b-ba03-1006dd102318 with identifier: CA96851
2026-04-27 08:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 095aac09-d686-5b2b-ba03-1006dd102318 with scrape type 1
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_8e44cce2251dd770882702ed2a0a6f07.jpg not downloaded yet
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_954113f93594b7a22e98f10aea4bd5be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_df135f8cc969f47bfaa48b209c9b93b3.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_e5345647f3e4a809cb2e769e8533dbeb.jpg not downloaded yet
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_6091b5ba4f2b6fe04127bdd4c40fee3f.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_164d6ad72318606c3d5c8742a0381419.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_52edb54bb54c0208709d842827bdd20e.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_fbf59907df563af6adb42543152aafbe.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_ef04b5af6bf021c0e7182e8a0c62a4e3.jpg not downloaded yet
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_8e44cce2251dd770882702ed2a0a6f07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_5f2c4aaa2cc36fc214d6d6aad4793c09.jpg not downloaded yet
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a1710>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_954113f93594b7a22e98f10aea4bd5be.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_4d846e15dfc431b8b54f130e97575ec9.jpg not downloaded yet
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cbcd0>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_8e44cce2251dd770882702ed2a0a6f07.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_ef04b5af6bf021c0e7182e8a0c62a4e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489888d0>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_ef04b5af6bf021c0e7182e8a0c62a4e3.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_4d846e15dfc431b8b54f130e97575ec9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851d10>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_4d846e15dfc431b8b54f130e97575ec9.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_5f2c4aaa2cc36fc214d6d6aad4793c09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_fbf59907df563af6adb42543152aafbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b710>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_5f2c4aaa2cc36fc214d6d6aad4793c09.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_52edb54bb54c0208709d842827bdd20e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486eee90>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_fbf59907df563af6adb42543152aafbe.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488538d0>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_52edb54bb54c0208709d842827bdd20e.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_164d6ad72318606c3d5c8742a0381419.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_6091b5ba4f2b6fe04127bdd4c40fee3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ffb90>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_164d6ad72318606c3d5c8742a0381419.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_e5345647f3e4a809cb2e769e8533dbeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ff090>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_6091b5ba4f2b6fe04127bdd4c40fee3f.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876f850>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_e5345647f3e4a809cb2e769e8533dbeb.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_df135f8cc969f47bfaa48b209c9b93b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_b869abc4fd592d81cd49b71cca4d20c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884e210>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_df135f8cc969f47bfaa48b209c9b93b3.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 095aac09-d686-5b2b-ba03-1006dd102318
2026-04-27 08:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 095aac09-d686-5b2b-ba03-1006dd102318, skipping ID generation
2026-04-27 08:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 095aac09-d686-5b2b-ba03-1006dd102318 with scrape type 1
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 095aac09-d686-5b2b-ba03-1006dd102318 sending to next pipeline
2026-04-27 08:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 095aac09-d686-5b2b-ba03-1006dd102318, identifier: CA96851
2026-04-27 08:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 095aac09-d686-5b2b-ba03-1006dd102318 with identifier: CA96851
2026-04-27 08:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 095aac09-d686-5b2b-ba03-1006dd102318 with identifier: CA96851
2026-04-27 08:06:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 095aac09-d686-5b2b-ba03-1006dd102318 with identifier: CA96851 to the API
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_df135f8cc969f47bfaa48b209c9b93b3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Zaragoza',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:34:37Z',
'fuel_type': 'diesel',
'id': '095aac09-d686-5b2b-ba03-1006dd102318',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6516,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA96851',
'listing': 'auction',
'location': 'ES, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -0.8771,
'make': 'Seat',
'model': 'Leon',
'odometer': 100605,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_8e44cce2251dd770882702ed2a0a6f07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_df135f8cc969f47bfaa48b209c9b93b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_e5345647f3e4a809cb2e769e8533dbeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_6091b5ba4f2b6fe04127bdd4c40fee3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_164d6ad72318606c3d5c8742a0381419.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_52edb54bb54c0208709d842827bdd20e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_fbf59907df563af6adb42543152aafbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_ef04b5af6bf021c0e7182e8a0c62a4e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_5f2c4aaa2cc36fc214d6d6aad4793c09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_095aac09-d686-5b2b-ba03-1006dd102318/095aac09-d686-5b2b-ba03-1006dd102318_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b23e1603fce413541131a2b2b96b19/pa/CA96851_4d846e15dfc431b8b54f130e97575ec9.jpg',
'Width': 800}],
'postal_code': '50001',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2006-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2006}
2026-04-27 08:06:07 [auto1.es] INFO: Saving data for CA96851: {'created_time': 1777277167.295443, 'last_price_update_time': 1777277167.295453, 'has_photos': True, 'auction_closing_time': 1777304077.0}
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_56a3a4487ec6534817ae3da509ee379f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048572810>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_b869abc4fd592d81cd49b71cca4d20c3.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_7508a55641e1c82fb47ef1a0387be3e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a3310>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_56a3a4487ec6534817ae3da509ee379f.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_9fae7f2d5e5593a00316cb9526df7136.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853890>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_7508a55641e1c82fb47ef1a0387be3e5.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a1590>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_9fae7f2d5e5593a00316cb9526df7136.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_684b7ef78712aa6c27a9854978a6bcc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_f87875e9888b89edbf883bb3f118bffe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487145d0>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_684b7ef78712aa6c27a9854978a6bcc4.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884dfd0>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_f87875e9888b89edbf883bb3f118bffe.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bea6867a-bcc7-5061-a9bb-0c92b64e3979
2026-04-27 08:06:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bea6867a-bcc7-5061-a9bb-0c92b64e3979, skipping ID generation
2026-04-27 08:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea6867a-bcc7-5061-a9bb-0c92b64e3979 with scrape type 1
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bea6867a-bcc7-5061-a9bb-0c92b64e3979 sending to next pipeline
2026-04-27 08:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bea6867a-bcc7-5061-a9bb-0c92b64e3979, identifier: NR68963
2026-04-27 08:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bea6867a-bcc7-5061-a9bb-0c92b64e3979 with identifier: NR68963
2026-04-27 08:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bea6867a-bcc7-5061-a9bb-0c92b64e3979 with identifier: NR68963
2026-04-27 08:06:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bea6867a-bcc7-5061-a9bb-0c92b64e3979 with identifier: NR68963 to the API
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_f87875e9888b89edbf883bb3f118bffe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 220,
'category': None,
'city': 'El Carpio',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:07:37Z',
'fuel_type': 'diesel',
'id': 'bea6867a-bcc7-5061-a9bb-0c92b64e3979',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.9409,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR68963',
'listing': 'auction',
'location': 'ES, El Carpio',
'location_confidence': 'geocoded',
'longitude': -4.4966,
'make': 'Opel',
'model': 'Vivaro',
'odometer': 285146,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_f87875e9888b89edbf883bb3f118bffe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_684b7ef78712aa6c27a9854978a6bcc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_9fae7f2d5e5593a00316cb9526df7136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_7508a55641e1c82fb47ef1a0387be3e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_56a3a4487ec6534817ae3da509ee379f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_b869abc4fd592d81cd49b71cca4d20c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_954113f93594b7a22e98f10aea4bd5be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_a83097dece3156a60f310aed88b9ceb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_39a4ced03e122c7e85c2a04edc0458dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea6867a-bcc7-5061-a9bb-0c92b64e3979/bea6867a-bcc7-5061-a9bb-0c92b64e3979_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/69/186972ed4f76c678aa4eb91139400d63/pa/NR68963_c2ec65edab92a53939c67cc5b0d3a2be.jpg',
'Width': 800}],
'postal_code': '14620',
'price': 0,
'price_includes_vat': True,
'province': 'Córdoba',
'province_code': 'ES-CO',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2009-02-11',
'seats_number': 3,
'seller_name': None,
'title': 'Opel Vivaro 2.0 CDTI Kasten L1H1 2,7t',
'transmission': 'manual',
'trim': 'Kasten L1H1 2,7t',
'year': 2009}
2026-04-27 08:06:08 [auto1.es] INFO: Saving data for NR68963: {'created_time': 1777277168.234561, 'last_price_update_time': 1777277168.234574, 'has_photos': True, 'auction_closing_time': 1777302457.0}
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX54724> (referer: https://www.auto1.com/v1/car-details-view/WX54724/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 with identifier: WX54724
2026-04-27 08:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 with scrape type 1
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2381e1d4addead2f6df89335b514ed69.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_90ac7289d43d6d4b6196c0cc0326c7a2.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_86aa76255fc6ee0b47864382d1616c9a.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_f2a2d6209f494dac17114bb5506bb524.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2e7ff55d2ad9e2e5e850199d508591eb.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_8fa5d4990bd76a78dc7ab079663a2067.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_b1d4495e8308e776bf7d57b5fa95ea89.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_73d7dfb592574dce9ad284b7e289fc24.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_560dcce10bd71b74729f19583873eafa.jpg not downloaded yet
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_1e91966a40dc0604c3f17814903ddecb.jpg not downloaded yet
2026-04-27 08:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF66391> (referer: https://www.auto1.com/v1/car-details-view/FF66391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb15388-eee6-589b-bbf3-35ddbd116b8e with identifier: FF66391
2026-04-27 08:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e with scrape type 1
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e24cf30f15d4c839b63e3c2fceb6ade3.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_24a05de98466bede9581e01ebcf36acd.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_3f001279e44310804ffb2ac3f2e1e5fd.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_0c03816bb3304991cbf8e5db7ecac8ce.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e59b66806cdabd9617c98e985251be89.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_7be1065f112f4fb94d520d6e09ef75d0.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_9c2cab469395a7f60297f45e19684b5a.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_f8c5808caa33fc8beb1ad2017d705f6e.jpg not downloaded yet
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e1b981910140d937c38f0c2e427ff3a5.jpg not downloaded yet
2026-04-27 08:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_1e91966a40dc0604c3f17814903ddecb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_8df29cefc6d7c308d47fc98f1f65b143.jpg not downloaded yet
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048715b90>
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_1e91966a40dc0604c3f17814903ddecb.jpg saved to cache
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e1b981910140d937c38f0c2e427ff3a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851590>
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e1b981910140d937c38f0c2e427ff3a5.jpg saved to cache
2026-04-27 08:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_8df29cefc6d7c308d47fc98f1f65b143.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209210>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_8df29cefc6d7c308d47fc98f1f65b143.jpg saved to cache
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_f8c5808caa33fc8beb1ad2017d705f6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42b90>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_f8c5808caa33fc8beb1ad2017d705f6e.jpg saved to cache
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_9c2cab469395a7f60297f45e19684b5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_7be1065f112f4fb94d520d6e09ef75d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820ba50>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_9c2cab469395a7f60297f45e19684b5a.jpg saved to cache
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841e490>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_7be1065f112f4fb94d520d6e09ef75d0.jpg saved to cache
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e59b66806cdabd9617c98e985251be89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_0c03816bb3304991cbf8e5db7ecac8ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876f850>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e59b66806cdabd9617c98e985251be89.jpg saved to cache
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a95750>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_0c03816bb3304991cbf8e5db7ecac8ce.jpg saved to cache
2026-04-27 08:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_3f001279e44310804ffb2ac3f2e1e5fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483df210>
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_3f001279e44310804ffb2ac3f2e1e5fd.jpg saved to cache
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_24a05de98466bede9581e01ebcf36acd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e24cf30f15d4c839b63e3c2fceb6ade3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487147d0>
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_24a05de98466bede9581e01ebcf36acd.jpg saved to cache
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dc490>
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e24cf30f15d4c839b63e3c2fceb6ade3.jpg saved to cache
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e
2026-04-27 08:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eb15388-eee6-589b-bbf3-35ddbd116b8e, skipping ID generation
2026-04-27 08:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e with scrape type 1
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9eb15388-eee6-589b-bbf3-35ddbd116b8e sending to next pipeline
2026-04-27 08:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9eb15388-eee6-589b-bbf3-35ddbd116b8e, identifier: FF66391
2026-04-27 08:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9eb15388-eee6-589b-bbf3-35ddbd116b8e with identifier: FF66391
2026-04-27 08:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9eb15388-eee6-589b-bbf3-35ddbd116b8e with identifier: FF66391
2026-04-27 08:06:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9eb15388-eee6-589b-bbf3-35ddbd116b8e with identifier: FF66391 to the API
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e24cf30f15d4c839b63e3c2fceb6ade3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'El Rebolledo',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:55:41Z',
'fuel_type': 'diesel',
'id': '9eb15388-eee6-589b-bbf3-35ddbd116b8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF66391',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Audi',
'model': 'A6',
'odometer': 243226,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e24cf30f15d4c839b63e3c2fceb6ade3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_24a05de98466bede9581e01ebcf36acd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_3f001279e44310804ffb2ac3f2e1e5fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_0c03816bb3304991cbf8e5db7ecac8ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e59b66806cdabd9617c98e985251be89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_7be1065f112f4fb94d520d6e09ef75d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_9c2cab469395a7f60297f45e19684b5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_f8c5808caa33fc8beb1ad2017d705f6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_e1b981910140d937c38f0c2e427ff3a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9eb15388-eee6-589b-bbf3-35ddbd116b8e/9eb15388-eee6-589b-bbf3-35ddbd116b8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/d2/8fd2b6c6573a3f5aa9b61c35b2e0ab04/pa/FF66391_8df29cefc6d7c308d47fc98f1f65b143.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2016-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 2.0 TDI ultra',
'transmission': 'automatic',
'trim': 'ultra',
'year': 2016}
2026-04-27 08:06:17 [auto1.es] INFO: Saving data for FF66391: {'created_time': 1777277177.733106, 'last_price_update_time': 1777277177.733116, 'has_photos': True, 'auction_closing_time': 1777305341.0}
2026-04-27 08:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_560dcce10bd71b74729f19583873eafa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a2fd0>
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_560dcce10bd71b74729f19583873eafa.jpg saved to cache
2026-04-27 08:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_73d7dfb592574dce9ad284b7e289fc24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898b210>
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_73d7dfb592574dce9ad284b7e289fc24.jpg saved to cache
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_b1d4495e8308e776bf7d57b5fa95ea89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841ead0>
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_b1d4495e8308e776bf7d57b5fa95ea89.jpg saved to cache
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_8fa5d4990bd76a78dc7ab079663a2067.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048256450>
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_8fa5d4990bd76a78dc7ab079663a2067.jpg saved to cache
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2e7ff55d2ad9e2e5e850199d508591eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841fc10>
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2e7ff55d2ad9e2e5e850199d508591eb.jpg saved to cache
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_f2a2d6209f494dac17114bb5506bb524.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894890>
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_f2a2d6209f494dac17114bb5506bb524.jpg saved to cache
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_86aa76255fc6ee0b47864382d1616c9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a0510>
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_86aa76255fc6ee0b47864382d1616c9a.jpg saved to cache
2026-04-27 08:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_90ac7289d43d6d4b6196c0cc0326c7a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2381e1d4addead2f6df89335b514ed69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488711d0>
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_90ac7289d43d6d4b6196c0cc0326c7a2.jpg saved to cache
2026-04-27 08:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714290>
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2381e1d4addead2f6df89335b514ed69.jpg saved to cache
2026-04-27 08:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2
2026-04-27 08:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2, skipping ID generation
2026-04-27 08:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 with scrape type 1
2026-04-27 08:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 sending to next pipeline
2026-04-27 08:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2, identifier: WX54724
2026-04-27 08:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 with identifier: WX54724
2026-04-27 08:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 with identifier: WX54724
2026-04-27 08:06:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2 with identifier: WX54724 to the API
2026-04-27 08:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2381e1d4addead2f6df89335b514ed69.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Madrid',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:43:54Z',
'fuel_type': 'diesel',
'id': 'f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX54724',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 99326,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2381e1d4addead2f6df89335b514ed69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_90ac7289d43d6d4b6196c0cc0326c7a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_86aa76255fc6ee0b47864382d1616c9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_f2a2d6209f494dac17114bb5506bb524.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_2e7ff55d2ad9e2e5e850199d508591eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_8fa5d4990bd76a78dc7ab079663a2067.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_b1d4495e8308e776bf7d57b5fa95ea89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_73d7dfb592574dce9ad284b7e289fc24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_560dcce10bd71b74729f19583873eafa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2/f12f12d1-54bf-5b35-b8e4-bd17e7ac81b2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8e/268ee645cf214776889f192caebd72c1/pa/WX54724_1e91966a40dc0604c3f17814903ddecb.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2015}
2026-04-27 08:06:19 [auto1.es] INFO: Saving data for WX54724: {'created_time': 1777277179.675418, 'last_price_update_time': 1777277179.675428, 'has_photos': True, 'auction_closing_time': 1777304634.0}
2026-04-27 08:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD45790> (referer: https://www.auto1.com/v1/car-details-view/UD45790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 076bc20b-69c2-588c-8c13-8d6b7537d048 with identifier: UD45790
2026-04-27 08:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 076bc20b-69c2-588c-8c13-8d6b7537d048 with scrape type 1
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ad6f9886da970a2ad4bb38918659132c.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_54e2a8a40e24810eb8cad9b718712ac1.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4aec552b74d7970eb02846acb4f08f8b.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4bbfbcabf14eaadf568f3558b61535f2.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_933e34c884f4ef50e835d97d196da6b1.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_8d23cadff788b144da85b5b3be80d020.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_421b1adc17f115793cb8ce7a5e201119.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_6081e15c04463c8e1b3dd7245b0e3a74.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_368cbf452a9c4fe55e300c57da708630.jpg not downloaded yet
2026-04-27 08:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ed042d39cce442dae949a4fcaaed6027.jpg not downloaded yet
2026-04-27 08:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC83489> (referer: https://www.auto1.com/v1/car-details-view/AC83489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 with identifier: AC83489
2026-04-27 08:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 with scrape type 1
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_0b202df56e3bfd17af0fdc77f2e98c19.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_216dff5777cb59b096bbe4ab228fd4ad.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_dbba7d07bae31c5d97b48d819680dfda.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_eff45bf263c6e9c27c852abc11e41b07.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2f2bc0fa8ba30ab42901ac2a5def492f.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b292c4a1c146b42950da05dd7f8162d.jpg not downloaded yet
2026-04-27 08:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ed042d39cce442dae949a4fcaaed6027.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_de019a4a543716074f1baf054f3a3629.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b77b7f1700e557049e08dc84b61d897.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_a9f72909a2ce66f2b5675fd86594e73e.jpg not downloaded yet
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2a887ba161edd560ed8a66c5d0852a98.jpg not downloaded yet
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ddc50>
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ed042d39cce442dae949a4fcaaed6027.jpg saved to cache
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2f2bc0fa8ba30ab42901ac2a5def492f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865a410>
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2f2bc0fa8ba30ab42901ac2a5def492f.jpg saved to cache
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2a887ba161edd560ed8a66c5d0852a98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_a9f72909a2ce66f2b5675fd86594e73e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876f490>
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2a887ba161edd560ed8a66c5d0852a98.jpg saved to cache
2026-04-27 08:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b77b7f1700e557049e08dc84b61d897.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a2d50>
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_a9f72909a2ce66f2b5675fd86594e73e.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485713d0>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b77b7f1700e557049e08dc84b61d897.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_de019a4a543716074f1baf054f3a3629.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a416d0>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_de019a4a543716074f1baf054f3a3629.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b292c4a1c146b42950da05dd7f8162d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820a250>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b292c4a1c146b42950da05dd7f8162d.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_eff45bf263c6e9c27c852abc11e41b07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_dbba7d07bae31c5d97b48d819680dfda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0d10>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_eff45bf263c6e9c27c852abc11e41b07.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a2910>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_dbba7d07bae31c5d97b48d819680dfda.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_216dff5777cb59b096bbe4ab228fd4ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048873dd0>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_216dff5777cb59b096bbe4ab228fd4ad.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_0b202df56e3bfd17af0fdc77f2e98c19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_368cbf452a9c4fe55e300c57da708630.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865a0d0>
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_0b202df56e3bfd17af0fdc77f2e98c19.jpg saved to cache
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4
2026-04-27 08:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4, skipping ID generation
2026-04-27 08:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 with scrape type 1
2026-04-27 08:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 sending to next pipeline
2026-04-27 08:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4, identifier: AC83489
2026-04-27 08:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 with identifier: AC83489
2026-04-27 08:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 with identifier: AC83489
2026-04-27 08:06:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1cf8d1b1-3df1-5152-b894-2cd1eaab77c4 with identifier: AC83489 to the API
2026-04-27 08:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_0b202df56e3bfd17af0fdc77f2e98c19.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:40:39Z',
'fuel_type': 'diesel',
'id': '1cf8d1b1-3df1-5152-b894-2cd1eaab77c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC83489',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Fiat',
'model': 'Doblo',
'odometer': 198680,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_0b202df56e3bfd17af0fdc77f2e98c19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_216dff5777cb59b096bbe4ab228fd4ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_dbba7d07bae31c5d97b48d819680dfda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_eff45bf263c6e9c27c852abc11e41b07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2f2bc0fa8ba30ab42901ac2a5def492f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b292c4a1c146b42950da05dd7f8162d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_de019a4a543716074f1baf054f3a3629.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_4b77b7f1700e557049e08dc84b61d897.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_a9f72909a2ce66f2b5675fd86594e73e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1cf8d1b1-3df1-5152-b894-2cd1eaab77c4/1cf8d1b1-3df1-5152-b894-2cd1eaab77c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/99/f199b4ea29e34ab518cf2d8f2e719e70/pa/AC83489_2a887ba161edd560ed8a66c5d0852a98.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Doblo 1.6 JTDM Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2017}
2026-04-27 08:06:30 [auto1.es] INFO: Saving data for AC83489: {'created_time': 1777277190.606935, 'last_price_update_time': 1777277190.606944, 'has_photos': True, 'auction_closing_time': 1777304439.0}
2026-04-27 08:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048572c10>
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_368cbf452a9c4fe55e300c57da708630.jpg saved to cache
2026-04-27 08:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_6081e15c04463c8e1b3dd7245b0e3a74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048865210>
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_6081e15c04463c8e1b3dd7245b0e3a74.jpg saved to cache
2026-04-27 08:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_421b1adc17f115793cb8ce7a5e201119.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894050>
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_421b1adc17f115793cb8ce7a5e201119.jpg saved to cache
2026-04-27 08:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_8d23cadff788b144da85b5b3be80d020.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a96d10>
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_8d23cadff788b144da85b5b3be80d020.jpg saved to cache
2026-04-27 08:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_933e34c884f4ef50e835d97d196da6b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488661d0>
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_933e34c884f4ef50e835d97d196da6b1.jpg saved to cache
2026-04-27 08:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4bbfbcabf14eaadf568f3558b61535f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209490>
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4bbfbcabf14eaadf568f3558b61535f2.jpg saved to cache
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4aec552b74d7970eb02846acb4f08f8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837ead0>
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4aec552b74d7970eb02846acb4f08f8b.jpg saved to cache
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_54e2a8a40e24810eb8cad9b718712ac1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ad6f9886da970a2ad4bb38918659132c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e5c10>
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_54e2a8a40e24810eb8cad9b718712ac1.jpg saved to cache
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:06:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:06:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048570b10>
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ad6f9886da970a2ad4bb38918659132c.jpg saved to cache
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 076bc20b-69c2-588c-8c13-8d6b7537d048
2026-04-27 08:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 076bc20b-69c2-588c-8c13-8d6b7537d048, skipping ID generation
2026-04-27 08:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 076bc20b-69c2-588c-8c13-8d6b7537d048 with scrape type 1
2026-04-27 08:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 076bc20b-69c2-588c-8c13-8d6b7537d048 sending to next pipeline
2026-04-27 08:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 076bc20b-69c2-588c-8c13-8d6b7537d048, identifier: UD45790
2026-04-27 08:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 076bc20b-69c2-588c-8c13-8d6b7537d048 with identifier: UD45790
2026-04-27 08:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 076bc20b-69c2-588c-8c13-8d6b7537d048 with identifier: UD45790
2026-04-27 08:06:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 076bc20b-69c2-588c-8c13-8d6b7537d048 with identifier: UD45790 to the API
2026-04-27 08:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ad6f9886da970a2ad4bb38918659132c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'city': 'Vitoria',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:19:45Z',
'fuel_type': 'petrol',
'id': '076bc20b-69c2-588c-8c13-8d6b7537d048',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.6025,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD45790',
'listing': 'auction',
'location': 'ES, Vitoria',
'location_confidence': 'geocoded',
'longitude': -6.4088,
'make': 'Peugeot',
'model': '3008',
'odometer': 129307,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403668,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ad6f9886da970a2ad4bb38918659132c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_54e2a8a40e24810eb8cad9b718712ac1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4aec552b74d7970eb02846acb4f08f8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849866,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_4bbfbcabf14eaadf568f3558b61535f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_933e34c884f4ef50e835d97d196da6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_8d23cadff788b144da85b5b3be80d020.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_421b1adc17f115793cb8ce7a5e201119.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_6081e15c04463c8e1b3dd7245b0e3a74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_368cbf452a9c4fe55e300c57da708630.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_076bc20b-69c2-588c-8c13-8d6b7537d048/076bc20b-69c2-588c-8c13-8d6b7537d048_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/4e/0d4e38a5c7f1ed5c663510f081cf5924/pa/UD45790_ed042d39cce442dae949a4fcaaed6027.jpg',
'Width': 800}],
'postal_code': '24316',
'price': 0,
'price_includes_vat': True,
'province': 'León',
'province_code': 'ES-LE',
'region': 'Castilla - Leon',
'region_code': 'ES-CL',
'registration_date': '2013-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-04-27 08:06:33 [auto1.es] INFO: Saving data for UD45790: {'created_time': 1777277193.190648, 'last_price_update_time': 1777277193.190658, 'has_photos': True, 'auction_closing_time': 1777303185.0}
2026-04-27 08:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL26716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:33 [scrapy.extensions.logstats] INFO: Crawled 500 pages (at 27 pages/min), scraped 597 items (at 21 items/min)
2026-04-27 08:06:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:06:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.882(s), this was the 1st time calling it.
2026-04-27 08:06:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.161480332002054 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS25075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.738(s), this was the 1st time calling it.
2026-04-27 08:07:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.087367337180608 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ39020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU90571> (referer: https://www.auto1.com/v1/car-details-view/JU90571/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf36e1f-3235-5890-95e6-f6ec5249d995 with identifier: JU90571
2026-04-27 08:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf36e1f-3235-5890-95e6-f6ec5249d995 with scrape type 1
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_ca089b63a0b6cd5aec94317309022a61.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_96f596a8a42b1eb95c90d938bc558559.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_cd41b9a3c7380c56f9e5816339741267.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_1f9d12ed1e3b367f98ac28f30b92cc88.jpg not downloaded yet
2026-04-27 08:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_660641a16c3d1f03644fc696f818b6db.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_18643c273ec2e0fb8f4a66bc65e39f58.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_58efbfeb40e32d75b5c3db7f93bf347a.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_7e1b4d65fb97dcd20a8abd89fabeba80.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_e9962df02c80a8033b1d6f2230be84b3.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_2a9d1e7596961481a936bcb2940d245e.jpg not downloaded yet
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP74290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_2a9d1e7596961481a936bcb2940d245e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485722d0>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_2a9d1e7596961481a936bcb2940d245e.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM75877> (referer: https://www.auto1.com/v1/car-details-view/YM75877/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_e9962df02c80a8033b1d6f2230be84b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9208cff-9912-5f1e-835d-136977071e79 with identifier: YM75877
2026-04-27 08:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9208cff-9912-5f1e-835d-136977071e79 with scrape type 1
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_55c5e5ba4af5bcf4820821d69ad65ed3.jpg not downloaded yet
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_9b170f5d35fb177f3edd36c1bd2b6685.jpg not downloaded yet
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_719eeb70598056ca957a5546d0e9bd4c.jpg not downloaded yet
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a18d0>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_e9962df02c80a8033b1d6f2230be84b3.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_ce2cdab22e6a95bcca03493454ba8f4b.jpg not downloaded yet
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_558a7e3460bc1fe135361689035a2024.jpg not downloaded yet
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_67fff70a6b8a2f7a24e1f414a05f8c35.jpg not downloaded yet
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_7e1b4d65fb97dcd20a8abd89fabeba80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_a41b4f2efef93ec64ef352054210d44a.jpg not downloaded yet
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_06f1ad2dd7ffc29ccd7134e6a1743eb4.jpg not downloaded yet
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_6636403db35cc9849e6a0e34eea76000.jpg not downloaded yet
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_e2c0775105e15ecc99a7fb4943023368.jpg not downloaded yet
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048850a90>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_7e1b4d65fb97dcd20a8abd89fabeba80.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_67fff70a6b8a2f7a24e1f414a05f8c35.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0590>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_67fff70a6b8a2f7a24e1f414a05f8c35.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_e2c0775105e15ecc99a7fb4943023368.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_6636403db35cc9849e6a0e34eea76000.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488713d0>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_e2c0775105e15ecc99a7fb4943023368.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898be50>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_6636403db35cc9849e6a0e34eea76000.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_06f1ad2dd7ffc29ccd7134e6a1743eb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048208910>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_06f1ad2dd7ffc29ccd7134e6a1743eb4.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_a41b4f2efef93ec64ef352054210d44a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885c590>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_a41b4f2efef93ec64ef352054210d44a.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_558a7e3460bc1fe135361689035a2024.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a95ad0>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_558a7e3460bc1fe135361689035a2024.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_ce2cdab22e6a95bcca03493454ba8f4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885cad0>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_ce2cdab22e6a95bcca03493454ba8f4b.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_719eeb70598056ca957a5546d0e9bd4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048807f90>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_719eeb70598056ca957a5546d0e9bd4c.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_9b170f5d35fb177f3edd36c1bd2b6685.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_55c5e5ba4af5bcf4820821d69ad65ed3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_58efbfeb40e32d75b5c3db7f93bf347a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048969a50>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_9b170f5d35fb177f3edd36c1bd2b6685.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853910>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_55c5e5ba4af5bcf4820821d69ad65ed3.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9208cff-9912-5f1e-835d-136977071e79
2026-04-27 08:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9208cff-9912-5f1e-835d-136977071e79, skipping ID generation
2026-04-27 08:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9208cff-9912-5f1e-835d-136977071e79 with scrape type 1
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9208cff-9912-5f1e-835d-136977071e79 sending to next pipeline
2026-04-27 08:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c9208cff-9912-5f1e-835d-136977071e79, identifier: YM75877
2026-04-27 08:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c9208cff-9912-5f1e-835d-136977071e79 with identifier: YM75877
2026-04-27 08:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c9208cff-9912-5f1e-835d-136977071e79 with identifier: YM75877
2026-04-27 08:07:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c9208cff-9912-5f1e-835d-136977071e79 with identifier: YM75877 to the API
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_55c5e5ba4af5bcf4820821d69ad65ed3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Aldaya',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:19:11Z',
'fuel_type': 'diesel',
'id': 'c9208cff-9912-5f1e-835d-136977071e79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM75877',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 156183,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_55c5e5ba4af5bcf4820821d69ad65ed3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_9b170f5d35fb177f3edd36c1bd2b6685.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_719eeb70598056ca957a5546d0e9bd4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_ce2cdab22e6a95bcca03493454ba8f4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_558a7e3460bc1fe135361689035a2024.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_67fff70a6b8a2f7a24e1f414a05f8c35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_a41b4f2efef93ec64ef352054210d44a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_06f1ad2dd7ffc29ccd7134e6a1743eb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_6636403db35cc9849e6a0e34eea76000.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c9208cff-9912-5f1e-835d-136977071e79/c9208cff-9912-5f1e-835d-136977071e79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/9b/4c9b4a374f9f1b9e787396f6efdf4661/pa/YM75877_e2c0775105e15ecc99a7fb4943023368.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-04-27 08:07:29 [auto1.es] INFO: Saving data for YM75877: {'created_time': 1777277249.186279, 'last_price_update_time': 1777277249.186296, 'has_photos': True, 'auction_closing_time': 1777303151.0}
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_18643c273ec2e0fb8f4a66bc65e39f58.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY24399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b29d0>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_58efbfeb40e32d75b5c3db7f93bf347a.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048872c50>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_18643c273ec2e0fb8f4a66bc65e39f58.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_660641a16c3d1f03644fc696f818b6db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_1f9d12ed1e3b367f98ac28f30b92cc88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_cd41b9a3c7380c56f9e5816339741267.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e510>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_660641a16c3d1f03644fc696f818b6db.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_96f596a8a42b1eb95c90d938bc558559.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820bcd0>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_1f9d12ed1e3b367f98ac28f30b92cc88.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_ca089b63a0b6cd5aec94317309022a61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482356d0>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_cd41b9a3c7380c56f9e5816339741267.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fe90>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_96f596a8a42b1eb95c90d938bc558559.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841d810>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_ca089b63a0b6cd5aec94317309022a61.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bf36e1f-3235-5890-95e6-f6ec5249d995
2026-04-27 08:07:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bf36e1f-3235-5890-95e6-f6ec5249d995, skipping ID generation
2026-04-27 08:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf36e1f-3235-5890-95e6-f6ec5249d995 with scrape type 1
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0bf36e1f-3235-5890-95e6-f6ec5249d995 sending to next pipeline
2026-04-27 08:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0bf36e1f-3235-5890-95e6-f6ec5249d995, identifier: JU90571
2026-04-27 08:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0bf36e1f-3235-5890-95e6-f6ec5249d995 with identifier: JU90571
2026-04-27 08:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0bf36e1f-3235-5890-95e6-f6ec5249d995 with identifier: JU90571
2026-04-27 08:07:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0bf36e1f-3235-5890-95e6-f6ec5249d995 with identifier: JU90571 to the API
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_ca089b63a0b6cd5aec94317309022a61.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'city': 'Alcobendas',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:25:21Z',
'fuel_type': 'diesel',
'id': '0bf36e1f-3235-5890-95e6-f6ec5249d995',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.5447,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU90571',
'listing': 'auction',
'location': 'ES, Alcobendas',
'location_confidence': 'geocoded',
'longitude': -3.6406,
'make': 'Audi',
'model': 'Q5',
'odometer': 220091,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_ca089b63a0b6cd5aec94317309022a61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_96f596a8a42b1eb95c90d938bc558559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_cd41b9a3c7380c56f9e5816339741267.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_1f9d12ed1e3b367f98ac28f30b92cc88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_660641a16c3d1f03644fc696f818b6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_18643c273ec2e0fb8f4a66bc65e39f58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_58efbfeb40e32d75b5c3db7f93bf347a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_7e1b4d65fb97dcd20a8abd89fabeba80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_e9962df02c80a8033b1d6f2230be84b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0bf36e1f-3235-5890-95e6-f6ec5249d995/0bf36e1f-3235-5890-95e6-f6ec5249d995_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/5f/a15f097bf09ccb56607beb7610c0e584/pa/JU90571_2a9d1e7596961481a936bcb2940d245e.jpg',
'Width': 800}],
'postal_code': '28100',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2012-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Advance',
'transmission': 'automatic',
'trim': 'quattro Advance',
'year': 2012}
2026-04-27 08:07:30 [auto1.es] INFO: Saving data for JU90571: {'created_time': 1777277250.113804, 'last_price_update_time': 1777277250.113817, 'has_photos': True, 'auction_closing_time': 1777303521.0}
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG81749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_388c4b972f4c1e27233ebd5f31b7e5f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b160b10cb4cd0a6677e037a2bc9d150e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ecd50>
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_388c4b972f4c1e27233ebd5f31b7e5f7.jpg saved to cache
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048873050>
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b160b10cb4cd0a6677e037a2bc9d150e.jpg saved to cache
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK70823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_337d127c81f792773a4ea26e6409b8b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837c6d0>
2026-04-27 08:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_337d127c81f792773a4ea26e6409b8b7.jpg saved to cache
2026-04-27 08:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:33 [scrapy.extensions.logstats] INFO: Crawled 508 pages (at 8 pages/min), scraped 599 items (at 2 items/min)
2026-04-27 08:07:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 379MiB
2026-04-27 08:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ28703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL26716> (referer: https://www.auto1.com/v1/car-details-view/CL26716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358f32cd-8bce-5196-b1e6-a1cd66514ee8 with identifier: CL26716
2026-04-27 08:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8 with scrape type 1
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_4fce6a15d6af38a98222090913616d43.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_e46a7667f3f249abcf708efc857faea2.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_65741b464c2bc3631f2690ba6ea17b2d.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_c090d2a3aa9209143dfa52d3ef8fd6d5.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_fe9d12f6fdb0625d229e1b5ed600a287.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_2a0b63b9ae0a83e88b00f309f7d550e1.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_9b1c8c1e4300911b72713e771dc53c09.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_1bb31bc40f25e2bccce4f622a2a6ba3f.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_48f241c30a472a51d667604decdc2ff5.jpg not downloaded yet
2026-04-27 08:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_92895720ef3db87d68bf5d5e853b1b9c.jpg not downloaded yet
2026-04-27 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS25075> (referer: https://www.auto1.com/v1/car-details-view/LS25075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075
2026-04-27 08:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with scrape type 1
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f15b73df-6dbe-52e8-bd3a-d2dedf076a17
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_6b275556f060e892fdc2b06553776932.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_c03f67c7b2c402bd02d96b6a07e6e316.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_3f78d8173e0be246c96c557b5a6c23e2.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_a87436101c4afd0111e0e302d6badaa0.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_bb939c9c84807daf4540286ed64371ab.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_e28f0e7e99763f45574a69753532c083.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_eb9011b13eb325a2d3233d4f450d3859.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_f30bd513f44024889f808cddd49d3e7d.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_7e42fc18ea8941a277bd322993c55865.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_aa8adaf16206365ae16682e20d7ff84e.jpg already downloaded
2026-04-27 08:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f15b73df-6dbe-52e8-bd3a-d2dedf076a17, identifier: LS25075
2026-04-27 08:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075
2026-04-27 08:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075
2026-04-27 08:07:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075 to the API
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LS25075>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Calaf',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:58:15Z',
'fuel_type': 'petrol',
'id': 'f15b73df-6dbe-52e8-bd3a-d2dedf076a17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7324,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS25075',
'listing': 'auction',
'location': 'ES, Calaf - Barcelona',
'location_confidence': 'geocoded',
'longitude': 1.514,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 102702,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_6b275556f060e892fdc2b06553776932.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_c03f67c7b2c402bd02d96b6a07e6e316.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_3f78d8173e0be246c96c557b5a6c23e2.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_a87436101c4afd0111e0e302d6badaa0.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_bb939c9c84807daf4540286ed64371ab.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_e28f0e7e99763f45574a69753532c083.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_eb9011b13eb325a2d3233d4f450d3859.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_f30bd513f44024889f808cddd49d3e7d.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_7e42fc18ea8941a277bd322993c55865.jpg',
'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_aa8adaf16206365ae16682e20d7ff84e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_6b275556f060e892fdc2b06553776932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_c03f67c7b2c402bd02d96b6a07e6e316.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_3f78d8173e0be246c96c557b5a6c23e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_a87436101c4afd0111e0e302d6badaa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_bb939c9c84807daf4540286ed64371ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_e28f0e7e99763f45574a69753532c083.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_eb9011b13eb325a2d3233d4f450d3859.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_f30bd513f44024889f808cddd49d3e7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_7e42fc18ea8941a277bd322993c55865.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f15b73df-6dbe-52e8-bd3a-d2dedf076a17/f15b73df-6dbe-52e8-bd3a-d2dedf076a17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/f7/66f7ae6aa5a27391d33f6dac930feb3d/pa/LS25075_aa8adaf16206365ae16682e20d7ff84e.jpg',
'Width': 800}],
'postal_code': '08280',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2015}
2026-04-27 08:07:44 [auto1.es] INFO: Saving data for LS25075: {'created_time': 1777277264.004219, 'last_price_update_time': 1777277264.004232, 'has_photos': True, 'auction_closing_time': 1777305495.0}
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_92895720ef3db87d68bf5d5e853b1b9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ee950>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_92895720ef3db87d68bf5d5e853b1b9c.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_48f241c30a472a51d667604decdc2ff5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a43810>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_48f241c30a472a51d667604decdc2ff5.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_1bb31bc40f25e2bccce4f622a2a6ba3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a07d0>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_1bb31bc40f25e2bccce4f622a2a6ba3f.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_9b1c8c1e4300911b72713e771dc53c09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048886910>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_9b1c8c1e4300911b72713e771dc53c09.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_2a0b63b9ae0a83e88b00f309f7d550e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884ed0>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_2a0b63b9ae0a83e88b00f309f7d550e1.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_fe9d12f6fdb0625d229e1b5ed600a287.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048870090>
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_fe9d12f6fdb0625d229e1b5ed600a287.jpg saved to cache
2026-04-27 08:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_c090d2a3aa9209143dfa52d3ef8fd6d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209f90>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_c090d2a3aa9209143dfa52d3ef8fd6d5.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_65741b464c2bc3631f2690ba6ea17b2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865b650>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_65741b464c2bc3631f2690ba6ea17b2d.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_e46a7667f3f249abcf708efc857faea2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_4fce6a15d6af38a98222090913616d43.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487152d0>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_e46a7667f3f249abcf708efc857faea2.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898bbd0>
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_4fce6a15d6af38a98222090913616d43.jpg saved to cache
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8
2026-04-27 08:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 358f32cd-8bce-5196-b1e6-a1cd66514ee8, skipping ID generation
2026-04-27 08:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8 with scrape type 1
2026-04-27 08:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 358f32cd-8bce-5196-b1e6-a1cd66514ee8 sending to next pipeline
2026-04-27 08:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 358f32cd-8bce-5196-b1e6-a1cd66514ee8, identifier: CL26716
2026-04-27 08:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 358f32cd-8bce-5196-b1e6-a1cd66514ee8 with identifier: CL26716
2026-04-27 08:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 358f32cd-8bce-5196-b1e6-a1cd66514ee8 with identifier: CL26716
2026-04-27 08:07:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 358f32cd-8bce-5196-b1e6-a1cd66514ee8 with identifier: CL26716 to the API
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_4fce6a15d6af38a98222090913616d43.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': 'Rental',
'city': 'Araia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:58:05Z',
'fuel_type': 'diesel',
'id': '358f32cd-8bce-5196-b1e6-a1cd66514ee8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL26716',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Peugeot',
'model': '3008',
'odometer': 169573,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_4fce6a15d6af38a98222090913616d43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_e46a7667f3f249abcf708efc857faea2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_65741b464c2bc3631f2690ba6ea17b2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_c090d2a3aa9209143dfa52d3ef8fd6d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_fe9d12f6fdb0625d229e1b5ed600a287.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_2a0b63b9ae0a83e88b00f309f7d550e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_9b1c8c1e4300911b72713e771dc53c09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_1bb31bc40f25e2bccce4f622a2a6ba3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_48f241c30a472a51d667604decdc2ff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_358f32cd-8bce-5196-b1e6-a1cd66514ee8/358f32cd-8bce-5196-b1e6-a1cd66514ee8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/80/f680c59b5f98ebacd8e4f94fed751f22/pa/CL26716_92895720ef3db87d68bf5d5e853b1b9c.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2016-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-04-27 08:07:45 [auto1.es] INFO: Saving data for CL26716: {'created_time': 1777277265.902451, 'last_price_update_time': 1777277265.902461, 'has_photos': True, 'auction_closing_time': 1777305485.0}
2026-04-27 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_2e1116f3563ba0bcff04a8c03dafe40f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d6b90>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_2e1116f3563ba0bcff04a8c03dafe40f.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bb1373b5b53262b73f631878f1ba8904.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.201(s), this was the 1st time calling it.
2026-04-27 08:07:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.4428273612067715 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:07:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.167(s), this was the 1st time calling it.
2026-04-27 08:07:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.16025718098125 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e3750>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bb1373b5b53262b73f631878f1ba8904.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_94f78a5cd3b6e0e1bbb2328a5040f82a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b290>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_94f78a5cd3b6e0e1bbb2328a5040f82a.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_56853152e327b8264bcda558d16f0531.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836a6d0>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_56853152e327b8264bcda558d16f0531.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_22b7ffe08d1a094984ea184450580628.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e2ed0>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_22b7ffe08d1a094984ea184450580628.jpg saved to cache
2026-04-27 08:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bd8d5a3f44018437bed784dd76d61cc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836b6d0>
2026-04-27 08:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bd8d5a3f44018437bed784dd76d61cc7.jpg saved to cache
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1b297c82bcaed1754d026a7333e83691.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3510>
2026-04-27 08:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1b297c82bcaed1754d026a7333e83691.jpg saved to cache
2026-04-27 08:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ39020> (referer: https://www.auto1.com/v1/car-details-view/HZ39020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_753a1410c0c989e3e3eb85ac270243a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 with identifier: HZ39020
2026-04-27 08:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 with scrape type 1
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_f753a386048f449bfade7e5797710018.jpg not downloaded yet
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_1a4e11fdeab30d682e9d42f94206a97d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_785c292abd3911336b65f6bf628c4dc9.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_88b0acd7ce016fde5f323f65b90bc2be.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_4369d849da20fcf7350bdb8e78b06667.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_fa8844025fe0abb7fba38320bfd3ec92.jpg not downloaded yet
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e17d0>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_753a1410c0c989e3e3eb85ac270243a7.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2f27cbefc6fdaf81205c94f09ff2deaf.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2ace776bf2f1b1031635d33dca8c2cdd.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_b5e06b9c1794f7d0502af922df9cd185.jpg not downloaded yet
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ecf50>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_1a4e11fdeab30d682e9d42f94206a97d.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_10e896c6f890c2dc87f3bb34180ce610.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_8e8b2076a52b2965da316c7fa62d3774.jpg not downloaded yet
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_f753a386048f449bfade7e5797710018.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048338a10>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_f753a386048f449bfade7e5797710018.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_8e8b2076a52b2965da316c7fa62d3774.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a0c10>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_8e8b2076a52b2965da316c7fa62d3774.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_10e896c6f890c2dc87f3bb34180ce610.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048339ed0>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_10e896c6f890c2dc87f3bb34180ce610.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_b5e06b9c1794f7d0502af922df9cd185.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04839b950>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_b5e06b9c1794f7d0502af922df9cd185.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP74290> (referer: https://www.auto1.com/v1/car-details-view/BP74290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2ace776bf2f1b1031635d33dca8c2cdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d291e42a-56d5-56ab-900c-2f103d6afdcc with identifier: BP74290
2026-04-27 08:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291e42a-56d5-56ab-900c-2f103d6afdcc with scrape type 1
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_722f6b1da10c1ad860e260816a5e198b.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_be0b67d47a5d5bb4f7191cf705590027.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_0bbbca5af6b9420f18a2b66920adee30.jpg not downloaded yet
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2f27cbefc6fdaf81205c94f09ff2deaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_99be9e79fcce2a38263b3a3bff884f34.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_f5a13f69b6be731f337c0e66ad970466.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_c999d76760f08bfad88770ef830b3d5b.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_acc88774636ae535fe5ef9d4057b31ed.jpg not downloaded yet
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5d50>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2ace776bf2f1b1031635d33dca8c2cdd.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2d98754cc9fc7d4793b0d1f769173f02.jpg not downloaded yet
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_be0b67d47a5d5bb4f7191cf705590027.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2baa271ab4ac5ebd09d51c4f9e21e6b2.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_deaa6f700828b5ddafd23ee013a3470c.jpg not downloaded yet
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048524c90>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2f27cbefc6fdaf81205c94f09ff2deaf.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048758610>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_be0b67d47a5d5bb4f7191cf705590027.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_fa8844025fe0abb7fba38320bfd3ec92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_deaa6f700828b5ddafd23ee013a3470c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_acc88774636ae535fe5ef9d4057b31ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2d98754cc9fc7d4793b0d1f769173f02.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2baa271ab4ac5ebd09d51c4f9e21e6b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834dcd0>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_fa8844025fe0abb7fba38320bfd3ec92.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04836bed0>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_deaa6f700828b5ddafd23ee013a3470c.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_f5a13f69b6be731f337c0e66ad970466.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_c999d76760f08bfad88770ef830b3d5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884f90>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_acc88774636ae535fe5ef9d4057b31ed.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c3650>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2d98754cc9fc7d4793b0d1f769173f02.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852a050>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2baa271ab4ac5ebd09d51c4f9e21e6b2.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_99be9e79fcce2a38263b3a3bff884f34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048163f50>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_f5a13f69b6be731f337c0e66ad970466.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048166fd0>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_c999d76760f08bfad88770ef830b3d5b.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_722f6b1da10c1ad860e260816a5e198b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488502d0>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_99be9e79fcce2a38263b3a3bff884f34.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_0bbbca5af6b9420f18a2b66920adee30.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_4369d849da20fcf7350bdb8e78b06667.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_785c292abd3911336b65f6bf628c4dc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529c90>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_722f6b1da10c1ad860e260816a5e198b.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_0993318fafdb2b18b6416da06c2d98d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833ba90>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_0bbbca5af6b9420f18a2b66920adee30.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d291e42a-56d5-56ab-900c-2f103d6afdcc
2026-04-27 08:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d291e42a-56d5-56ab-900c-2f103d6afdcc, skipping ID generation
2026-04-27 08:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291e42a-56d5-56ab-900c-2f103d6afdcc with scrape type 1
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d291e42a-56d5-56ab-900c-2f103d6afdcc sending to next pipeline
2026-04-27 08:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d291e42a-56d5-56ab-900c-2f103d6afdcc, identifier: BP74290
2026-04-27 08:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d291e42a-56d5-56ab-900c-2f103d6afdcc with identifier: BP74290
2026-04-27 08:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d291e42a-56d5-56ab-900c-2f103d6afdcc with identifier: BP74290
2026-04-27 08:07:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d291e42a-56d5-56ab-900c-2f103d6afdcc with identifier: BP74290 to the API
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_0bbbca5af6b9420f18a2b66920adee30.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'city': 'Caldes De Malavella',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:56:43Z',
'fuel_type': 'diesel',
'id': 'd291e42a-56d5-56ab-900c-2f103d6afdcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7743,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP74290',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'location_confidence': 'geocoded',
'longitude': 2.6451,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 240357,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_722f6b1da10c1ad860e260816a5e198b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_be0b67d47a5d5bb4f7191cf705590027.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_0bbbca5af6b9420f18a2b66920adee30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_99be9e79fcce2a38263b3a3bff884f34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_f5a13f69b6be731f337c0e66ad970466.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_c999d76760f08bfad88770ef830b3d5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_acc88774636ae535fe5ef9d4057b31ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2d98754cc9fc7d4793b0d1f769173f02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_2baa271ab4ac5ebd09d51c4f9e21e6b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d291e42a-56d5-56ab-900c-2f103d6afdcc/d291e42a-56d5-56ab-900c-2f103d6afdcc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/85/05857e912de882c8efafa5382b6621e7/pa/BP74290_deaa6f700828b5ddafd23ee013a3470c.jpg',
'Width': 800}],
'postal_code': '17455',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2014-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Edition BlueMotion Tech',
'transmission': 'manual',
'trim': 'Edition BlueMotion Tech',
'year': 2014}
2026-04-27 08:07:52 [auto1.es] INFO: Saving data for BP74290: {'created_time': 1777277272.137231, 'last_price_update_time': 1777277272.137244, 'has_photos': True, 'auction_closing_time': 1777305403.0}
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_88b0acd7ce016fde5f323f65b90bc2be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_41d8e98ca77dd5f087f250c88d3afa82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207890>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_4369d849da20fcf7350bdb8e78b06667.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bda50>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_785c292abd3911336b65f6bf628c4dc9.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048369c50>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_0993318fafdb2b18b6416da06c2d98d5.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048660f10>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_88b0acd7ce016fde5f323f65b90bc2be.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411
2026-04-27 08:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8470d8dc-2d97-514e-99e0-fd9a9ebd2411, skipping ID generation
2026-04-27 08:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 with scrape type 1
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 sending to next pipeline
2026-04-27 08:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8470d8dc-2d97-514e-99e0-fd9a9ebd2411, identifier: HZ39020
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048368110>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_41d8e98ca77dd5f087f250c88d3afa82.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 with identifier: HZ39020
2026-04-27 08:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 with identifier: HZ39020
2026-04-27 08:07:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8470d8dc-2d97-514e-99e0-fd9a9ebd2411 with identifier: HZ39020 to the API
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_88b0acd7ce016fde5f323f65b90bc2be.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Barcelona',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:09:35Z',
'fuel_type': 'petrol',
'id': '8470d8dc-2d97-514e-99e0-fd9a9ebd2411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ39020',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Seat',
'model': 'Leon',
'odometer': 54206,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_f753a386048f449bfade7e5797710018.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_785c292abd3911336b65f6bf628c4dc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_88b0acd7ce016fde5f323f65b90bc2be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_4369d849da20fcf7350bdb8e78b06667.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_fa8844025fe0abb7fba38320bfd3ec92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2f27cbefc6fdaf81205c94f09ff2deaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_2ace776bf2f1b1031635d33dca8c2cdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_b5e06b9c1794f7d0502af922df9cd185.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_10e896c6f890c2dc87f3bb34180ce610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8470d8dc-2d97-514e-99e0-fd9a9ebd2411/8470d8dc-2d97-514e-99e0-fd9a9ebd2411_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/c8/d7c8b76e9c68764d3f0e98461eb02817/pa/HZ39020_8e8b2076a52b2965da316c7fa62d3774.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.4 TSI Style Connect',
'transmission': 'manual',
'trim': 'Style Connect',
'year': 2015}
2026-04-27 08:07:52 [auto1.es] INFO: Saving data for HZ39020: {'created_time': 1777277272.765603, 'last_price_update_time': 1777277272.765613, 'has_photos': True, 'auction_closing_time': 1777302575.0}
2026-04-27 08:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_4949a8c2ee1a97a8f619167c080568b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_a101873eac6c4d77ae1799d3b77a6ba2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_8eb7d9a045b635f5a2b7775d3f3bba5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483eaad0>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_4949a8c2ee1a97a8f619167c080568b8.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_d6ce2147cf505f4f80625161d280cb61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a2a50>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_a101873eac6c4d77ae1799d3b77a6ba2.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_145157bc24832d2bee1fb64cd2004319.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870eb90>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_8eb7d9a045b635f5a2b7775d3f3bba5e.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7cdc90c-9441-5cb8-b621-7a85be4952ba
2026-04-27 08:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7cdc90c-9441-5cb8-b621-7a85be4952ba, skipping ID generation
2026-04-27 08:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cdc90c-9441-5cb8-b621-7a85be4952ba with scrape type 1
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7cdc90c-9441-5cb8-b621-7a85be4952ba sending to next pipeline
2026-04-27 08:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7cdc90c-9441-5cb8-b621-7a85be4952ba, identifier: YH13326
2026-04-27 08:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7cdc90c-9441-5cb8-b621-7a85be4952ba with identifier: YH13326
2026-04-27 08:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7cdc90c-9441-5cb8-b621-7a85be4952ba with identifier: YH13326
2026-04-27 08:07:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7cdc90c-9441-5cb8-b621-7a85be4952ba with identifier: YH13326 to the API
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_8eb7d9a045b635f5a2b7775d3f3bba5e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'city': 'Campo Real',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:11:41Z',
'fuel_type': 'diesel',
'id': 'a7cdc90c-9441-5cb8-b621-7a85be4952ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH13326',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'Opel',
'model': 'Insignia',
'odometer': 127435,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_4c83acf1cd9af47ef0229fec859527e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_8eb7d9a045b635f5a2b7775d3f3bba5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_d3fb783e421909a12ca14c973f883a70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_753a1410c0c989e3e3eb85ac270243a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_22b7ffe08d1a094984ea184450580628.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_f9713d3e3187ec74e6030f879003c65f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_2e1116f3563ba0bcff04a8c03dafe40f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_388c4b972f4c1e27233ebd5f31b7e5f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_c683371ac9fabfc18264dd179824a533.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7cdc90c-9441-5cb8-b621-7a85be4952ba/a7cdc90c-9441-5cb8-b621-7a85be4952ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/31/aa3158a1c86ba85531566b835cd44383/pa/YH13326_903af2b0bb9bc1f0bea7e0b32661f68d.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2014-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2014}
2026-04-27 08:07:53 [auto1.es] INFO: Saving data for YH13326: {'created_time': 1777277273.427589, 'last_price_update_time': 1777277273.427603, 'has_photos': True, 'auction_closing_time': 1777302701.0}
2026-04-27 08:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_8eb116767b29f908ce2a37bff5238199.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048989c90>
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_d6ce2147cf505f4f80625161d280cb61.jpg saved to cache
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 921e4265-44d9-5c55-8432-8b2cdc345b9f
2026-04-27 08:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 921e4265-44d9-5c55-8432-8b2cdc345b9f, skipping ID generation
2026-04-27 08:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921e4265-44d9-5c55-8432-8b2cdc345b9f with scrape type 1
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 921e4265-44d9-5c55-8432-8b2cdc345b9f sending to next pipeline
2026-04-27 08:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 921e4265-44d9-5c55-8432-8b2cdc345b9f, identifier: ME50829
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885d010>
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_145157bc24832d2bee1fb64cd2004319.jpg saved to cache
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 921e4265-44d9-5c55-8432-8b2cdc345b9f with identifier: ME50829
2026-04-27 08:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 921e4265-44d9-5c55-8432-8b2cdc345b9f with identifier: ME50829
2026-04-27 08:07:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 921e4265-44d9-5c55-8432-8b2cdc345b9f with identifier: ME50829 to the API
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_d6ce2147cf505f4f80625161d280cb61.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Sevilla',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:08:41Z',
'fuel_type': 'diesel',
'id': '921e4265-44d9-5c55-8432-8b2cdc345b9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME50829',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Toyota',
'model': 'Avensis',
'odometer': 277137,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_de7c743c274aadcdd2609d54d8c9492d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_d6ce2147cf505f4f80625161d280cb61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b46626680d83132b47df7ce0ca081e44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_1a4e11fdeab30d682e9d42f94206a97d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bd8d5a3f44018437bed784dd76d61cc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_917530580a8d0adef7074848b40bff41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_bb1373b5b53262b73f631878f1ba8904.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_b160b10cb4cd0a6677e037a2bc9d150e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_a42d4220fe7d8a758803c66f3edf7f01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_921e4265-44d9-5c55-8432-8b2cdc345b9f/921e4265-44d9-5c55-8432-8b2cdc345b9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/b0/ffb0aee7a0105df046c1058b5431d81a/pa/ME50829_5a1cfcb4aa077a9ef309e9aa7bdc271a.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2016-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Avensis 2.0 D-4D Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2016}
2026-04-27 08:07:53 [auto1.es] INFO: Saving data for ME50829: {'created_time': 1777277273.945291, 'last_price_update_time': 1777277273.945303, 'has_photos': True, 'auction_closing_time': 1777302521.0}
2026-04-27 08:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY24399> (referer: https://www.auto1.com/v1/car-details-view/VY24399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481be250>
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_8eb116767b29f908ce2a37bff5238199.jpg saved to cache
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27dd868f-2a02-56e8-9ad0-e522cdee0b19 with identifier: VY24399
2026-04-27 08:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19 with scrape type 1
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_06b4d58ae4bc7e532a2037575c6a474d.jpg not downloaded yet
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1aebc6c984cfb0a488b8161f6005cef4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_c75f790e8fa3418bb225af7a6523e0f7.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_039e19abe6e806ee9468ad22bcaea641.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_e7e5908afb8c396e611b2bd793c374f9.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_402a5a814f74841acb019cb0e85b6adb.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_2e2aab1f8ab2344e56e912a30cccad00.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_5d9aa3ffb32bae8484c381409ad68e3d.jpg not downloaded yet
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877890>
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1aebc6c984cfb0a488b8161f6005cef4.jpg saved to cache
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd
2026-04-27 08:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51ac9b0e-f6a2-589a-abb4-f66f816d82bd, skipping ID generation
2026-04-27 08:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd with scrape type 1
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51ac9b0e-f6a2-589a-abb4-f66f816d82bd sending to next pipeline
2026-04-27 08:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51ac9b0e-f6a2-589a-abb4-f66f816d82bd, identifier: HD33844
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_06b4d58ae4bc7e532a2037575c6a474d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_947bec0a38cee6d235b3e789789dd26b.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51ac9b0e-f6a2-589a-abb4-f66f816d82bd with identifier: HD33844
2026-04-27 08:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51ac9b0e-f6a2-589a-abb4-f66f816d82bd with identifier: HD33844
2026-04-27 08:07:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51ac9b0e-f6a2-589a-abb4-f66f816d82bd with identifier: HD33844 to the API
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1aebc6c984cfb0a488b8161f6005cef4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Esquivias',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:07:08Z',
'fuel_type': 'petrol',
'id': '51ac9b0e-f6a2-589a-abb4-f66f816d82bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD33844',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 68324,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1aebc6c984cfb0a488b8161f6005cef4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_145157bc24832d2bee1fb64cd2004319.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_a101873eac6c4d77ae1799d3b77a6ba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_0993318fafdb2b18b6416da06c2d98d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_1b297c82bcaed1754d026a7333e83691.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_56853152e327b8264bcda558d16f0531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_94f78a5cd3b6e0e1bbb2328a5040f82a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_337d127c81f792773a4ea26e6409b8b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_186f67397079dcafdf4d9cdd445caff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51ac9b0e-f6a2-589a-abb4-f66f816d82bd/51ac9b0e-f6a2-589a-abb4-f66f816d82bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec384af5048e1ede2253ff5d490232f5/pa/HD33844_f8ae554a7190e7e3d74d126fde61d152.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.2 360',
'transmission': 'manual',
'trim': '360',
'year': 2017}
2026-04-27 08:07:54 [auto1.es] INFO: Saving data for HD33844: {'created_time': 1777277274.753564, 'last_price_update_time': 1777277274.753577, 'has_photos': True, 'auction_closing_time': 1777302428.0}
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_a07b10ae55fae973cecadb29567fe016.jpg not downloaded yet
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_af02a52634939f6e9910d8016d19a09a.jpg not downloaded yet
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870ed50>
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_06b4d58ae4bc7e532a2037575c6a474d.jpg saved to cache
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC01902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_5d9aa3ffb32bae8484c381409ad68e3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_af02a52634939f6e9910d8016d19a09a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870e250>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_5d9aa3ffb32bae8484c381409ad68e3d.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048163a90>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_af02a52634939f6e9910d8016d19a09a.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_a07b10ae55fae973cecadb29567fe016.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_947bec0a38cee6d235b3e789789dd26b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820ba50>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_a07b10ae55fae973cecadb29567fe016.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e2d90>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_947bec0a38cee6d235b3e789789dd26b.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_2e2aab1f8ab2344e56e912a30cccad00.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885df10>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_2e2aab1f8ab2344e56e912a30cccad00.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_402a5a814f74841acb019cb0e85b6adb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_e7e5908afb8c396e611b2bd793c374f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482bbf10>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_402a5a814f74841acb019cb0e85b6adb.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT47654> (referer: https://www.auto1.com/v1/car-details-view/AT47654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1cd0>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_e7e5908afb8c396e611b2bd793c374f9.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_039e19abe6e806ee9468ad22bcaea641.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_c75f790e8fa3418bb225af7a6523e0f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_b8b8d434e838aefc31223d4fede82c04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994baab8-6f80-5a92-8bd3-b9b4fbc39232 with identifier: AT47654
2026-04-27 08:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232 with scrape type 1
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_43c9a8977e401fcbcbf8c507dc62b391.jpg not downloaded yet
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_fefcaaeefdd7c9644313a1a0407f80e0.jpg not downloaded yet
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a7848b8148e8b05f7f8da65e28a61cfa.jpg not downloaded yet
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486638d0>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_039e19abe6e806ee9468ad22bcaea641.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529c10>
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_c75f790e8fa3418bb225af7a6523e0f7.jpg saved to cache
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19
2026-04-27 08:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27dd868f-2a02-56e8-9ad0-e522cdee0b19, skipping ID generation
2026-04-27 08:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19 with scrape type 1
2026-04-27 08:07:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27dd868f-2a02-56e8-9ad0-e522cdee0b19 sending to next pipeline
2026-04-27 08:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 27dd868f-2a02-56e8-9ad0-e522cdee0b19, identifier: VY24399
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_0323eb2430a17d1c9488f449c26a3e7d.jpg not downloaded yet
2026-04-27 08:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 27dd868f-2a02-56e8-9ad0-e522cdee0b19 with identifier: VY24399
2026-04-27 08:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 27dd868f-2a02-56e8-9ad0-e522cdee0b19 with identifier: VY24399
2026-04-27 08:07:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 27dd868f-2a02-56e8-9ad0-e522cdee0b19 with identifier: VY24399 to the API
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_c75f790e8fa3418bb225af7a6523e0f7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:50:02Z',
'fuel_type': 'diesel',
'id': '27dd868f-2a02-56e8-9ad0-e522cdee0b19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY24399',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Audi',
'model': 'A4',
'odometer': 110017,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_06b4d58ae4bc7e532a2037575c6a474d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_c75f790e8fa3418bb225af7a6523e0f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_039e19abe6e806ee9468ad22bcaea641.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_e7e5908afb8c396e611b2bd793c374f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_402a5a814f74841acb019cb0e85b6adb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_2e2aab1f8ab2344e56e912a30cccad00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_5d9aa3ffb32bae8484c381409ad68e3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_947bec0a38cee6d235b3e789789dd26b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_a07b10ae55fae973cecadb29567fe016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27dd868f-2a02-56e8-9ad0-e522cdee0b19/27dd868f-2a02-56e8-9ad0-e522cdee0b19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/7a/e87a46c38c25cb0fa708f489c6e661db/pa/VY24399_af02a52634939f6e9910d8016d19a09a.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2006-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-04-27 08:07:56 [auto1.es] INFO: Saving data for VY24399: {'created_time': 1777277276.556975, 'last_price_update_time': 1777277276.556985, 'has_photos': True, 'auction_closing_time': 1777305002.0}
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_cb3d97bd3a504a195d328e46677fdc45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_591c87c89ca2674fdb183067ebe47635.jpg not downloaded yet
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048338fd0>
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_b8b8d434e838aefc31223d4fede82c04.jpg saved to cache
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a87cd550db5949993128b5d47b6d2c45.jpg not downloaded yet
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_b7603c9d6f60bb7fbb91fa5139dfe01b.jpg not downloaded yet
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_8372b27fd8f275f5f4abae32a56e4520.jpg not downloaded yet
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_19123cbae61b8b23225b47870d9637fa.jpg not downloaded yet
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f80d0>
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_cb3d97bd3a504a195d328e46677fdc45.jpg saved to cache
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_0323eb2430a17d1c9488f449c26a3e7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_6afc6ec933ead9fd7df1dc2a5113ed15.jpg not downloaded yet
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_19123cbae61b8b23225b47870d9637fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d5b50>
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_0323eb2430a17d1c9488f449c26a3e7d.jpg saved to cache
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_6afc6ec933ead9fd7df1dc2a5113ed15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL38185> (referer: https://www.auto1.com/v1/car-details-view/BL38185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_8372b27fd8f275f5f4abae32a56e4520.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c2210>
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_19123cbae61b8b23225b47870d9637fa.jpg saved to cache
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048660190>
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_6afc6ec933ead9fd7df1dc2a5113ed15.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2630ce6d-2b88-58d6-9655-a798b2a7e175 with identifier: BL38185
2026-04-27 08:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2630ce6d-2b88-58d6-9655-a798b2a7e175 with scrape type 1
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_9e659f9cad511a038747e3daa971a42e.jpg not downloaded yet
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_bc7538dc1642f6d250522cfa0cffee75.jpg not downloaded yet
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_b7603c9d6f60bb7fbb91fa5139dfe01b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_1c2858d8a53bf464664cc19e075065d5.jpg not downloaded yet
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048758a10>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_8372b27fd8f275f5f4abae32a56e4520.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_2846263346ac20dee0717163f76ebda2.jpg not downloaded yet
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_250ba129794d5b51aaf7a8a593957985.jpg not downloaded yet
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b97d7e402f0956f319f5bcc8571ca00d.jpg not downloaded yet
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_4c517152ebbf80564685f04fc4a7ab81.jpg not downloaded yet
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3e10>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_b7603c9d6f60bb7fbb91fa5139dfe01b.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_d0886282a619e65be712c0a50e5878d9.jpg not downloaded yet
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a87cd550db5949993128b5d47b6d2c45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b95dd8a8594372bc7722a42091720f9e.jpg not downloaded yet
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_f0a47383dc113e03ff444a3a91563932.jpg not downloaded yet
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_bc7538dc1642f6d250522cfa0cffee75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c2c90>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a87cd550db5949993128b5d47b6d2c45.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9d90>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_bc7538dc1642f6d250522cfa0cffee75.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_f0a47383dc113e03ff444a3a91563932.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_4c517152ebbf80564685f04fc4a7ab81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884650>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_f0a47383dc113e03ff444a3a91563932.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c3190>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_4c517152ebbf80564685f04fc4a7ab81.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b95dd8a8594372bc7722a42091720f9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_d0886282a619e65be712c0a50e5878d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c810>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b95dd8a8594372bc7722a42091720f9e.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884d210>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_d0886282a619e65be712c0a50e5878d9.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_250ba129794d5b51aaf7a8a593957985.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b97d7e402f0956f319f5bcc8571ca00d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048163350>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_250ba129794d5b51aaf7a8a593957985.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG64756> (referer: https://www.auto1.com/v1/car-details-view/ZG64756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841f250>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b97d7e402f0956f319f5bcc8571ca00d.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_2846263346ac20dee0717163f76ebda2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_1c2858d8a53bf464664cc19e075065d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_591c87c89ca2674fdb183067ebe47635.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64382eef-632f-5a83-be64-faec019b3951 with identifier: ZG64756
2026-04-27 08:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64382eef-632f-5a83-be64-faec019b3951 with scrape type 1
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_10fb54ef49933d51e870f172824557d2.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0ef9095d10605f98094de04474e3aaf.jpg not downloaded yet
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a7848b8148e8b05f7f8da65e28a61cfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_010a2ca022f3d5233b25e146cc7f4a7b.jpg not downloaded yet
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_fefcaaeefdd7c9644313a1a0407f80e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_8d91a3f672d119ee446acca22a093eb6.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_9bf5401078a528c9f862d65db120fbbe.jpg not downloaded yet
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820aa50>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_2846263346ac20dee0717163f76ebda2.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0f964335b40e8ca4a14fac8467034bd.jpg not downloaded yet
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_10fb54ef49933d51e870f172824557d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481ffc50>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_1c2858d8a53bf464664cc19e075065d5.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_9e659f9cad511a038747e3daa971a42e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_010a2ca022f3d5233b25e146cc7f4a7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW52091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK70823> (referer: https://www.auto1.com/v1/car-details-view/MK70823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048162890>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_591c87c89ca2674fdb183067ebe47635.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c890>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a7848b8148e8b05f7f8da65e28a61cfa.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822c390>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_fefcaaeefdd7c9644313a1a0407f80e0.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b690>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_10fb54ef49933d51e870f172824557d2.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9d10>
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_9e659f9cad511a038747e3daa971a42e.jpg saved to cache
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2630ce6d-2b88-58d6-9655-a798b2a7e175
2026-04-27 08:07:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2630ce6d-2b88-58d6-9655-a798b2a7e175, skipping ID generation
2026-04-27 08:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2630ce6d-2b88-58d6-9655-a798b2a7e175 with scrape type 1
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2630ce6d-2b88-58d6-9655-a798b2a7e175 sending to next pipeline
2026-04-27 08:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2630ce6d-2b88-58d6-9655-a798b2a7e175, identifier: BL38185
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a3690>
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_010a2ca022f3d5233b25e146cc7f4a7b.jpg saved to cache
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-04-27 08:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043be3b6-9f94-5190-9dea-94f99414cd15 with scrape type 1
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_ae14dc87d524e473e5af6fb04030d864.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2630ce6d-2b88-58d6-9655-a798b2a7e175 with identifier: BL38185
2026-04-27 08:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2630ce6d-2b88-58d6-9655-a798b2a7e175 with identifier: BL38185
2026-04-27 08:07:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2630ce6d-2b88-58d6-9655-a798b2a7e175 with identifier: BL38185 to the API
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_9e659f9cad511a038747e3daa971a42e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'A Cañiza Pontevedra',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:57:25Z',
'fuel_type': 'diesel',
'id': '2630ce6d-2b88-58d6-9655-a798b2a7e175',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL38185',
'listing': 'auction',
'location': 'ES, A Cañiza Pontevedra',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 301039,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_9e659f9cad511a038747e3daa971a42e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_bc7538dc1642f6d250522cfa0cffee75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_1c2858d8a53bf464664cc19e075065d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_2846263346ac20dee0717163f76ebda2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_250ba129794d5b51aaf7a8a593957985.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b97d7e402f0956f319f5bcc8571ca00d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_4c517152ebbf80564685f04fc4a7ab81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_d0886282a619e65be712c0a50e5878d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_b95dd8a8594372bc7722a42091720f9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2630ce6d-2b88-58d6-9655-a798b2a7e175/2630ce6d-2b88-58d6-9655-a798b2a7e175_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/f3/10f3660d52801675b015bcaab9ff4b9a/pa/BL38185_f0a47383dc113e03ff444a3a91563932.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi Tekna Premium 4x4',
'transmission': 'automatic',
'trim': 'Tekna Premium 4x4',
'year': 2011}
2026-04-27 08:07:59 [auto1.es] INFO: Saving data for BL38185: {'created_time': 1777277279.628478, 'last_price_update_time': 1777277279.628488, 'has_photos': True, 'auction_closing_time': 1777305445.0}
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_2bb54bfe87c285de674a5a77c93360e8.jpg not downloaded yet
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_9bf5401078a528c9f862d65db120fbbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0f964335b40e8ca4a14fac8467034bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_8d91a3f672d119ee446acca22a093eb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG81749> (referer: https://www.auto1.com/v1/car-details-view/FG81749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_4c96e437bd57319ae7f97800e40c812c.jpg not downloaded yet
2026-04-27 08:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_6210538a25e6e82e15dfe19071db0e9f.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_103924e478afea255329dcb601114f3d.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_5add20ca117790ff2cd2d0cab9b93ea9.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_d92b1f03b64185ca6f4c7e07d054d265.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_c2ac67c1ba2aafc1154e8922c9827bd2.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_aca473a9febad37ec7ebb86f97a67c31.jpg not downloaded yet
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_e517eb54c2ae9d23104de055126fddb7.jpg not downloaded yet
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048160c10>
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_9bf5401078a528c9f862d65db120fbbe.jpg saved to cache
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048714190>
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0f964335b40e8ca4a14fac8467034bd.jpg saved to cache
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207c90>
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_8d91a3f672d119ee446acca22a093eb6.jpg saved to cache
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfc17997-d9b9-5d91-8f6f-1d397aed5e20 with identifier: FG81749
2026-04-27 08:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20 with scrape type 1
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_08472e9ed54484e684e42e73a08b54f3.jpg not downloaded yet
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_31e5b53c8ab7d44a52beaabc58247649.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_a5cf89288e30e2aad52bfe2e9d150242.jpg not downloaded yet
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_43c9a8977e401fcbcbf8c507dc62b391.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_ae14dc87d524e473e5af6fb04030d864.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_2bb54bfe87c285de674a5a77c93360e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0ef9095d10605f98094de04474e3aaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_032e49432eb45918b4a7097ee781cc54.jpg not downloaded yet
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_c25b33506c6501626bc249e50e3c897e.jpg not downloaded yet
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_0c9b90dabb1cef4bc9d04196e55c4606.jpg not downloaded yet
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_8cc9e5fc691139cd4c53d2ae3cad9eaf.jpg not downloaded yet
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_aca473a9febad37ec7ebb86f97a67c31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_c2ac67c1ba2aafc1154e8922c9827bd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_e517eb54c2ae9d23104de055126fddb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488922d0>
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_31e5b53c8ab7d44a52beaabc58247649.jpg saved to cache
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_0c9b90dabb1cef4bc9d04196e55c4606.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_032e49432eb45918b4a7097ee781cc54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_c25b33506c6501626bc249e50e3c897e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048567450>
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_43c9a8977e401fcbcbf8c507dc62b391.jpg saved to cache
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232
2026-04-27 08:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 994baab8-6f80-5a92-8bd3-b9b4fbc39232, skipping ID generation
2026-04-27 08:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232 with scrape type 1
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 994baab8-6f80-5a92-8bd3-b9b4fbc39232 sending to next pipeline
2026-04-27 08:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 994baab8-6f80-5a92-8bd3-b9b4fbc39232, identifier: AT47654
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e0910>
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_ae14dc87d524e473e5af6fb04030d864.jpg saved to cache
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487edd50>
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_2bb54bfe87c285de674a5a77c93360e8.jpg saved to cache
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884f090>
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0ef9095d10605f98094de04474e3aaf.jpg saved to cache
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64382eef-632f-5a83-be64-faec019b3951
2026-04-27 08:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64382eef-632f-5a83-be64-faec019b3951, skipping ID generation
2026-04-27 08:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64382eef-632f-5a83-be64-faec019b3951 with scrape type 1
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64382eef-632f-5a83-be64-faec019b3951 sending to next pipeline
2026-04-27 08:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 64382eef-632f-5a83-be64-faec019b3951, identifier: ZG64756
2026-04-27 08:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 994baab8-6f80-5a92-8bd3-b9b4fbc39232 with identifier: AT47654
2026-04-27 08:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 994baab8-6f80-5a92-8bd3-b9b4fbc39232 with identifier: AT47654
2026-04-27 08:08:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 994baab8-6f80-5a92-8bd3-b9b4fbc39232 with identifier: AT47654 to the API
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_43c9a8977e401fcbcbf8c507dc62b391.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'city': 'Araia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:13:31Z',
'fuel_type': 'diesel',
'id': '994baab8-6f80-5a92-8bd3-b9b4fbc39232',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT47654',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'BMW',
'model': '3er',
'odometer': 301983,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_43c9a8977e401fcbcbf8c507dc62b391.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_fefcaaeefdd7c9644313a1a0407f80e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a7848b8148e8b05f7f8da65e28a61cfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_0323eb2430a17d1c9488f449c26a3e7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_591c87c89ca2674fdb183067ebe47635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_a87cd550db5949993128b5d47b6d2c45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_b7603c9d6f60bb7fbb91fa5139dfe01b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_8372b27fd8f275f5f4abae32a56e4520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_19123cbae61b8b23225b47870d9637fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_994baab8-6f80-5a92-8bd3-b9b4fbc39232/994baab8-6f80-5a92-8bd3-b9b4fbc39232_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/89/4889d786afa1ffdcde07450da63fc2bf/pa/AT47654_6afc6ec933ead9fd7df1dc2a5113ed15.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2014-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d GT xDrive',
'transmission': 'manual',
'trim': 'xDrive',
'year': 2014}
2026-04-27 08:08:00 [auto1.es] INFO: Saving data for AT47654: {'created_time': 1777277280.794538, 'last_price_update_time': 1777277280.794548, 'has_photos': True, 'auction_closing_time': 1777302811.0}
2026-04-27 08:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 64382eef-632f-5a83-be64-faec019b3951 with identifier: ZG64756
2026-04-27 08:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 64382eef-632f-5a83-be64-faec019b3951 with identifier: ZG64756
2026-04-27 08:08:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 64382eef-632f-5a83-be64-faec019b3951 with identifier: ZG64756 to the API
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0ef9095d10605f98094de04474e3aaf.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Elche',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-04-27T15:16:08Z',
'fuel_type': 'diesel',
'id': '64382eef-632f-5a83-be64-faec019b3951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG64756',
'listing': 'auction',
'location': 'ES, Elche',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '206',
'odometer': 236569,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_10fb54ef49933d51e870f172824557d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0ef9095d10605f98094de04474e3aaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_010a2ca022f3d5233b25e146cc7f4a7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_8d91a3f672d119ee446acca22a093eb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_9bf5401078a528c9f862d65db120fbbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64382eef-632f-5a83-be64-faec019b3951/64382eef-632f-5a83-be64-faec019b3951_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/2f/7a2fbe8dedbd40a535214cd23126fb7f/pa/ZG64756_b0f964335b40e8ca4a14fac8467034bd.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 206 1.4 HDi X Line',
'transmission': 'manual',
'trim': 'X Line',
'year': 2004}
2026-04-27 08:08:01 [auto1.es] INFO: Saving data for ZG64756: {'created_time': 1777277281.124788, 'last_price_update_time': 1777277281.124798, 'has_photos': True, 'auction_closing_time': 1777302968.0}
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_8cc9e5fc691139cd4c53d2ae3cad9eaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_d92b1f03b64185ca6f4c7e07d054d265.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_08472e9ed54484e684e42e73a08b54f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD85467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_5add20ca117790ff2cd2d0cab9b93ea9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_a5cf89288e30e2aad52bfe2e9d150242.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN36901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ec610>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_aca473a9febad37ec7ebb86f97a67c31.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898ba90>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_c2ac67c1ba2aafc1154e8922c9827bd2.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048895750>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_e517eb54c2ae9d23104de055126fddb7.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824ead0>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_0c9b90dabb1cef4bc9d04196e55c4606.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048494150>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_032e49432eb45918b4a7097ee781cc54.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048876cd0>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_c25b33506c6501626bc249e50e3c897e.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_6210538a25e6e82e15dfe19071db0e9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_103924e478afea255329dcb601114f3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6690>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_8cc9e5fc691139cd4c53d2ae3cad9eaf.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048855710>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_d92b1f03b64185ca6f4c7e07d054d265.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894cb90>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_08472e9ed54484e684e42e73a08b54f3.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048252990>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_5add20ca117790ff2cd2d0cab9b93ea9.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048428bd0>
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_a5cf89288e30e2aad52bfe2e9d150242.jpg saved to cache
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20
2026-04-27 08:08:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfc17997-d9b9-5d91-8f6f-1d397aed5e20, skipping ID generation
2026-04-27 08:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20 with scrape type 1
2026-04-27 08:08:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfc17997-d9b9-5d91-8f6f-1d397aed5e20 sending to next pipeline
2026-04-27 08:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cfc17997-d9b9-5d91-8f6f-1d397aed5e20, identifier: FG81749
2026-04-27 08:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cfc17997-d9b9-5d91-8f6f-1d397aed5e20 with identifier: FG81749
2026-04-27 08:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cfc17997-d9b9-5d91-8f6f-1d397aed5e20 with identifier: FG81749
2026-04-27 08:08:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cfc17997-d9b9-5d91-8f6f-1d397aed5e20 with identifier: FG81749 to the API
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_a5cf89288e30e2aad52bfe2e9d150242.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 160,
'expiration_date': '2026-04-27T15:26:25Z',
'fuel_type': 'diesel',
'id': 'cfc17997-d9b9-5d91-8f6f-1d397aed5e20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG81749',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Opel',
'model': 'Insignia',
'odometer': 204648,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_08472e9ed54484e684e42e73a08b54f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_a5cf89288e30e2aad52bfe2e9d150242.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_032e49432eb45918b4a7097ee781cc54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_c25b33506c6501626bc249e50e3c897e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_0c9b90dabb1cef4bc9d04196e55c4606.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc17997-d9b9-5d91-8f6f-1d397aed5e20/cfc17997-d9b9-5d91-8f6f-1d397aed5e20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/62/3d6250ce5bc11caa26af0a88ddf477f2/pa/FG81749_8cc9e5fc691139cd4c53d2ae3cad9eaf.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2011-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2011}
2026-04-27 08:08:02 [auto1.es] INFO: Saving data for FG81749: {'created_time': 1777277282.048355, 'last_price_update_time': 1777277282.048365, 'has_photos': True, 'auction_closing_time': 1777303585.0}
2026-04-27 08:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_74b80666eff44852e74d7163c4fdae16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_367f90636db9233e291fc19c5b46cc5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_4c96e437bd57319ae7f97800e40c812c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e14d0>
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_6210538a25e6e82e15dfe19071db0e9f.jpg saved to cache
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048895590>
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_103924e478afea255329dcb601114f3d.jpg saved to cache
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_e3f67b20c799f34fdce125ed2e6cd7ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_3bdc9696f47be7ff4561efe6016caa7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891c1d0>
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_74b80666eff44852e74d7163c4fdae16.jpg saved to cache
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048497f90>
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_367f90636db9233e291fc19c5b46cc5a.jpg saved to cache
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba
2026-04-27 08:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c98e9b62-a45f-5f57-ac0c-006e5ab153ba, skipping ID generation
2026-04-27 08:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba with scrape type 1
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c98e9b62-a45f-5f57-ac0c-006e5ab153ba sending to next pipeline
2026-04-27 08:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c98e9b62-a45f-5f57-ac0c-006e5ab153ba, identifier: GC65194
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891e990>
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_4c96e437bd57319ae7f97800e40c812c.jpg saved to cache
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 043be3b6-9f94-5190-9dea-94f99414cd15
2026-04-27 08:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 043be3b6-9f94-5190-9dea-94f99414cd15, skipping ID generation
2026-04-27 08:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043be3b6-9f94-5190-9dea-94f99414cd15 with scrape type 1
2026-04-27 08:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 043be3b6-9f94-5190-9dea-94f99414cd15 sending to next pipeline
2026-04-27 08:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 043be3b6-9f94-5190-9dea-94f99414cd15, identifier: MK70823
2026-04-27 08:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c98e9b62-a45f-5f57-ac0c-006e5ab153ba with identifier: GC65194
2026-04-27 08:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c98e9b62-a45f-5f57-ac0c-006e5ab153ba with identifier: GC65194
2026-04-27 08:08:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c98e9b62-a45f-5f57-ac0c-006e5ab153ba with identifier: GC65194 to the API
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_367f90636db9233e291fc19c5b46cc5a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'La Linde',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:28:03Z',
'fuel_type': 'petrol',
'id': 'c98e9b62-a45f-5f57-ac0c-006e5ab153ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 43.063,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC65194',
'listing': 'auction',
'location': 'ES, La Linea, Cadiz',
'location_confidence': 'geocoded',
'longitude': -6.5075,
'make': 'Ford',
'model': 'Tourneo',
'odometer': 36410,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_367f90636db9233e291fc19c5b46cc5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_f3a4618622d4bff182b861699e558e63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_d4aa97b277663c34410dfa897b3441dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_784639def12784006a002911eeb4ee9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_31e5b53c8ab7d44a52beaabc58247649.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_cb3d97bd3a504a195d328e46677fdc45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_b8b8d434e838aefc31223d4fede82c04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_8eb116767b29f908ce2a37bff5238199.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_4949a8c2ee1a97a8f619167c080568b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c98e9b62-a45f-5f57-ac0c-006e5ab153ba/c98e9b62-a45f-5f57-ac0c-006e5ab153ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/4e/944e3582334f02af86124099c6a45748/pa/GC65194_41d8e98ca77dd5f087f250c88d3afa82.jpg',
'Width': 800}],
'postal_code': '33818',
'price': 0,
'price_includes_vat': True,
'province': 'Asturias',
'province_code': 'ES-O',
'region': 'Asturias',
'region_code': 'ES-AS',
'registration_date': '2017-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Tourneo 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-04-27 08:08:02 [auto1.es] INFO: Saving data for GC65194: {'created_time': 1777277282.794953, 'last_price_update_time': 1777277282.794965, 'has_photos': True, 'auction_closing_time': 1777303683.0}
2026-04-27 08:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-04-27 08:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-04-27 08:08:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823 to the API
2026-04-27 08:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_4c96e437bd57319ae7f97800e40c812c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'city': 'Sevilla',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:01:03Z',
'fuel_type': 'diesel',
'id': '043be3b6-9f94-5190-9dea-94f99414cd15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK70823',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Peugeot',
'model': '508',
'odometer': 89468,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_ae14dc87d524e473e5af6fb04030d864.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_2bb54bfe87c285de674a5a77c93360e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_4c96e437bd57319ae7f97800e40c812c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_6210538a25e6e82e15dfe19071db0e9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_103924e478afea255329dcb601114f3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_5add20ca117790ff2cd2d0cab9b93ea9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_d92b1f03b64185ca6f4c7e07d054d265.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_c2ac67c1ba2aafc1154e8922c9827bd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_aca473a9febad37ec7ebb86f97a67c31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_043be3b6-9f94-5190-9dea-94f99414cd15/043be3b6-9f94-5190-9dea-94f99414cd15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/76/737610c28629ffefbb7f43e81c7abfbd/pa/MK70823_e517eb54c2ae9d23104de055126fddb7.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2019-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 2.0 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-04-27 08:08:03 [auto1.es] INFO: Saving data for MK70823: {'created_time': 1777277283.154437, 'last_price_update_time': 1777277283.154447, 'has_photos': True, 'auction_closing_time': 1777302063.0}
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_f2338bb9675237488b417680b7abc5dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_5fa719fd1cb3bf3d03b4e8de3251991d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_aae1099bdeed2f4698e1f4ea70c8de90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a07a22f5b2761405a92b41f802d04232.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC01902> (referer: https://www.auto1.com/v1/car-details-view/GC01902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV03945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048931810>
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_e3f67b20c799f34fdce125ed2e6cd7ed.jpg saved to cache
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d3407af-7fa5-5857-b442-d36a46bcfcab
2026-04-27 08:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d3407af-7fa5-5857-b442-d36a46bcfcab, skipping ID generation
2026-04-27 08:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d3407af-7fa5-5857-b442-d36a46bcfcab with scrape type 1
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d3407af-7fa5-5857-b442-d36a46bcfcab sending to next pipeline
2026-04-27 08:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d3407af-7fa5-5857-b442-d36a46bcfcab, identifier: DD74793
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048257690>
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_3bdc9696f47be7ff4561efe6016caa7c.jpg saved to cache
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793
2026-04-27 08:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793
2026-04-27 08:08:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793 to the API
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_e3f67b20c799f34fdce125ed2e6cd7ed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'city': 'Granyanella',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 67,
'expiration_date': '2026-04-27T15:42:30Z',
'fuel_type': 'petrol',
'id': '7d3407af-7fa5-5857-b442-d36a46bcfcab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD74793',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Hyundai',
'model': 'i10',
'odometer': 139745,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_2295d1ab35e1ea3cc21a66bbf3ebd5e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_e3f67b20c799f34fdce125ed2e6cd7ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_74b80666eff44852e74d7163c4fdae16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_76ac759932939550efa96f85feca2242.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_0035ddf36ea06ee9cd431b059f30b72c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_1540a9767d4971f552d76ddaa5cc8a2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_99a3577dca52f5bdc412100acb622a18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_a2160340a090f57313043f3d0f0ae27e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_b0d5ca75d62602084ef8c9b310037ae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d3407af-7fa5-5857-b442-d36a46bcfcab/7d3407af-7fa5-5857-b442-d36a46bcfcab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/4f/154fb90effd33a2503d6918f517ecc2b/pa/DD74793_5b01a6e3475ec801a602c9b6e204f820.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i10 1.0 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-04-27 08:08:03 [auto1.es] INFO: Saving data for DD74793: {'created_time': 1777277283.661693, 'last_price_update_time': 1777277283.661703, 'has_photos': True, 'auction_closing_time': 1777304550.0}
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_b72ad79b0934029219cd9c827004ed8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_1af223dc527f9b59f9e0dfe8a3509851.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a81ab98a2b8f698fb8a8e2e67d97fadc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff056e6b850>
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_f2338bb9675237488b417680b7abc5dc.jpg saved to cache
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822c810>
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_5fa719fd1cb3bf3d03b4e8de3251991d.jpg saved to cache
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04822c250>
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_aae1099bdeed2f4698e1f4ea70c8de90.jpg saved to cache
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9
2026-04-27 08:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 948ff48b-911b-5ad6-b52b-9cef15ffd5c9, skipping ID generation
2026-04-27 08:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 with scrape type 1
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 sending to next pipeline
2026-04-27 08:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 948ff48b-911b-5ad6-b52b-9cef15ffd5c9, identifier: DN96024
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842b850>
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a07a22f5b2761405a92b41f802d04232.jpg saved to cache
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf
2026-04-27 08:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27341818-a1c3-5cb1-a17d-48a8c15f8baf, skipping ID generation
2026-04-27 08:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf with scrape type 1
2026-04-27 08:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27341818-a1c3-5cb1-a17d-48a8c15f8baf sending to next pipeline
2026-04-27 08:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 27341818-a1c3-5cb1-a17d-48a8c15f8baf, identifier: VG52049
2026-04-27 08:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf54e16b-41dc-5634-a733-d1f82cffb2fd with identifier: GC01902
2026-04-27 08:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf54e16b-41dc-5634-a733-d1f82cffb2fd with scrape type 1
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_0470020f116c1db68a3448507dda86ec.jpg not downloaded yet
2026-04-27 08:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 with identifier: DN96024
2026-04-27 08:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 with identifier: DN96024
2026-04-27 08:08:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 948ff48b-911b-5ad6-b52b-9cef15ffd5c9 with identifier: DN96024 to the API
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_aae1099bdeed2f4698e1f4ea70c8de90.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:33:01Z',
'fuel_type': 'petrol',
'id': '948ff48b-911b-5ad6-b52b-9cef15ffd5c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN96024',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Seat',
'model': 'Leon',
'odometer': 286173,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_eba8d581a648bc6e84464d7c97f922c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_64d968732e52bca788d66278061d069f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_3bdc9696f47be7ff4561efe6016caa7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_aae1099bdeed2f4698e1f4ea70c8de90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_d823bb1200b07db92aa2996a18ecae2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_9fefb4179210ecc6bc8fdd82d6927849.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_1c4d3b323d3e64038f7e263a802ac138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_b15656a21d5e8c7158b0569d6645b564.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_c849d5f6e8ab53c599f969644cf70b3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_948ff48b-911b-5ad6-b52b-9cef15ffd5c9/948ff48b-911b-5ad6-b52b-9cef15ffd5c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/cd/2fcd3b372b55b10a3b7db3b89558bb9e/pa/DN96024_33ed9a084b19bbc36b706c6433f2f6e6.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2014-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-04-27 08:08:04 [auto1.es] INFO: Saving data for DN96024: {'created_time': 1777277284.367217, 'last_price_update_time': 1777277284.367229, 'has_photos': True, 'auction_closing_time': 1777303981.0}
2026-04-27 08:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 27341818-a1c3-5cb1-a17d-48a8c15f8baf with identifier: VG52049
2026-04-27 08:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 27341818-a1c3-5cb1-a17d-48a8c15f8baf with identifier: VG52049
2026-04-27 08:08:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 27341818-a1c3-5cb1-a17d-48a8c15f8baf with identifier: VG52049 to the API
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a07a22f5b2761405a92b41f802d04232.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Pedrola',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:21:42Z',
'fuel_type': 'diesel',
'id': '27341818-a1c3-5cb1-a17d-48a8c15f8baf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG52049',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 150932,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_5fa719fd1cb3bf3d03b4e8de3251991d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a07a22f5b2761405a92b41f802d04232.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_6394d210c9f0b72043b81bee958f7295.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_f2338bb9675237488b417680b7abc5dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_fc646a7036272be8b77048927e8ca6ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_14ed78aac42874576368767f4f9d2f41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_3e30ded1e95fa349b3a6746e8da6ee3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_91da1f7ec9f6cc5ca8869185095a6499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_aa993427c850e92d1097adf81ded0a32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_27341818-a1c3-5cb1-a17d-48a8c15f8baf/27341818-a1c3-5cb1-a17d-48a8c15f8baf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/56/de5650bd85eb65eb59eaa6be0efdd456/pa/VG52049_a3591766a6763d5fed160fb1e941f45f.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2018-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar F-Pace 20d R-Sport AWD',
'transmission': 'automatic',
'trim': 'R-Sport AWD',
'year': 2018}
2026-04-27 08:08:04 [auto1.es] INFO: Saving data for VG52049: {'created_time': 1777277284.67558, 'last_price_update_time': 1777277284.675594, 'has_photos': True, 'auction_closing_time': 1777303302.0}
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_8a81acd4114439c0f38fd1d2192f558e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a5f7e6149a47fff70a239dd4b142e521.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_117159b8711c33116635ece63f83d547.jpg not downloaded yet
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482118d0>
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_b72ad79b0934029219cd9c827004ed8b.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048695090>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_1af223dc527f9b59f9e0dfe8a3509851.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488568d0>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a81ab98a2b8f698fb8a8e2e67d97fadc.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_00a44ee5bb44aaba4f99bf8457b9744b.png> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_322d0298875b5fe7e88ef36a8657a611.jpg not downloaded yet
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853bd0>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_8a81acd4114439c0f38fd1d2192f558e.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b6a90>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a5f7e6149a47fff70a239dd4b142e521.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_b2ddb3fe3550d5e5aeee5b534a963c6d.jpg not downloaded yet
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_0470020f116c1db68a3448507dda86ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_46b63ad6fa1201292ad9b37e78447214.jpg not downloaded yet
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_6c23a4c4b62b0cd80ab23e32d515dc1c.jpg not downloaded yet
2026-04-27 08:08:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 08:08:05 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 08:08:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e8c10>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_2.png HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_00a44ee5bb44aaba4f99bf8457b9744b.png saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4660707-9073-5a47-b843-1fa393d1cbe1
2026-04-27 08:08:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4660707-9073-5a47-b843-1fa393d1cbe1, skipping ID generation
2026-04-27 08:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4660707-9073-5a47-b843-1fa393d1cbe1 with scrape type 1
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4660707-9073-5a47-b843-1fa393d1cbe1 sending to next pipeline
2026-04-27 08:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4660707-9073-5a47-b843-1fa393d1cbe1, identifier: XY57124
2026-04-27 08:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4660707-9073-5a47-b843-1fa393d1cbe1 with identifier: XY57124
2026-04-27 08:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4660707-9073-5a47-b843-1fa393d1cbe1 with identifier: XY57124
2026-04-27 08:08:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4660707-9073-5a47-b843-1fa393d1cbe1 with identifier: XY57124 to the API
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_00a44ee5bb44aaba4f99bf8457b9744b.png>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'city': 'Esquivias',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:03:53Z',
'fuel_type': 'diesel',
'id': 'd4660707-9073-5a47-b843-1fa393d1cbe1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY57124',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Peugeot',
'model': '508',
'odometer': 71358,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55171,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_8a81acd4114439c0f38fd1d2192f558e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55171,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a5f7e6149a47fff70a239dd4b142e521.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 381317,
'Height': 516,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_00a44ee5bb44aaba4f99bf8457b9744b.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49596,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_1af223dc527f9b59f9e0dfe8a3509851.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54479,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_a81ab98a2b8f698fb8a8e2e67d97fadc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46014,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_b72ad79b0934029219cd9c827004ed8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42211,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_4734ca1c1098760957fd6de5797a413e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55377,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_bd744e7e181feac7b543d1aa1acb7950.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57966,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_574a1be285e67c5e0ed1507534943349.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4660707-9073-5a47-b843-1fa393d1cbe1/d4660707-9073-5a47-b843-1fa393d1cbe1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34034,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/da/d0da29efe3d60b7727e70ec485bad812/pa/XY57124_2c2b9e2dcf0108071c530b20efe95dde.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2019-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-04-27 08:08:05 [auto1.es] INFO: Saving data for XY57124: {'created_time': 1777277285.779748, 'last_price_update_time': 1777277285.779763, 'has_photos': True, 'auction_closing_time': 1777302233.0}
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_b2ddb3fe3550d5e5aeee5b534a963c6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_117159b8711c33116635ece63f83d547.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820b850>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_0470020f116c1db68a3448507dda86ec.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR58121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841e590>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_b2ddb3fe3550d5e5aeee5b534a963c6d.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851b90>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_117159b8711c33116635ece63f83d547.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_46b63ad6fa1201292ad9b37e78447214.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_322d0298875b5fe7e88ef36a8657a611.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520450>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_46b63ad6fa1201292ad9b37e78447214.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_6c23a4c4b62b0cd80ab23e32d515dc1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820aed0>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_322d0298875b5fe7e88ef36a8657a611.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048565f10>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_6c23a4c4b62b0cd80ab23e32d515dc1c.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf54e16b-41dc-5634-a733-d1f82cffb2fd
2026-04-27 08:08:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf54e16b-41dc-5634-a733-d1f82cffb2fd, skipping ID generation
2026-04-27 08:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf54e16b-41dc-5634-a733-d1f82cffb2fd with scrape type 1
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf54e16b-41dc-5634-a733-d1f82cffb2fd sending to next pipeline
2026-04-27 08:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf54e16b-41dc-5634-a733-d1f82cffb2fd, identifier: GC01902
2026-04-27 08:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf54e16b-41dc-5634-a733-d1f82cffb2fd with identifier: GC01902
2026-04-27 08:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf54e16b-41dc-5634-a733-d1f82cffb2fd with identifier: GC01902
2026-04-27 08:08:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf54e16b-41dc-5634-a733-d1f82cffb2fd with identifier: GC01902 to the API
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_6c23a4c4b62b0cd80ab23e32d515dc1c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 60,
'expiration_date': '2026-04-27T15:07:48Z',
'fuel_type': 'petrol',
'id': 'cf54e16b-41dc-5634-a733-d1f82cffb2fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC01902',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Citroen',
'model': 'C3',
'odometer': 52187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_0470020f116c1db68a3448507dda86ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_117159b8711c33116635ece63f83d547.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_322d0298875b5fe7e88ef36a8657a611.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_b2ddb3fe3550d5e5aeee5b534a963c6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_46b63ad6fa1201292ad9b37e78447214.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf54e16b-41dc-5634-a733-d1f82cffb2fd/cf54e16b-41dc-5634-a733-d1f82cffb2fd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/34/8834112702d35fcd2e07d6289fc0ea5d/pa/GC01902_6c23a4c4b62b0cd80ab23e32d515dc1c.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2009-10-01',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.1 First Tonic',
'transmission': 'manual',
'trim': 'First Tonic',
'year': 2009}
2026-04-27 08:08:06 [auto1.es] INFO: Saving data for GC01902: {'created_time': 1777277286.683803, 'last_price_update_time': 1777277286.683813, 'has_photos': True, 'auction_closing_time': 1777302468.0}
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW52091> (referer: https://www.auto1.com/v1/car-details-view/NW52091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4040978-c8c4-5e6a-ba6e-91004755f9a9 with identifier: NW52091
2026-04-27 08:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4040978-c8c4-5e6a-ba6e-91004755f9a9 with scrape type 1
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b5f198ba58a8603e0d86accca3b8efb8.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_79cb14a989ad83762696d9f7e3ab4823.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_7109de2ed913116574bf592cc58e1e6a.jpg not downloaded yet
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ28703> (referer: https://www.auto1.com/v1/car-details-view/UJ28703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_330e3a4c941bd9cd26aff96e811793f8.jpg not downloaded yet
2026-04-27 08:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_3bd9cea4d03f5eb6f6937dbc778d73dc.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_53c587bdf2cef13118e11e33275fc844.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b858e65d08de9ab055794e5e64967c37.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_d3cd031aace62dca959e23c7316bff6e.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_9723b7d06024a4696066a6268c7bb6b2.jpg not downloaded yet
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_7109de2ed913116574bf592cc58e1e6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_311899aab6eef8391860a6b66a077158.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b67b44-6159-5959-82fa-5df64e473324 with identifier: UJ28703
2026-04-27 08:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b67b44-6159-5959-82fa-5df64e473324 with scrape type 1
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_6a417b37cfef836fd450f1ded4c6437c.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_a623a1104951a342e4938dbcf5fafb39.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_76f456bc63a01feeb50fcefc6c91a45d.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_36c05cc9f6b1f3c98cbfbad8bcd82755.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_0c89a5605e35ac6c26a34262d56c980a.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_f76f7cfd76061f89ea00b4e79db565db.jpg not downloaded yet
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c1e10>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_7109de2ed913116574bf592cc58e1e6a.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_ae472335868e5d26e4e08ef686855f0e.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_56ce3d941c704fffd589ed6101c285a0.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_5e45ed083518141f5d1cd3d26dfa9136.jpg not downloaded yet
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_9723b7d06024a4696066a6268c7bb6b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_46a7b673c55e19458c131ccf7e0461e9.jpg not downloaded yet
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a0910>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_9723b7d06024a4696066a6268c7bb6b2.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_5e45ed083518141f5d1cd3d26dfa9136.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b4950>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_5e45ed083518141f5d1cd3d26dfa9136.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_46a7b673c55e19458c131ccf7e0461e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824d190>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_46a7b673c55e19458c131ccf7e0461e9.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_56ce3d941c704fffd589ed6101c285a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN36901> (referer: https://www.auto1.com/v1/car-details-view/RN36901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048806ad0>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_56ce3d941c704fffd589ed6101c285a0.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e with identifier: RN36901
2026-04-27 08:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e with scrape type 1
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_f6b4ae59e004740f27d0c749f1eada16.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_276cfcfb5b52446bd8009a67c634c080.jpg not downloaded yet
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_f76f7cfd76061f89ea00b4e79db565db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcd2f552dd58edb1939e443717b6004c.jpg not downloaded yet
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_2cdf3722ca6dbd83510c192a0f11b8cf.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_136e9804aec4934101fe4f39c1174494.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_62070349ded1ef309994c42e3c7c5663.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_1a0e86d8d080cffc4fd9c1d62921a835.jpg not downloaded yet
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_f6b4ae59e004740f27d0c749f1eada16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_ded1067908e68b388246f31761f710dd.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcc4764a570a0fee185fe7c02511a6a8.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_c9a0989c98e9b85869a8a7f55becd9d0.jpg not downloaded yet
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_ae472335868e5d26e4e08ef686855f0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048867b50>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_f76f7cfd76061f89ea00b4e79db565db.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884fa50>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_f6b4ae59e004740f27d0c749f1eada16.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_62070349ded1ef309994c42e3c7c5663.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a55d0>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_ae472335868e5d26e4e08ef686855f0e.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcc4764a570a0fee185fe7c02511a6a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048654d50>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_62070349ded1ef309994c42e3c7c5663.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_c9a0989c98e9b85869a8a7f55becd9d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ff2d0>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcc4764a570a0fee185fe7c02511a6a8.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_ded1067908e68b388246f31761f710dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_1a0e86d8d080cffc4fd9c1d62921a835.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048208290>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_c9a0989c98e9b85869a8a7f55becd9d0.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d6a10>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_ded1067908e68b388246f31761f710dd.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_136e9804aec4934101fe4f39c1174494.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04820be50>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_1a0e86d8d080cffc4fd9c1d62921a835.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_2cdf3722ca6dbd83510c192a0f11b8cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.549(s), this was the 1st time calling it.
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.205887458283271 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048161ed0>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_136e9804aec4934101fe4f39c1174494.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980190>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_2cdf3722ca6dbd83510c192a0f11b8cf.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcd2f552dd58edb1939e443717b6004c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK11876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_276cfcfb5b52446bd8009a67c634c080.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_76f456bc63a01feeb50fcefc6c91a45d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853850>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcd2f552dd58edb1939e443717b6004c.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048866790>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_276cfcfb5b52446bd8009a67c634c080.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e
2026-04-27 08:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e, skipping ID generation
2026-04-27 08:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e with scrape type 1
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e sending to next pipeline
2026-04-27 08:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e, identifier: RN36901
2026-04-27 08:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e with identifier: RN36901
2026-04-27 08:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e with identifier: RN36901
2026-04-27 08:08:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f03dbf9-9367-57c2-8d20-3007cbc0eb6e with identifier: RN36901 to the API
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_276cfcfb5b52446bd8009a67c634c080.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'city': 'Campo Real',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-04-27T15:15:24Z',
'fuel_type': 'diesel',
'id': '6f03dbf9-9367-57c2-8d20-3007cbc0eb6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN36901',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'BMW',
'model': 'X4',
'odometer': 221695,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_f6b4ae59e004740f27d0c749f1eada16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_276cfcfb5b52446bd8009a67c634c080.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcd2f552dd58edb1939e443717b6004c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_2cdf3722ca6dbd83510c192a0f11b8cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_136e9804aec4934101fe4f39c1174494.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_62070349ded1ef309994c42e3c7c5663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_1a0e86d8d080cffc4fd9c1d62921a835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_ded1067908e68b388246f31761f710dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_bcc4764a570a0fee185fe7c02511a6a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6f03dbf9-9367-57c2-8d20-3007cbc0eb6e/6f03dbf9-9367-57c2-8d20-3007cbc0eb6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/22/70220fea40b0ca908f4534b1080bc56f/pa/RN36901_c9a0989c98e9b85869a8a7f55becd9d0.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2019-11-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X4 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-04-27 08:08:09 [auto1.es] INFO: Saving data for RN36901: {'created_time': 1777277289.592295, 'last_price_update_time': 1777277289.592316, 'has_photos': True, 'auction_closing_time': 1777302924.0}
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_0c89a5605e35ac6c26a34262d56c980a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY46229> (referer: https://www.auto1.com/v1/car-details-view/TY46229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848d850>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_76f456bc63a01feeb50fcefc6c91a45d.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_36c05cc9f6b1f3c98cbfbad8bcd82755.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_a623a1104951a342e4938dbcf5fafb39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048661350>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_0c89a5605e35ac6c26a34262d56c980a.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_6a417b37cfef836fd450f1ded4c6437c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_311899aab6eef8391860a6b66a077158.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 with identifier: TY46229
2026-04-27 08:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 with scrape type 1
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_bd75f69a5c5228e6a2e4cf957520b488.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_0c39d442b4315e76af57a63539e7a8c7.jpg not downloaded yet
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_76997db767973bd2c873d013b773be9e.jpg not downloaded yet
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889fe10>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_36c05cc9f6b1f3c98cbfbad8bcd82755.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_29931060421dac6c4b2129f3dcd46559.jpg not downloaded yet
2026-04-27 08:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841cf10>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_a623a1104951a342e4938dbcf5fafb39.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_d3cd031aace62dca959e23c7316bff6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_4363d403304a779eba7c6e32d2ffebb2.jpg not downloaded yet
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048743f50>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_6a417b37cfef836fd450f1ded4c6437c.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23b67b44-6159-5959-82fa-5df64e473324
2026-04-27 08:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23b67b44-6159-5959-82fa-5df64e473324, skipping ID generation
2026-04-27 08:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b67b44-6159-5959-82fa-5df64e473324 with scrape type 1
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23b67b44-6159-5959-82fa-5df64e473324 sending to next pipeline
2026-04-27 08:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 23b67b44-6159-5959-82fa-5df64e473324, identifier: UJ28703
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048841390>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_311899aab6eef8391860a6b66a077158.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 23b67b44-6159-5959-82fa-5df64e473324 with identifier: UJ28703
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-04-27 08:08:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 23b67b44-6159-5959-82fa-5df64e473324 with identifier: UJ28703
2026-04-27 08:08:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 23b67b44-6159-5959-82fa-5df64e473324 with identifier: UJ28703 to the API
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_6a417b37cfef836fd450f1ded4c6437c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 184,
'category': None,
'city': 'Cabrera De Mar',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:51:59Z',
'fuel_type': 'diesel',
'id': '23b67b44-6159-5959-82fa-5df64e473324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.5167,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ28703',
'listing': 'auction',
'location': 'ES, Cabrera de Mar',
'location_confidence': 'geocoded',
'longitude': 2.4,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 265538,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_6a417b37cfef836fd450f1ded4c6437c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2360023,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_a623a1104951a342e4938dbcf5fafb39.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409724,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_76f456bc63a01feeb50fcefc6c91a45d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2133009,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_36c05cc9f6b1f3c98cbfbad8bcd82755.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_0c89a5605e35ac6c26a34262d56c980a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_f76f7cfd76061f89ea00b4e79db565db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2155091,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_ae472335868e5d26e4e08ef686855f0e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_56ce3d941c704fffd589ed6101c285a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_5e45ed083518141f5d1cd3d26dfa9136.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23b67b44-6159-5959-82fa-5df64e473324/23b67b44-6159-5959-82fa-5df64e473324_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/1e/621e5497b12105c2a87fbcf8f5c5e8ba/pa/UJ28703_46a7b673c55e19458c131ccf7e0461e9.jpg',
'Width': 800}],
'postal_code': '08349',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2012-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi Tekna Premium 4x4',
'transmission': 'automatic',
'trim': 'Tekna Premium 4x4',
'year': 2012}
2026-04-27 08:08:10 [auto1.es] INFO: Saving data for UJ28703: {'created_time': 1777277290.660394, 'last_price_update_time': 1777277290.660408, 'has_photos': True, 'auction_closing_time': 1777305119.0}
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_ce75821ffb6e727cce9f8b2d595df230.jpg not downloaded yet
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b858e65d08de9ab055794e5e64967c37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ebbd0>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_d3cd031aace62dca959e23c7316bff6e.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_76997db767973bd2c873d013b773be9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_90a27809e5bc7a610aa38eec295741ad.jpg not downloaded yet
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.266(s), this was the 1st time calling it.
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.771947623788423 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_1fe235a7ecb54fd5a95ef04b3bc1d73b.jpg not downloaded yet
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ73279> (referer: https://www.auto1.com/v1/car-details-view/NJ73279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_53c587bdf2cef13118e11e33275fc844.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_462ef202d1df07d0698fa55f4d0d4221.jpg not downloaded yet
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_e0a9336c18f79b8c61d9a5e9b0bd829c.jpg not downloaded yet
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048897b50>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b858e65d08de9ab055794e5e64967c37.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_1fe235a7ecb54fd5a95ef04b3bc1d73b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c1390>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_76997db767973bd2c873d013b773be9e.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_ce75821ffb6e727cce9f8b2d595df230.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_4363d403304a779eba7c6e32d2ffebb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279
2026-04-27 08:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08640767-4910-5498-926e-158541284fda with scrape type 1
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_d5b77ab2082b76d1311d1794f45363be.jpg not downloaded yet
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e1c90>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_53c587bdf2cef13118e11e33275fc844.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_90a27809e5bc7a610aa38eec295741ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_5e6270c868c1b712ef06878f90cc765b.jpg not downloaded yet
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_462ef202d1df07d0698fa55f4d0d4221.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_8042ddac1cb7b364fddbfdce4f513d23.jpg not downloaded yet
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e99d0>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_1fe235a7ecb54fd5a95ef04b3bc1d73b.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_eb93823c36d649f70385ea1c2ea2e3a2.jpg not downloaded yet
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a94850>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_ce75821ffb6e727cce9f8b2d595df230.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048740810>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_4363d403304a779eba7c6e32d2ffebb2.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_d5b77ab2082b76d1311d1794f45363be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_e0a9336c18f79b8c61d9a5e9b0bd829c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_e67d7ea38b3ec608f2c1b65af2e9adf5.jpg not downloaded yet
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_29931060421dac6c4b2129f3dcd46559.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0ad0>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_90a27809e5bc7a610aa38eec295741ad.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841c890>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_462ef202d1df07d0698fa55f4d0d4221.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_f3860a203fe6952e7bc413b3c2f17e07.jpg not downloaded yet
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_0c39d442b4315e76af57a63539e7a8c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_8042ddac1cb7b364fddbfdce4f513d23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_7dffdf14aafec3bd19555b526c2cde33.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_96c24540c11a7036dcd87784813f7712.jpg not downloaded yet
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048160650>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_d5b77ab2082b76d1311d1794f45363be.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894d150>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_e0a9336c18f79b8c61d9a5e9b0bd829c.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207e50>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_29931060421dac6c4b2129f3dcd46559.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_16d32c18f21da3fbfa21ca2ff832f6b1.jpg not downloaded yet
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_5e6270c868c1b712ef06878f90cc765b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_f3860a203fe6952e7bc413b3c2f17e07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_eb93823c36d649f70385ea1c2ea2e3a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_e67d7ea38b3ec608f2c1b65af2e9adf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_2476a3748432f26b3e1e5568af3c91b8.jpg not downloaded yet
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894f210>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_0c39d442b4315e76af57a63539e7a8c7.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048236550>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_8042ddac1cb7b364fddbfdce4f513d23.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_7dffdf14aafec3bd19555b526c2cde33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_96c24540c11a7036dcd87784813f7712.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824c150>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_5e6270c868c1b712ef06878f90cc765b.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f9850>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_f3860a203fe6952e7bc413b3c2f17e07.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_bd75f69a5c5228e6a2e4cf957520b488.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_16d32c18f21da3fbfa21ca2ff832f6b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e5310>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_eb93823c36d649f70385ea1c2ea2e3a2.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048988650>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_e67d7ea38b3ec608f2c1b65af2e9adf5.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048741590>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_7dffdf14aafec3bd19555b526c2cde33.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fd10>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_96c24540c11a7036dcd87784813f7712.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_3bd9cea4d03f5eb6f6937dbc778d73dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_330e3a4c941bd9cd26aff96e811793f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_2476a3748432f26b3e1e5568af3c91b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_79cb14a989ad83762696d9f7e3ab4823.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889f490>
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_bd75f69a5c5228e6a2e4cf957520b488.jpg saved to cache
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4
2026-04-27 08:08:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4, skipping ID generation
2026-04-27 08:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 with scrape type 1
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 sending to next pipeline
2026-04-27 08:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4, identifier: TY46229
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048864150>
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_16d32c18f21da3fbfa21ca2ff832f6b1.jpg saved to cache
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 with identifier: TY46229
2026-04-27 08:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 with identifier: TY46229
2026-04-27 08:08:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4 with identifier: TY46229 to the API
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_bd75f69a5c5228e6a2e4cf957520b488.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:48:14Z',
'fuel_type': 'diesel',
'id': '7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY46229',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 104105,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_bd75f69a5c5228e6a2e4cf957520b488.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_0c39d442b4315e76af57a63539e7a8c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_76997db767973bd2c873d013b773be9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_29931060421dac6c4b2129f3dcd46559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_4363d403304a779eba7c6e32d2ffebb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_ce75821ffb6e727cce9f8b2d595df230.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_90a27809e5bc7a610aa38eec295741ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_1fe235a7ecb54fd5a95ef04b3bc1d73b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_462ef202d1df07d0698fa55f4d0d4221.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4/7cfa4ae1-a3f0-525d-a10d-b294e5f7c2e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/9b/ee9b28ec20c157f89b18f50b43fdb43c/pa/TY46229_e0a9336c18f79b8c61d9a5e9b0bd829c.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2014-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion Tech',
'transmission': 'manual',
'trim': 'Advance BlueMotion Tech',
'year': 2014}
2026-04-27 08:08:12 [auto1.es] INFO: Saving data for TY46229: {'created_time': 1777277292.614863, 'last_price_update_time': 1777277292.614878, 'has_photos': True, 'auction_closing_time': 1777304894.0}
2026-04-27 08:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048988410>
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_3bd9cea4d03f5eb6f6937dbc778d73dc.jpg saved to cache
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048657b50>
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_330e3a4c941bd9cd26aff96e811793f8.jpg saved to cache
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894e450>
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_2476a3748432f26b3e1e5568af3c91b8.jpg saved to cache
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08640767-4910-5498-926e-158541284fda
2026-04-27 08:08:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08640767-4910-5498-926e-158541284fda, skipping ID generation
2026-04-27 08:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08640767-4910-5498-926e-158541284fda with scrape type 1
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08640767-4910-5498-926e-158541284fda sending to next pipeline
2026-04-27 08:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08640767-4910-5498-926e-158541284fda, identifier: NJ73279
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488647d0>
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_79cb14a989ad83762696d9f7e3ab4823.jpg saved to cache
2026-04-27 08:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279
2026-04-27 08:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279
2026-04-27 08:08:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08640767-4910-5498-926e-158541284fda with identifier: NJ73279 to the API
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_2476a3748432f26b3e1e5568af3c91b8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'city': 'Madrid',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 116,
'expiration_date': '2026-04-27T15:48:20Z',
'fuel_type': 'petrol',
'id': '08640767-4910-5498-926e-158541284fda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ73279',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 49606,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_d5b77ab2082b76d1311d1794f45363be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_5e6270c868c1b712ef06878f90cc765b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_8042ddac1cb7b364fddbfdce4f513d23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_eb93823c36d649f70385ea1c2ea2e3a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_e67d7ea38b3ec608f2c1b65af2e9adf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_f3860a203fe6952e7bc413b3c2f17e07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_7dffdf14aafec3bd19555b526c2cde33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_96c24540c11a7036dcd87784813f7712.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_16d32c18f21da3fbfa21ca2ff832f6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_08640767-4910-5498-926e-158541284fda/08640767-4910-5498-926e-158541284fda_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/6b/cf6b333b7a7b253cd093a27726ed1aa4/pa/NJ73279_2476a3748432f26b3e1e5568af3c91b8.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2018-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 30 TFSI Advanced',
'transmission': 'manual',
'trim': 'Advanced',
'year': 2018}
2026-04-27 08:08:13 [auto1.es] INFO: Saving data for NJ73279: {'created_time': 1777277293.295129, 'last_price_update_time': 1777277293.29514, 'has_photos': True, 'auction_closing_time': 1777304900.0}
2026-04-27 08:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b5f198ba58a8603e0d86accca3b8efb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048658090>
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b5f198ba58a8603e0d86accca3b8efb8.jpg saved to cache
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4040978-c8c4-5e6a-ba6e-91004755f9a9
2026-04-27 08:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4040978-c8c4-5e6a-ba6e-91004755f9a9, skipping ID generation
2026-04-27 08:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4040978-c8c4-5e6a-ba6e-91004755f9a9 with scrape type 1
2026-04-27 08:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4040978-c8c4-5e6a-ba6e-91004755f9a9 sending to next pipeline
2026-04-27 08:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4040978-c8c4-5e6a-ba6e-91004755f9a9, identifier: NW52091
2026-04-27 08:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4040978-c8c4-5e6a-ba6e-91004755f9a9 with identifier: NW52091
2026-04-27 08:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4040978-c8c4-5e6a-ba6e-91004755f9a9 with identifier: NW52091
2026-04-27 08:08:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4040978-c8c4-5e6a-ba6e-91004755f9a9 with identifier: NW52091 to the API
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b5f198ba58a8603e0d86accca3b8efb8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'city': 'Pamplona',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 313,
'expiration_date': '2026-04-27T15:22:18Z',
'fuel_type': 'diesel',
'id': 'e4040978-c8c4-5e6a-ba6e-91004755f9a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW52091',
'listing': 'auction',
'location': 'ES, Pamplona',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X5',
'odometer': 282226,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 760877,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b5f198ba58a8603e0d86accca3b8efb8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_79cb14a989ad83762696d9f7e3ab4823.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_7109de2ed913116574bf592cc58e1e6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_330e3a4c941bd9cd26aff96e811793f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623299,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_3bd9cea4d03f5eb6f6937dbc778d73dc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637614,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_53c587bdf2cef13118e11e33275fc844.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_b858e65d08de9ab055794e5e64967c37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641115,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_d3cd031aace62dca959e23c7316bff6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623509,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_9723b7d06024a4696066a6268c7bb6b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4040978-c8c4-5e6a-ba6e-91004755f9a9/e4040978-c8c4-5e6a-ba6e-91004755f9a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/54/f35486f9548ea6c1cc00a761dd6efd10/pa/NW52091_311899aab6eef8391860a6b66a077158.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 08:08:13 [auto1.es] INFO: Saving data for NW52091: {'created_time': 1777277293.952143, 'last_price_update_time': 1777277293.952155, 'has_photos': True, 'auction_closing_time': 1777303338.0}
2026-04-27 08:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV03945> (referer: https://www.auto1.com/v1/car-details-view/FV03945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1b5bbf-56a5-5c48-aad1-2df8091a612b with identifier: FV03945
2026-04-27 08:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b with scrape type 1
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_a147ee56a7705946da6ac893f8f6495c.jpg not downloaded yet
2026-04-27 08:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_7d95fc173410f3c88c2ceb721cb04498.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_314998ada23ea08427e246f3f0e10dfb.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_79cbcc2a1a46d9d5051aef9548f4a8e3.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_f678aabe669f3a1c6b478a232dd38ed8.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_5de44d8eac7f6171f19816139d215f60.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_9127e9e971ac719a30a4d56c3264e2a9.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_6faae4411ce49f7eb69382dbb95443e9.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_01c45901347870606b06964de9ac6ccd.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_ade2c489b81bf8738c832a085c196afc.jpg not downloaded yet
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR58121> (referer: https://www.auto1.com/v1/car-details-view/DR58121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_ade2c489b81bf8738c832a085c196afc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23597a4-1315-59bd-8fa0-786df5a01581 with identifier: DR58121
2026-04-27 08:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23597a4-1315-59bd-8fa0-786df5a01581 with scrape type 1
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_7706f53cec70764aa999d0bf92a17ee0.jpg not downloaded yet
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_957c829b4fe6f8280912cacd7efe0f4c.jpg not downloaded yet
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_150c4ac062782195d9b6bc69d80c897a.jpg not downloaded yet
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_90e09eb9eb7082bb5e950ed92e23f0c0.jpg not downloaded yet
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_1a0947495f3e409e4c202b408b71997b.jpg not downloaded yet
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048654550>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_ade2c489b81bf8738c832a085c196afc.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_2566c41be1f5ce1f86edefabcfd1f494.jpg not downloaded yet
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_01c45901347870606b06964de9ac6ccd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6950>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_01c45901347870606b06964de9ac6ccd.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_2566c41be1f5ce1f86edefabcfd1f494.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048982ed0>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_2566c41be1f5ce1f86edefabcfd1f494.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_1a0947495f3e409e4c202b408b71997b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a7ad0>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_1a0947495f3e409e4c202b408b71997b.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_90e09eb9eb7082bb5e950ed92e23f0c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481dac50>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_90e09eb9eb7082bb5e950ed92e23f0c0.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_150c4ac062782195d9b6bc69d80c897a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049713ed0>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_150c4ac062782195d9b6bc69d80c897a.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_957c829b4fe6f8280912cacd7efe0f4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823c610>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_957c829b4fe6f8280912cacd7efe0f4c.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_7706f53cec70764aa999d0bf92a17ee0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894cc90>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_7706f53cec70764aa999d0bf92a17ee0.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f23597a4-1315-59bd-8fa0-786df5a01581
2026-04-27 08:08:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f23597a4-1315-59bd-8fa0-786df5a01581, skipping ID generation
2026-04-27 08:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23597a4-1315-59bd-8fa0-786df5a01581 with scrape type 1
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f23597a4-1315-59bd-8fa0-786df5a01581 sending to next pipeline
2026-04-27 08:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f23597a4-1315-59bd-8fa0-786df5a01581, identifier: DR58121
2026-04-27 08:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f23597a4-1315-59bd-8fa0-786df5a01581 with identifier: DR58121
2026-04-27 08:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f23597a4-1315-59bd-8fa0-786df5a01581 with identifier: DR58121
2026-04-27 08:08:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f23597a4-1315-59bd-8fa0-786df5a01581 with identifier: DR58121 to the API
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_7706f53cec70764aa999d0bf92a17ee0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'city': 'Araia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:19:30Z',
'fuel_type': 'petrol',
'id': 'f23597a4-1315-59bd-8fa0-786df5a01581',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR58121',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 181822,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_7706f53cec70764aa999d0bf92a17ee0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_957c829b4fe6f8280912cacd7efe0f4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_150c4ac062782195d9b6bc69d80c897a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_90e09eb9eb7082bb5e950ed92e23f0c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_1a0947495f3e409e4c202b408b71997b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23597a4-1315-59bd-8fa0-786df5a01581/f23597a4-1315-59bd-8fa0-786df5a01581_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/97/f097e916dec562859c5936d254b65d2a/pa/DR58121_2566c41be1f5ce1f86edefabcfd1f494.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2015-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-04-27 08:08:18 [auto1.es] INFO: Saving data for DR58121: {'created_time': 1777277298.200843, 'last_price_update_time': 1777277298.200855, 'has_photos': True, 'auction_closing_time': 1777303170.0}
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_6faae4411ce49f7eb69382dbb95443e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ82632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS90788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486583d0>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_6faae4411ce49f7eb69382dbb95443e9.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_f678aabe669f3a1c6b478a232dd38ed8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_9127e9e971ac719a30a4d56c3264e2a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_79cbcc2a1a46d9d5051aef9548f4a8e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a2dd0>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_f678aabe669f3a1c6b478a232dd38ed8.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_5de44d8eac7f6171f19816139d215f60.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_314998ada23ea08427e246f3f0e10dfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834eb90>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_9127e9e971ac719a30a4d56c3264e2a9.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a2510>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_79cbcc2a1a46d9d5051aef9548f4a8e3.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894c5d0>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_5de44d8eac7f6171f19816139d215f60.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048659690>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_314998ada23ea08427e246f3f0e10dfb.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_7d95fc173410f3c88c2ceb721cb04498.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872f010>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_7d95fc173410f3c88c2ceb721cb04498.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_a147ee56a7705946da6ac893f8f6495c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_3c13f1562748a852b7934c548d1f7b87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980050>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_a147ee56a7705946da6ac893f8f6495c.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b
2026-04-27 08:08:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d1b5bbf-56a5-5c48-aad1-2df8091a612b, skipping ID generation
2026-04-27 08:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b with scrape type 1
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d1b5bbf-56a5-5c48-aad1-2df8091a612b sending to next pipeline
2026-04-27 08:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d1b5bbf-56a5-5c48-aad1-2df8091a612b, identifier: FV03945
2026-04-27 08:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d1b5bbf-56a5-5c48-aad1-2df8091a612b with identifier: FV03945
2026-04-27 08:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d1b5bbf-56a5-5c48-aad1-2df8091a612b with identifier: FV03945
2026-04-27 08:08:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d1b5bbf-56a5-5c48-aad1-2df8091a612b with identifier: FV03945 to the API
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_a147ee56a7705946da6ac893f8f6495c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Leganes',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 215,
'expiration_date': '2026-04-27T15:59:07Z',
'fuel_type': 'hybrid',
'id': '9d1b5bbf-56a5-5c48-aad1-2df8091a612b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.3272,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV03945',
'listing': 'auction',
'location': 'ES, Leganés',
'location_confidence': 'geocoded',
'longitude': -3.7635,
'make': 'Kia',
'model': 'Sportage',
'odometer': 53654,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589474,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_a147ee56a7705946da6ac893f8f6495c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_7d95fc173410f3c88c2ceb721cb04498.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464053,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_314998ada23ea08427e246f3f0e10dfb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_79cbcc2a1a46d9d5051aef9548f4a8e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432679,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_f678aabe669f3a1c6b478a232dd38ed8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_5de44d8eac7f6171f19816139d215f60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_9127e9e971ac719a30a4d56c3264e2a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_6faae4411ce49f7eb69382dbb95443e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_01c45901347870606b06964de9ac6ccd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d1b5bbf-56a5-5c48-aad1-2df8091a612b/9d1b5bbf-56a5-5c48-aad1-2df8091a612b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/a8/01a8985a68f85fa6d9edb0d4a44b186a/pa/FV03945_ade2c489b81bf8738c832a085c196afc.jpg',
'Width': 800}],
'postal_code': '28910',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2024-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI Hybrid Drive',
'transmission': 'automatic',
'trim': 'Drive',
'year': 2024}
2026-04-27 08:08:19 [auto1.es] INFO: Saving data for FV03945: {'created_time': 1777277299.555719, 'last_price_update_time': 1777277299.555735, 'has_photos': True, 'auction_closing_time': 1777305547.0}
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_dab2579982fa08b94fe41ae3b9f91d19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF48856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA34637> (referer: https://www.auto1.com/v1/car-details-view/FA34637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488271d0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_3c13f1562748a852b7934c548d1f7b87.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_98555c9704d42cd07871372450e0d891.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a73d0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_dab2579982fa08b94fe41ae3b9f91d19.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_23d6fc22b4844640a27ee6236e5ce617.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_711c53001c0d849edeff522fc485f615.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK11876> (referer: https://www.auto1.com/v1/car-details-view/YK11876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be08efc7-7da8-5d9e-8a0b-f452cb7b494a with identifier: FA34637
2026-04-27 08:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a with scrape type 1
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3cbcb912b7921cd894bc01c2b5e17bca.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3ecfb8993b1edec8bca1f1a1800c3966.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_d4fd91e43471d2d8401b5f19c4fb9114.jpg not downloaded yet
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851b90>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_98555c9704d42cd07871372450e0d891.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_5a138b68f0036d6a6a53337ae12c08d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_e1b4cba216219ae08579507ce7502704.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_78d2b3dba80874f8c5ed128fc58861a7.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8b53d0887563928585c65f1be3f68381.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_9aa16bf1d81792f46e5b143b03604e3b.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048867890>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_23d6fc22b4844640a27ee6236e5ce617.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048210350>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_711c53001c0d849edeff522fc485f615.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063c371e-1814-5418-ad96-6d12efd3e85b with identifier: YK11876
2026-04-27 08:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063c371e-1814-5418-ad96-6d12efd3e85b with scrape type 1
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_c0555a326f8818e1dfa1f91c13206360.jpg not downloaded yet
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_d4fd91e43471d2d8401b5f19c4fb9114.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3ecfb8993b1edec8bca1f1a1800c3966.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8232ff261dacfdf471672f7088c8c3a6.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_682555538ca39ee8ea5fd8029ef87314.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048237510>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_5a138b68f0036d6a6a53337ae12c08d1.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c0ed0>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_e1b4cba216219ae08579507ce7502704.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_a5f5077bae822cf2eb444afd0cea9bc4.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1e5e8c18de070ea2c4bff266bf0bf699.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_f2d77e09c64d6b3255291b74fb43a1c4.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1b75c67803d9cfff1e4df4b42aeb2fa2.jpg not downloaded yet
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ37047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048698f90>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_d4fd91e43471d2d8401b5f19c4fb9114.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891e510>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3ecfb8993b1edec8bca1f1a1800c3966.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_1d24ce9eda149394df87836e1a9383e6.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_d1900d9aef336d51b431effcb98e34d3.jpg not downloaded yet
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_c0555a326f8818e1dfa1f91c13206360.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_9aa16bf1d81792f46e5b143b03604e3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT15109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_cdc99e732f908bcbb1b842a78ccf8179.jpg not downloaded yet
2026-04-27 08:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_6c874946c154be4b2f9b3b4525621cfb.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e10eb31efe201aa0a5c253c380cc7d6b.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e56ad030c34e58daeb3eb3cfb659152c.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_df39d50e3357f3bc2115b420da3f51cb.jpg not downloaded yet
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_f2d77e09c64d6b3255291b74fb43a1c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c6d50>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_c0555a326f8818e1dfa1f91c13206360.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896c50>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_9aa16bf1d81792f46e5b143b03604e3b.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1b75c67803d9cfff1e4df4b42aeb2fa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA92923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048213d90>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_f2d77e09c64d6b3255291b74fb43a1c4.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_d1900d9aef336d51b431effcb98e34d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_df39d50e3357f3bc2115b420da3f51cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e10eb31efe201aa0a5c253c380cc7d6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1e5e8c18de070ea2c4bff266bf0bf699.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3250>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1b75c67803d9cfff1e4df4b42aeb2fa2.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891c850>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_d1900d9aef336d51b431effcb98e34d3.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e56ad030c34e58daeb3eb3cfb659152c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_6c874946c154be4b2f9b3b4525621cfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896550>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_df39d50e3357f3bc2115b420da3f51cb.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048843bd0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e10eb31efe201aa0a5c253c380cc7d6b.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896550>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1e5e8c18de070ea2c4bff266bf0bf699.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048890a50>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e56ad030c34e58daeb3eb3cfb659152c.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048663a90>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_6c874946c154be4b2f9b3b4525621cfb.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_cdc99e732f908bcbb1b842a78ccf8179.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_a5f5077bae822cf2eb444afd0cea9bc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_1d24ce9eda149394df87836e1a9383e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876e8d0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_cdc99e732f908bcbb1b842a78ccf8179.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048160dd0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_a5f5077bae822cf2eb444afd0cea9bc4.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893410>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_1d24ce9eda149394df87836e1a9383e6.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8232ff261dacfdf471672f7088c8c3a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_682555538ca39ee8ea5fd8029ef87314.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fddd0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8232ff261dacfdf471672f7088c8c3a6.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488915d0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_682555538ca39ee8ea5fd8029ef87314.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 063c371e-1814-5418-ad96-6d12efd3e85b
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 063c371e-1814-5418-ad96-6d12efd3e85b, skipping ID generation
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063c371e-1814-5418-ad96-6d12efd3e85b with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 063c371e-1814-5418-ad96-6d12efd3e85b sending to next pipeline
2026-04-27 08:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 063c371e-1814-5418-ad96-6d12efd3e85b, identifier: YK11876
2026-04-27 08:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 063c371e-1814-5418-ad96-6d12efd3e85b with identifier: YK11876
2026-04-27 08:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 063c371e-1814-5418-ad96-6d12efd3e85b with identifier: YK11876
2026-04-27 08:08:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 063c371e-1814-5418-ad96-6d12efd3e85b with identifier: YK11876 to the API
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_682555538ca39ee8ea5fd8029ef87314.jpg>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'city': 'Sevilla',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:30:49Z',
'fuel_type': 'diesel',
'id': '063c371e-1814-5418-ad96-6d12efd3e85b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK11876',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Fiat',
'model': 'Freemont',
'odometer': 180266,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_c0555a326f8818e1dfa1f91c13206360.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_682555538ca39ee8ea5fd8029ef87314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1e5e8c18de070ea2c4bff266bf0bf699.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_1b75c67803d9cfff1e4df4b42aeb2fa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_d1900d9aef336d51b431effcb98e34d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_cdc99e732f908bcbb1b842a78ccf8179.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_6c874946c154be4b2f9b3b4525621cfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e10eb31efe201aa0a5c253c380cc7d6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_e56ad030c34e58daeb3eb3cfb659152c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_063c371e-1814-5418-ad96-6d12efd3e85b/063c371e-1814-5418-ad96-6d12efd3e85b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/27/5b2763925dddf984f9d1c0ec3003fcf0/pa/YK11876_df39d50e3357f3bc2115b420da3f51cb.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2012-09-12',
'seats_number': 7,
'seller_name': None,
'title': 'Fiat Freemont 2.0 Multijet Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2012}
2026-04-27 08:08:22 [auto1.es] INFO: Saving data for YK11876: {'created_time': 1777277302.412865, 'last_price_update_time': 1777277302.412874, 'has_photos': True, 'auction_closing_time': 1777303849.0}
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8b53d0887563928585c65f1be3f68381.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_78d2b3dba80874f8c5ed128fc58861a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK45669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3cbcb912b7921cd894bc01c2b5e17bca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_87c3d50abd31c319c2586136776cc169.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6050>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8b53d0887563928585c65f1be3f68381.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048234dd0>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_78d2b3dba80874f8c5ed128fc58861a7.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_2500716f82bad01cb81b585cd32c4029.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2037 | hits on page: 40
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209ed0>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3cbcb912b7921cd894bc01c2b5e17bca.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a
2026-04-27 08:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be08efc7-7da8-5d9e-8a0b-f452cb7b494a, skipping ID generation
2026-04-27 08:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a with scrape type 1
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be08efc7-7da8-5d9e-8a0b-f452cb7b494a sending to next pipeline
2026-04-27 08:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be08efc7-7da8-5d9e-8a0b-f452cb7b494a, identifier: FA34637
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e9a50>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_87c3d50abd31c319c2586136776cc169.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be08efc7-7da8-5d9e-8a0b-f452cb7b494a with identifier: FA34637
2026-04-27 08:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be08efc7-7da8-5d9e-8a0b-f452cb7b494a with identifier: FA34637
2026-04-27 08:08:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be08efc7-7da8-5d9e-8a0b-f452cb7b494a with identifier: FA34637 to the API
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3cbcb912b7921cd894bc01c2b5e17bca.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-04-27T15:10:01Z',
'fuel_type': 'diesel',
'id': 'be08efc7-7da8-5d9e-8a0b-f452cb7b494a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA34637',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'BMW',
'model': 'X5',
'odometer': 240839,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3cbcb912b7921cd894bc01c2b5e17bca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_3ecfb8993b1edec8bca1f1a1800c3966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_d4fd91e43471d2d8401b5f19c4fb9114.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_78d2b3dba80874f8c5ed128fc58861a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8b53d0887563928585c65f1be3f68381.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_9aa16bf1d81792f46e5b143b03604e3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_8232ff261dacfdf471672f7088c8c3a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_a5f5077bae822cf2eb444afd0cea9bc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_f2d77e09c64d6b3255291b74fb43a1c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be08efc7-7da8-5d9e-8a0b-f452cb7b494a/be08efc7-7da8-5d9e-8a0b-f452cb7b494a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/0c/960c50172c47eddf525072ed7843af45/pa/FA34637_1d24ce9eda149394df87836e1a9383e6.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2010-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-04-27 08:08:23 [auto1.es] INFO: Saving data for FA34637: {'created_time': 1777277303.136962, 'last_price_update_time': 1777277303.136971, 'has_photos': True, 'auction_closing_time': 1777302601.0}
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: EG01111
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for EG01111: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: NR68963
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for NR68963: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: MM99362
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for MM99362: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: FA34637
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for FA34637: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: NW38370
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for NW38370: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: CD83035
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for CD83035: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: VM06943
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for VM06943: 0
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: CX01476
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for CX01476: 2
2026-04-27 08:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 308d7faf-9871-5e0e-ab9c-bdac9bdee134 with identifier: CX01476
2026-04-27 08:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308d7faf-9871-5e0e-ab9c-bdac9bdee134 with scrape type 2
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 308d7faf-9871-5e0e-ab9c-bdac9bdee134 with scrape type 2
2026-04-27 08:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 308d7faf-9871-5e0e-ab9c-bdac9bdee134, identifier: CX01476
2026-04-27 08:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 308d7faf-9871-5e0e-ab9c-bdac9bdee134 with identifier: CX01476
2026-04-27 08:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 308d7faf-9871-5e0e-ab9c-bdac9bdee134 with identifier: CX01476
2026-04-27 08:08:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 308d7faf-9871-5e0e-ab9c-bdac9bdee134 with identifier: CX01476 to the API
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-04-27T15:50:51Z',
'fuel_type': 'diesel',
'id': '308d7faf-9871-5e0e-ab9c-bdac9bdee134',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX01476',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Sorento',
'odometer': 334255,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-09-29',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Spirit 4WD',
'transmission': 'automatic',
'trim': 'Spirit 4WD',
'year': 2014}
2026-04-27 08:08:23 [auto1.es] INFO: Saving data for CX01476: {'auction_closing_time': 1777305051.0, 'created_time': 1777018201.637264, 'has_photos': True, 'last_price_update_time': 1777277303.741229}
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b4590>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_2500716f82bad01cb81b585cd32c4029.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:08:23 [auto1.es] INFO: Found listing with ID: UA87015
2026-04-27 08:08:23 [auto1.es] INFO: Scrape type for UA87015: 2
2026-04-27 08:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7182c1b-8da4-5c0a-b52e-c2b686fd535e with identifier: UA87015
2026-04-27 08:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7182c1b-8da4-5c0a-b52e-c2b686fd535e with scrape type 2
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7182c1b-8da4-5c0a-b52e-c2b686fd535e with scrape type 2
2026-04-27 08:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7182c1b-8da4-5c0a-b52e-c2b686fd535e, identifier: UA87015
2026-04-27 08:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7182c1b-8da4-5c0a-b52e-c2b686fd535e with identifier: UA87015
2026-04-27 08:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7182c1b-8da4-5c0a-b52e-c2b686fd535e with identifier: UA87015
2026-04-27 08:08:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7182c1b-8da4-5c0a-b52e-c2b686fd535e with identifier: UA87015 to the API
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 173,
'expiration_date': '2026-04-27T15:21:00Z',
'fuel_type': 'diesel',
'id': 'f7182c1b-8da4-5c0a-b52e-c2b686fd535e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA87015',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Laguna',
'odometer': 306685,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-07-27',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi BOSE Edition',
'transmission': 'automatic',
'trim': 'BOSE Edition',
'year': 2011}
2026-04-27 08:08:24 [auto1.es] INFO: Saving data for UA87015: {'auction_closing_time': 1777303260.0, 'created_time': 1777020943.163081, 'has_photos': True, 'last_price_update_time': 1777277304.285419}
2026-04-27 08:08:24 [auto1.es] INFO: Found listing with ID: ND75442
2026-04-27 08:08:24 [auto1.es] INFO: Scrape type for ND75442: 2
2026-04-27 08:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c89c7707-8f75-5e7c-875b-043d259117cf with identifier: ND75442
2026-04-27 08:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c89c7707-8f75-5e7c-875b-043d259117cf with scrape type 2
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c89c7707-8f75-5e7c-875b-043d259117cf with scrape type 2
2026-04-27 08:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c89c7707-8f75-5e7c-875b-043d259117cf, identifier: ND75442
2026-04-27 08:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c89c7707-8f75-5e7c-875b-043d259117cf with identifier: ND75442
2026-04-27 08:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c89c7707-8f75-5e7c-875b-043d259117cf with identifier: ND75442
2026-04-27 08:08:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c89c7707-8f75-5e7c-875b-043d259117cf with identifier: ND75442 to the API
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-04-27T15:28:59Z',
'fuel_type': 'diesel',
'id': 'c89c7707-8f75-5e7c-875b-043d259117cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND75442',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 226650,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-03-26',
'seller_name': None,
'title': 'Seat Ibiza 1.4 TDI Hit',
'transmission': 'manual',
'trim': 'Hit',
'year': 2007}
2026-04-27 08:08:24 [auto1.es] INFO: Saving data for ND75442: {'auction_closing_time': 1777303739.0, 'created_time': 1777018043.217022, 'has_photos': True, 'last_price_update_time': 1777277304.708944}
2026-04-27 08:08:24 [auto1.es] INFO: Found listing with ID: LL62717
2026-04-27 08:08:24 [auto1.es] INFO: Scrape type for LL62717: 2
2026-04-27 08:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc with identifier: LL62717
2026-04-27 08:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc with scrape type 2
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc with scrape type 2
2026-04-27 08:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc, identifier: LL62717
2026-04-27 08:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc with identifier: LL62717
2026-04-27 08:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc with identifier: LL62717
2026-04-27 08:08:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 653d3c72-9ad2-5b20-b30d-ff6ecf3195dc with identifier: LL62717 to the API
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:18:49Z',
'fuel_type': 'petrol',
'id': '653d3c72-9ad2-5b20-b30d-ff6ecf3195dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL62717',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Captur',
'odometer': 72979,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-04-25',
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2019}
2026-04-27 08:08:25 [auto1.es] INFO: Saving data for LL62717: {'auction_closing_time': 1777303129.0, 'created_time': 1777021057.555833, 'has_photos': True, 'last_price_update_time': 1777277305.126999}
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: TH42219
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for TH42219: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: GG74961
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for GG74961: 2
2026-04-27 08:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961
2026-04-27 08:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb97035-7e4c-53d2-aea6-96638969a30b with scrape type 2
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cb97035-7e4c-53d2-aea6-96638969a30b with scrape type 2
2026-04-27 08:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1cb97035-7e4c-53d2-aea6-96638969a30b, identifier: GG74961
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA33031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961
2026-04-27 08:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961
2026-04-27 08:08:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961 to the API
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:44:59Z',
'fuel_type': 'diesel',
'id': '1cb97035-7e4c-53d2-aea6-96638969a30b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG74961',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 91575,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-10-24',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Advance BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Advance BlueMotion Tech',
'year': 2017}
2026-04-27 08:08:25 [auto1.es] INFO: Saving data for GG74961: {'auction_closing_time': 1777304699.0, 'created_time': 1777018193.836445, 'has_photos': True, 'last_price_update_time': 1777277305.574798}
2026-04-27 08:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: KD92229
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for KD92229: 1
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS90788> (referer: https://www.auto1.com/v1/car-details-view/SS90788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: EX26645
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for EX26645: 1
2026-04-27 08:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: WX79689
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for WX79689: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: AT69557
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for AT69557: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: WU29040
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for WU29040: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: VF55417
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for VF55417: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: XY25635
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for XY25635: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: EH04096
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for EH04096: 1
2026-04-27 08:08:25 [auto1.es] INFO: Found listing with ID: TX56976
2026-04-27 08:08:25 [auto1.es] INFO: Scrape type for TX56976: 2
2026-04-27 08:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364e6adb-e911-5bea-a2bf-188974fe38c6 with identifier: TX56976
2026-04-27 08:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364e6adb-e911-5bea-a2bf-188974fe38c6 with scrape type 2
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364e6adb-e911-5bea-a2bf-188974fe38c6 with scrape type 2
2026-04-27 08:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 364e6adb-e911-5bea-a2bf-188974fe38c6, identifier: TX56976
2026-04-27 08:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 364e6adb-e911-5bea-a2bf-188974fe38c6 with identifier: TX56976
2026-04-27 08:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 364e6adb-e911-5bea-a2bf-188974fe38c6 with identifier: TX56976
2026-04-27 08:08:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 364e6adb-e911-5bea-a2bf-188974fe38c6 with identifier: TX56976 to the API
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-04-27T15:46:05Z',
'fuel_type': 'diesel',
'id': '364e6adb-e911-5bea-a2bf-188974fe38c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX56976',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 103306,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-10-12',
'seller_name': None,
'title': 'Jaguar F-Pace 25d R-Sport AWD',
'transmission': 'automatic',
'trim': 'R-Sport AWD',
'year': 2017}
2026-04-27 08:08:26 [auto1.es] INFO: Saving data for TX56976: {'auction_closing_time': 1777304765.0, 'created_time': 1777020844.446674, 'has_photos': True, 'last_price_update_time': 1777277306.104905}
2026-04-27 08:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84dbee4c-021a-5dce-935d-aa1cbf948647 with identifier: SS90788
2026-04-27 08:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84dbee4c-021a-5dce-935d-aa1cbf948647 with scrape type 1
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2e8911b497499960cdf3d5288ff1d34c.jpg not downloaded yet
2026-04-27 08:08:26 [auto1.es] INFO: Found listing with ID: MM77073
2026-04-27 08:08:26 [auto1.es] INFO: Scrape type for MM77073: 2
2026-04-27 08:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073
2026-04-27 08:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with scrape type 2
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with scrape type 2
2026-04-27 08:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7900c92-8e92-52d2-ac56-8fcc778ef6a4, identifier: MM77073
2026-04-27 08:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073
2026-04-27 08:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073
2026-04-27 08:08:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7900c92-8e92-52d2-ac56-8fcc778ef6a4 with identifier: MM77073 to the API
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:52:53Z',
'fuel_type': 'diesel',
'id': 'c7900c92-8e92-52d2-ac56-8fcc778ef6a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM77073',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': '500L',
'odometer': 115434,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2015}
2026-04-27 08:08:26 [auto1.es] INFO: Saving data for MM77073: {'auction_closing_time': 1777305173.0, 'created_time': 1777018063.092946, 'has_photos': True, 'last_price_update_time': 1777277306.611059}
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_801cf9a3fd533901e3774420d70a8446.jpg not downloaded yet
2026-04-27 08:08:26 [auto1.es] INFO: Found listing with ID: KP82638
2026-04-27 08:08:26 [auto1.es] INFO: Scrape type for KP82638: 1
2026-04-27 08:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC74373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_6d8c03c8b7eb43633445f037bfa7b061.jpg not downloaded yet
2026-04-27 08:08:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:26 [auto1.es] INFO: Found listing with ID: AB02907
2026-04-27 08:08:26 [auto1.es] INFO: Scrape type for AB02907: 2
2026-04-27 08:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4deb5c46-b759-5159-b81e-5e98fdd68ee4 with identifier: AB02907
2026-04-27 08:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4deb5c46-b759-5159-b81e-5e98fdd68ee4 with scrape type 2
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4deb5c46-b759-5159-b81e-5e98fdd68ee4 with scrape type 2
2026-04-27 08:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4deb5c46-b759-5159-b81e-5e98fdd68ee4, identifier: AB02907
2026-04-27 08:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4deb5c46-b759-5159-b81e-5e98fdd68ee4 with identifier: AB02907
2026-04-27 08:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4deb5c46-b759-5159-b81e-5e98fdd68ee4 with identifier: AB02907
2026-04-27 08:08:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4deb5c46-b759-5159-b81e-5e98fdd68ee4 with identifier: AB02907 to the API
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-04-27T15:40:13Z',
'fuel_type': 'diesel',
'id': '4deb5c46-b759-5159-b81e-5e98fdd68ee4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB02907',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 203089,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'Dacia Lodgy 1.5 Blue dCi SL Xplore',
'transmission': 'manual',
'trim': 'SL Xplore',
'year': 2020}
2026-04-27 08:08:27 [auto1.es] INFO: Saving data for AB02907: {'auction_closing_time': 1777304413.0, 'created_time': 1777020873.49891, 'has_photos': True, 'last_price_update_time': 1777277307.083081}
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2c49c16a12c9df669f4c34e674b5e128.jpg not downloaded yet
2026-04-27 08:08:27 [auto1.es] INFO: Found listing with ID: EE09579
2026-04-27 08:08:27 [auto1.es] INFO: Scrape type for EE09579: 2
2026-04-27 08:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579
2026-04-27 08:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with scrape type 2
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with scrape type 2
2026-04-27 08:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9de03b25-9840-53e0-bd39-2a16bd6f13f5, identifier: EE09579
2026-04-27 08:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579
2026-04-27 08:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579
2026-04-27 08:08:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579 to the API
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:33:35Z',
'fuel_type': 'diesel',
'id': '9de03b25-9840-53e0-bd39-2a16bd6f13f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE09579',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jaguar',
'model': 'XF',
'odometer': 172857,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-10-08',
'seller_name': None,
'title': 'Jaguar XF 2.2 D',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-04-27 08:08:27 [auto1.es] INFO: Saving data for EE09579: {'auction_closing_time': 1777304015.0, 'created_time': 1777021880.642655, 'has_photos': True, 'last_price_update_time': 1777277307.496353}
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_e8403d50c636329ddb031273a279e4c6.jpg not downloaded yet
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_801cf9a3fd533901e3774420d70a8446.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:27 [auto1.es] INFO: Found listing with ID: AT20660
2026-04-27 08:08:27 [auto1.es] INFO: Scrape type for AT20660: 1
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9abfad238ef8479dc3ea3749c389d9f4.jpg not downloaded yet
2026-04-27 08:08:27 [auto1.es] INFO: Found listing with ID: ES22233
2026-04-27 08:08:27 [auto1.es] INFO: Scrape type for ES22233: 2
2026-04-27 08:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8672ac8-dd24-576d-bdae-38e285d5ed40 with identifier: ES22233
2026-04-27 08:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8672ac8-dd24-576d-bdae-38e285d5ed40 with scrape type 2
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8672ac8-dd24-576d-bdae-38e285d5ed40 with scrape type 2
2026-04-27 08:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f8672ac8-dd24-576d-bdae-38e285d5ed40, identifier: ES22233
2026-04-27 08:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f8672ac8-dd24-576d-bdae-38e285d5ed40 with identifier: ES22233
2026-04-27 08:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f8672ac8-dd24-576d-bdae-38e285d5ed40 with identifier: ES22233
2026-04-27 08:08:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f8672ac8-dd24-576d-bdae-38e285d5ed40 with identifier: ES22233 to the API
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:22:02Z',
'fuel_type': 'petrol',
'id': 'f8672ac8-dd24-576d-bdae-38e285d5ed40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES22233',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 238827,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-10-06',
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-04-27 08:08:27 [auto1.es] INFO: Saving data for ES22233: {'auction_closing_time': 1777303322.0, 'created_time': 1776940958.599465, 'has_photos': True, 'last_price_update_time': 1777277307.95455}
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_0172f0863f0b91355e6fb31cc82cf55d.jpg not downloaded yet
2026-04-27 08:08:27 [auto1.es] INFO: Found listing with ID: FB97743
2026-04-27 08:08:28 [auto1.es] INFO: Scrape type for FB97743: 1
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2c49c16a12c9df669f4c34e674b5e128.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9bf952cdb379062ef9b16069c2d42310.jpg not downloaded yet
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fff10>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_801cf9a3fd533901e3774420d70a8446.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:28 [auto1.es] INFO: Found listing with ID: NL75156
2026-04-27 08:08:28 [auto1.es] INFO: Scrape type for NL75156: 1
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_20854b403e3d48b1ecb48b691552d7d6.jpg not downloaded yet
2026-04-27 08:08:28 [auto1.es] INFO: Found listing with ID: PL04403
2026-04-27 08:08:28 [auto1.es] INFO: Scrape type for PL04403: 2
2026-04-27 08:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3 with identifier: PL04403
2026-04-27 08:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3 with scrape type 2
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3 with scrape type 2
2026-04-27 08:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3, identifier: PL04403
2026-04-27 08:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3 with identifier: PL04403
2026-04-27 08:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3 with identifier: PL04403
2026-04-27 08:08:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 66327f5d-bf4c-5b16-ab52-c26dbf7d3db3 with identifier: PL04403 to the API
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:58:06Z',
'fuel_type': 'diesel',
'id': '66327f5d-bf4c-5b16-ab52-c26dbf7d3db3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL04403',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 84327,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-10-20',
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2021}
2026-04-27 08:08:28 [auto1.es] INFO: Saving data for PL04403: {'auction_closing_time': 1777305486.0, 'created_time': 1777018150.982515, 'has_photos': True, 'last_price_update_time': 1777277308.548373}
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_314d3b1f33e26fa6e28d923b403e9ec1.jpg not downloaded yet
2026-04-27 08:08:28 [auto1.es] INFO: Found listing with ID: NJ98715
2026-04-27 08:08:28 [auto1.es] INFO: Scrape type for NJ98715: 2
2026-04-27 08:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb384a15-772e-51b8-9964-b9a4addd770a with identifier: NJ98715
2026-04-27 08:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb384a15-772e-51b8-9964-b9a4addd770a with scrape type 2
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb384a15-772e-51b8-9964-b9a4addd770a with scrape type 2
2026-04-27 08:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb384a15-772e-51b8-9964-b9a4addd770a, identifier: NJ98715
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_0172f0863f0b91355e6fb31cc82cf55d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb384a15-772e-51b8-9964-b9a4addd770a with identifier: NJ98715
2026-04-27 08:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb384a15-772e-51b8-9964-b9a4addd770a with identifier: NJ98715
2026-04-27 08:08:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb384a15-772e-51b8-9964-b9a4addd770a with identifier: NJ98715 to the API
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 210,
'expiration_date': '2026-04-27T15:50:39Z',
'fuel_type': 'petrol',
'id': 'eb384a15-772e-51b8-9964-b9a4addd770a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ98715',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Passat CC',
'odometer': 170174,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-03-09',
'seller_name': None,
'title': 'Volkswagen Passat CC 2.0 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-04-27 08:08:28 [auto1.es] INFO: Saving data for NJ98715: {'auction_closing_time': 1777305039.0, 'created_time': 1777018761.346582, 'has_photos': True, 'last_price_update_time': 1777277308.974543}
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ede50>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2c49c16a12c9df669f4c34e674b5e128.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:29 [auto1.es] INFO: Found listing with ID: HL63729
2026-04-27 08:08:29 [auto1.es] INFO: Scrape type for HL63729: 2
2026-04-27 08:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434eba65-19d8-5039-8413-ad7751cf4e89 with identifier: HL63729
2026-04-27 08:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434eba65-19d8-5039-8413-ad7751cf4e89 with scrape type 2
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434eba65-19d8-5039-8413-ad7751cf4e89 with scrape type 2
2026-04-27 08:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 434eba65-19d8-5039-8413-ad7751cf4e89, identifier: HL63729
2026-04-27 08:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 434eba65-19d8-5039-8413-ad7751cf4e89 with identifier: HL63729
2026-04-27 08:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 434eba65-19d8-5039-8413-ad7751cf4e89 with identifier: HL63729
2026-04-27 08:08:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 434eba65-19d8-5039-8413-ad7751cf4e89 with identifier: HL63729 to the API
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:51:23Z',
'fuel_type': 'diesel',
'id': '434eba65-19d8-5039-8413-ad7751cf4e89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL63729',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 219395,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-03-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Sport BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport BlueMotion Tech',
'year': 2013}
2026-04-27 08:08:29 [auto1.es] INFO: Saving data for HL63729: {'auction_closing_time': 1777305083.0, 'created_time': 1777021823.62994, 'has_photos': True, 'last_price_update_time': 1777277309.422553}
2026-04-27 08:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS87061/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:29 [auto1.es] INFO: Found listing with ID: CS83553
2026-04-27 08:08:29 [auto1.es] INFO: Scrape type for CS83553: 2
2026-04-27 08:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad844a1f-0f16-555e-b52e-19dfcf2e78ec with identifier: CS83553
2026-04-27 08:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad844a1f-0f16-555e-b52e-19dfcf2e78ec with scrape type 2
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad844a1f-0f16-555e-b52e-19dfcf2e78ec with scrape type 2
2026-04-27 08:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad844a1f-0f16-555e-b52e-19dfcf2e78ec, identifier: CS83553
2026-04-27 08:08:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889efd0>
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_0172f0863f0b91355e6fb31cc82cf55d.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad844a1f-0f16-555e-b52e-19dfcf2e78ec with identifier: CS83553
2026-04-27 08:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad844a1f-0f16-555e-b52e-19dfcf2e78ec with identifier: CS83553
2026-04-27 08:08:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad844a1f-0f16-555e-b52e-19dfcf2e78ec with identifier: CS83553 to the API
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:26:10Z',
'fuel_type': 'diesel',
'id': 'ad844a1f-0f16-555e-b52e-19dfcf2e78ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS83553',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '508',
'odometer': 217492,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'Peugeot 508 2.0 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-04-27 08:08:29 [auto1.es] INFO: Saving data for CS83553: {'auction_closing_time': 1777303570.0, 'created_time': 1776940941.46277, 'has_photos': True, 'last_price_update_time': 1777277309.964646}
2026-04-27 08:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_314d3b1f33e26fa6e28d923b403e9ec1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:29 [auto1.es] INFO: Found listing with ID: ZB84973
2026-04-27 08:08:29 [auto1.es] INFO: Scrape type for ZB84973: 2
2026-04-27 08:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430ca105-7065-5e81-a7d1-fb214d540f1e with identifier: ZB84973
2026-04-27 08:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430ca105-7065-5e81-a7d1-fb214d540f1e with scrape type 2
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 430ca105-7065-5e81-a7d1-fb214d540f1e with scrape type 2
2026-04-27 08:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 430ca105-7065-5e81-a7d1-fb214d540f1e, identifier: ZB84973
2026-04-27 08:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 430ca105-7065-5e81-a7d1-fb214d540f1e with identifier: ZB84973
2026-04-27 08:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 430ca105-7065-5e81-a7d1-fb214d540f1e with identifier: ZB84973
2026-04-27 08:08:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 430ca105-7065-5e81-a7d1-fb214d540f1e with identifier: ZB84973 to the API
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 151,
'expiration_date': '2026-04-27T15:06:10Z',
'fuel_type': 'petrol',
'id': '430ca105-7065-5e81-a7d1-fb214d540f1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB84973',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': '500X',
'odometer': 68518,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-02-11',
'seller_name': None,
'title': 'Fiat 500X 1.3 Turbo Cross',
'transmission': 'automatic',
'trim': 'Cross',
'year': 2021}
2026-04-27 08:08:30 [auto1.es] INFO: Saving data for ZB84973: {'auction_closing_time': 1777302370.0, 'created_time': 1777018092.149953, 'has_photos': True, 'last_price_update_time': 1777277310.367598}
2026-04-27 08:08:30 [auto1.es] INFO: Found listing with ID: SR20555
2026-04-27 08:08:30 [auto1.es] INFO: Scrape type for SR20555: 2
2026-04-27 08:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c438edb4-3620-5372-9d9a-8b7c4ecf96e7 with identifier: SR20555
2026-04-27 08:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c438edb4-3620-5372-9d9a-8b7c4ecf96e7 with scrape type 2
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c438edb4-3620-5372-9d9a-8b7c4ecf96e7 with scrape type 2
2026-04-27 08:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c438edb4-3620-5372-9d9a-8b7c4ecf96e7, identifier: SR20555
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_20854b403e3d48b1ecb48b691552d7d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c438edb4-3620-5372-9d9a-8b7c4ecf96e7 with identifier: SR20555
2026-04-27 08:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c438edb4-3620-5372-9d9a-8b7c4ecf96e7 with identifier: SR20555
2026-04-27 08:08:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c438edb4-3620-5372-9d9a-8b7c4ecf96e7 with identifier: SR20555 to the API
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 230,
'expiration_date': '2026-04-27T15:04:28Z',
'fuel_type': 'diesel',
'id': 'c438edb4-3620-5372-9d9a-8b7c4ecf96e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR20555',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '5er',
'odometer': 477553,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-02-28',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-04-27 08:08:30 [auto1.es] INFO: Saving data for SR20555: {'auction_closing_time': 1777302268.0, 'created_time': 1777021417.017529, 'has_photos': True, 'last_price_update_time': 1777277310.7454}
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c3d10>
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_314d3b1f33e26fa6e28d923b403e9ec1.jpg saved to cache
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:30 [auto1.es] INFO: Found listing with ID: TW94312
2026-04-27 08:08:30 [auto1.es] INFO: Scrape type for TW94312: 2
2026-04-27 08:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d90f65-a569-52c2-8813-26b32e5be606 with identifier: TW94312
2026-04-27 08:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d90f65-a569-52c2-8813-26b32e5be606 with scrape type 2
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d90f65-a569-52c2-8813-26b32e5be606 with scrape type 2
2026-04-27 08:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0d90f65-a569-52c2-8813-26b32e5be606, identifier: TW94312
2026-04-27 08:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0d90f65-a569-52c2-8813-26b32e5be606 with identifier: TW94312
2026-04-27 08:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0d90f65-a569-52c2-8813-26b32e5be606 with identifier: TW94312
2026-04-27 08:08:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0d90f65-a569-52c2-8813-26b32e5be606 with identifier: TW94312 to the API
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:44:43Z',
'fuel_type': 'petrol',
'id': 'b0d90f65-a569-52c2-8813-26b32e5be606',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW94312',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Corolla Verso',
'odometer': 167957,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-04-25',
'seller_name': None,
'title': 'Toyota Corolla Verso 1.8 Sol',
'transmission': 'automatic',
'trim': 'Sol',
'year': 2002}
2026-04-27 08:08:31 [auto1.es] INFO: Saving data for TW94312: {'auction_closing_time': 1777304683.0, 'created_time': 1777021900.924769, 'has_photos': True, 'last_price_update_time': 1777277311.536128}
2026-04-27 08:08:31 [auto1.es] INFO: Found listing with ID: TF99464
2026-04-27 08:08:31 [auto1.es] INFO: Scrape type for TF99464: 1
2026-04-27 08:08:31 [auto1.es] INFO: Found listing with ID: NP54958
2026-04-27 08:08:31 [auto1.es] INFO: Scrape type for NP54958: 1
2026-04-27 08:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876e010>
2026-04-27 08:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_20854b403e3d48b1ecb48b691552d7d6.jpg saved to cache
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:31 [auto1.es] INFO: Found listing with ID: LN52681
2026-04-27 08:08:31 [auto1.es] INFO: Scrape type for LN52681: 2
2026-04-27 08:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64cc322d-1c62-5001-ba3f-1bbb55376f70 with identifier: LN52681
2026-04-27 08:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64cc322d-1c62-5001-ba3f-1bbb55376f70 with scrape type 2
2026-04-27 08:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64cc322d-1c62-5001-ba3f-1bbb55376f70 with scrape type 2
2026-04-27 08:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 64cc322d-1c62-5001-ba3f-1bbb55376f70, identifier: LN52681
2026-04-27 08:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 64cc322d-1c62-5001-ba3f-1bbb55376f70 with identifier: LN52681
2026-04-27 08:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 64cc322d-1c62-5001-ba3f-1bbb55376f70 with identifier: LN52681
2026-04-27 08:08:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 64cc322d-1c62-5001-ba3f-1bbb55376f70 with identifier: LN52681 to the API
2026-04-27 08:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:50:22Z',
'fuel_type': 'petrol',
'id': '64cc322d-1c62-5001-ba3f-1bbb55376f70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN52681',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Bravo',
'odometer': 182547,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-10-31',
'seller_name': None,
'title': 'Fiat Bravo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2007}
2026-04-27 08:08:32 [auto1.es] INFO: Saving data for LN52681: {'auction_closing_time': 1777305022.0, 'created_time': 1777021594.725025, 'has_photos': True, 'last_price_update_time': 1777277312.153766}
2026-04-27 08:08:33 [scrapy.extensions.logstats] INFO: Crawled 548 pages (at 40 pages/min), scraped 645 items (at 46 items/min)
2026-04-27 08:08:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ37047> (referer: https://www.auto1.com/v1/car-details-view/GZ37047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76ca7ff3-ac34-5574-947e-a174805c2074 with identifier: GZ37047
2026-04-27 08:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ca7ff3-ac34-5574-947e-a174805c2074 with scrape type 1
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_480541f3757c817db48c505f89ee7ad5.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_88c992883fee6e689fbbdf5ffde6280c.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_bc0b10f2cfe5e4bd9b57ffa23bf23129.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_f7f23e32b26d6c1c32a5db1cf309fce6.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_047c1d91331010c775c6152b7e55eb42.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_580226e4581e711146bb5be726da5913.jpg not downloaded yet
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA92923> (referer: https://www.auto1.com/v1/car-details-view/MA92923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_580226e4581e711146bb5be726da5913.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923
2026-04-27 08:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d17e280-80d0-5b0d-932d-9decfff71329 with scrape type 1
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_5777a1de2ebd1942eb86b0ee741aa200.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_4e3be7e46f0890ba197c4d5d34ce5d5c.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_509480b6495d5bf208fadbec04b7240d.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_421e77811e2c16d48f9512e5bcc9ac49.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_ff7101d160f813ddc3c2eab9b3d3e9c2.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_f3aef607d465a05c931603e6b45dce0c.jpg not downloaded yet
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048841fd0>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_580226e4581e711146bb5be726da5913.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_38d9c99b37061309e3326ff9771a6109.jpg not downloaded yet
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_047c1d91331010c775c6152b7e55eb42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_19c14bc0aba747762e2bd8f18a0e1f0b.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_79145507e4122a4b018901a4514beb08.jpg not downloaded yet
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_539a4fd64ed941e49d1d8c43e662ed92.jpg not downloaded yet
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_38d9c99b37061309e3326ff9771a6109.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048982d10>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_047c1d91331010c775c6152b7e55eb42.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048840bd0>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_38d9c99b37061309e3326ff9771a6109.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_539a4fd64ed941e49d1d8c43e662ed92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_79145507e4122a4b018901a4514beb08.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a7590>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_539a4fd64ed941e49d1d8c43e662ed92.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885a210>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_79145507e4122a4b018901a4514beb08.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_19c14bc0aba747762e2bd8f18a0e1f0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824750>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_19c14bc0aba747762e2bd8f18a0e1f0b.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_f3aef607d465a05c931603e6b45dce0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048717850>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_f3aef607d465a05c931603e6b45dce0c.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_ff7101d160f813ddc3c2eab9b3d3e9c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048858dd0>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_ff7101d160f813ddc3c2eab9b3d3e9c2.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_421e77811e2c16d48f9512e5bcc9ac49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884df90>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_421e77811e2c16d48f9512e5bcc9ac49.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_509480b6495d5bf208fadbec04b7240d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_4e3be7e46f0890ba197c4d5d34ce5d5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485927d0>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_509480b6495d5bf208fadbec04b7240d.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_5777a1de2ebd1942eb86b0ee741aa200.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885b090>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_4e3be7e46f0890ba197c4d5d34ce5d5c.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048897ad0>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_5777a1de2ebd1942eb86b0ee741aa200.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d17e280-80d0-5b0d-932d-9decfff71329
2026-04-27 08:08:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d17e280-80d0-5b0d-932d-9decfff71329, skipping ID generation
2026-04-27 08:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d17e280-80d0-5b0d-932d-9decfff71329 with scrape type 1
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d17e280-80d0-5b0d-932d-9decfff71329 sending to next pipeline
2026-04-27 08:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d17e280-80d0-5b0d-932d-9decfff71329, identifier: MA92923
2026-04-27 08:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923
2026-04-27 08:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923
2026-04-27 08:08:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923 to the API
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_5777a1de2ebd1942eb86b0ee741aa200.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'city': 'Granyanella',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:26:54Z',
'fuel_type': 'diesel',
'id': '0d17e280-80d0-5b0d-932d-9decfff71329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA92923',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Peugeot',
'model': '2008',
'odometer': 156268,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_5777a1de2ebd1942eb86b0ee741aa200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_4e3be7e46f0890ba197c4d5d34ce5d5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_509480b6495d5bf208fadbec04b7240d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_421e77811e2c16d48f9512e5bcc9ac49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_ff7101d160f813ddc3c2eab9b3d3e9c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_f3aef607d465a05c931603e6b45dce0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_38d9c99b37061309e3326ff9771a6109.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_19c14bc0aba747762e2bd8f18a0e1f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_79145507e4122a4b018901a4514beb08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d17e280-80d0-5b0d-932d-9decfff71329/0d17e280-80d0-5b0d-932d-9decfff71329_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/2e/142e3357ca5ab9e3b48886133e7f1436/pa/MA92923_539a4fd64ed941e49d1d8c43e662ed92.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-04-27 08:08:39 [auto1.es] INFO: Saving data for MA92923: {'created_time': 1777277319.82867, 'last_price_update_time': 1777277319.828681, 'has_photos': True, 'auction_closing_time': 1777303614.0}
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_f7f23e32b26d6c1c32a5db1cf309fce6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488431d0>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_f7f23e32b26d6c1c32a5db1cf309fce6.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_bc0b10f2cfe5e4bd9b57ffa23bf23129.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_88c992883fee6e689fbbdf5ffde6280c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04971c090>
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_bc0b10f2cfe5e4bd9b57ffa23bf23129.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_480541f3757c817db48c505f89ee7ad5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048783d10>
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_88c992883fee6e689fbbdf5ffde6280c.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048783f90>
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_480541f3757c817db48c505f89ee7ad5.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76ca7ff3-ac34-5574-947e-a174805c2074
2026-04-27 08:08:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76ca7ff3-ac34-5574-947e-a174805c2074, skipping ID generation
2026-04-27 08:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ca7ff3-ac34-5574-947e-a174805c2074 with scrape type 1
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76ca7ff3-ac34-5574-947e-a174805c2074 sending to next pipeline
2026-04-27 08:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76ca7ff3-ac34-5574-947e-a174805c2074, identifier: GZ37047
2026-04-27 08:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76ca7ff3-ac34-5574-947e-a174805c2074 with identifier: GZ37047
2026-04-27 08:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76ca7ff3-ac34-5574-947e-a174805c2074 with identifier: GZ37047
2026-04-27 08:08:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76ca7ff3-ac34-5574-947e-a174805c2074 with identifier: GZ37047 to the API
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_480541f3757c817db48c505f89ee7ad5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Santa Ana',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:12:11Z',
'fuel_type': 'diesel',
'id': '76ca7ff3-ac34-5574-947e-a174805c2074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4616,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ37047',
'listing': 'auction',
'location': 'ES, Santa Ana',
'location_confidence': 'geocoded',
'longitude': -3.8865,
'make': 'Seat',
'model': 'Altea',
'odometer': 263959,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_480541f3757c817db48c505f89ee7ad5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_88c992883fee6e689fbbdf5ffde6280c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_bc0b10f2cfe5e4bd9b57ffa23bf23129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_f7f23e32b26d6c1c32a5db1cf309fce6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_047c1d91331010c775c6152b7e55eb42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76ca7ff3-ac34-5574-947e-a174805c2074/76ca7ff3-ac34-5574-947e-a174805c2074_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a9/5fa9b60bec504f22052214dab57cf493/pa/GZ37047_580226e4581e711146bb5be726da5913.jpg',
'Width': 800}],
'postal_code': '23692',
'price': 0,
'price_includes_vat': True,
'province': 'Jaén',
'province_code': 'ES-J',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2006-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Altea 1.9 TDI Hot',
'transmission': 'manual',
'trim': 'Hot',
'year': 2006}
2026-04-27 08:08:40 [auto1.es] INFO: Saving data for GZ37047: {'created_time': 1777277320.778054, 'last_price_update_time': 1777277320.778065, 'has_photos': True, 'auction_closing_time': 1777302731.0}
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE80473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9bf952cdb379062ef9b16069c2d42310.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a0850>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9bf952cdb379062ef9b16069c2d42310.jpg saved to cache
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC16015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA39577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF48856> (referer: https://www.auto1.com/v1/car-details-view/MF48856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c1fe03e-15ed-5f33-a843-ba34768bdc7d with identifier: MF48856
2026-04-27 08:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d with scrape type 1
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_e76308a7d7d3528c43bfabc04f83b4c1.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b5cd34d0af876c5ce5162e3e6aadf8d8.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_23e5a03c4c22adc007f956d1ddbc9199.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b8fe996f456916918f63d401d4e87533.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_098b7910dbb58abaa4cd3db05f221b0e.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_6200c0f76c82ad4c0fd2c4ff5281759e.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_84e51309feba1cdb7b5fafce7188d9d0.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_5740f269c970e2d1f8964b982c2fb293.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_c516791b3cb749fbc192fad07897f785.jpg not downloaded yet
2026-04-27 08:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_ec7d8f74c85d009fb528844fede84b17.jpg not downloaded yet
2026-04-27 08:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR04430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_ec7d8f74c85d009fb528844fede84b17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c0ad0>
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_ec7d8f74c85d009fb528844fede84b17.jpg saved to cache
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_c516791b3cb749fbc192fad07897f785.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a43ed0>
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_c516791b3cb749fbc192fad07897f785.jpg saved to cache
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD92229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_5740f269c970e2d1f8964b982c2fb293.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ffb90>
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_5740f269c970e2d1f8964b982c2fb293.jpg saved to cache
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH42219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_84e51309feba1cdb7b5fafce7188d9d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff049710810>
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_84e51309feba1cdb7b5fafce7188d9d0.jpg saved to cache
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_6200c0f76c82ad4c0fd2c4ff5281759e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42f90>
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_6200c0f76c82ad4c0fd2c4ff5281759e.jpg saved to cache
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS87061> (referer: https://www.auto1.com/v1/car-details-view/WS87061/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_098b7910dbb58abaa4cd3db05f221b0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e869112-0f08-518d-975c-f468943236f6 with identifier: WS87061
2026-04-27 08:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e869112-0f08-518d-975c-f468943236f6 with scrape type 1
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_14bbc6ed87b9ccb6ed485847709f6926.jpg not downloaded yet
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b8fe996f456916918f63d401d4e87533.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_fd9b763686da14cdf87d5e60357c029e.jpg not downloaded yet
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_ee4741953dcc70205895e690bed012f6.jpg not downloaded yet
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_b510f79c34ba49b11a3c5c1e68cd28a9.jpg not downloaded yet
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e919657135c8b4bf9c18c6726708900f.jpg not downloaded yet
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e3d0>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_098b7910dbb58abaa4cd3db05f221b0e.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_dc66506384962bb4f7041c5a36ec842b.jpg not downloaded yet
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_14bbc6ed87b9ccb6ed485847709f6926.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_621aba3967d43844ea2687af9e90d6e6.jpg not downloaded yet
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_f573cf571ab9f00bd39b156ed7a38d41.jpg not downloaded yet
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e7850>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b8fe996f456916918f63d401d4e87533.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e47660313f160829b5ee169cf33ee788.jpg not downloaded yet
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_42578b9b55d0697c1a124154206abeb9.jpg not downloaded yet
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e919657135c8b4bf9c18c6726708900f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048782510>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_14bbc6ed87b9ccb6ed485847709f6926.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_42578b9b55d0697c1a124154206abeb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048890750>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e919657135c8b4bf9c18c6726708900f.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e47660313f160829b5ee169cf33ee788.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884f3d0>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_42578b9b55d0697c1a124154206abeb9.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e510>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e47660313f160829b5ee169cf33ee788.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_f573cf571ab9f00bd39b156ed7a38d41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU01953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_621aba3967d43844ea2687af9e90d6e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_dc66506384962bb4f7041c5a36ec842b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048827cd0>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_f573cf571ab9f00bd39b156ed7a38d41.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_b510f79c34ba49b11a3c5c1e68cd28a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_ee4741953dcc70205895e690bed012f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0650>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_621aba3967d43844ea2687af9e90d6e6.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_23e5a03c4c22adc007f956d1ddbc9199.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048590690>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_dc66506384962bb4f7041c5a36ec842b.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_fd9b763686da14cdf87d5e60357c029e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cbc50>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_b510f79c34ba49b11a3c5c1e68cd28a9.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b5cd34d0af876c5ce5162e3e6aadf8d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884db10>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_ee4741953dcc70205895e690bed012f6.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_e76308a7d7d3528c43bfabc04f83b4c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487801d0>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_23e5a03c4c22adc007f956d1ddbc9199.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057224350>
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_fd9b763686da14cdf87d5e60357c029e.jpg saved to cache
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e869112-0f08-518d-975c-f468943236f6
2026-04-27 08:08:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e869112-0f08-518d-975c-f468943236f6, skipping ID generation
2026-04-27 08:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e869112-0f08-518d-975c-f468943236f6 with scrape type 1
2026-04-27 08:08:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e869112-0f08-518d-975c-f468943236f6 sending to next pipeline
2026-04-27 08:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1e869112-0f08-518d-975c-f468943236f6, identifier: WS87061
2026-04-27 08:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1e869112-0f08-518d-975c-f468943236f6 with identifier: WS87061
2026-04-27 08:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1e869112-0f08-518d-975c-f468943236f6 with identifier: WS87061
2026-04-27 08:08:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1e869112-0f08-518d-975c-f468943236f6 with identifier: WS87061 to the API
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_fd9b763686da14cdf87d5e60357c029e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': 'Taxi',
'city': 'Basauri',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-04-27T15:07:49Z',
'fuel_type': 'hybrid',
'id': '1e869112-0f08-518d-975c-f468943236f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 43.2383,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS87061',
'listing': 'auction',
'location': 'ES, Basauri',
'location_confidence': 'geocoded',
'longitude': -2.8759,
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 398427,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_14bbc6ed87b9ccb6ed485847709f6926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_fd9b763686da14cdf87d5e60357c029e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_ee4741953dcc70205895e690bed012f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_b510f79c34ba49b11a3c5c1e68cd28a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e919657135c8b4bf9c18c6726708900f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_dc66506384962bb4f7041c5a36ec842b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_621aba3967d43844ea2687af9e90d6e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_f573cf571ab9f00bd39b156ed7a38d41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_e47660313f160829b5ee169cf33ee788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e869112-0f08-518d-975c-f468943236f6/1e869112-0f08-518d-975c-f468943236f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/d1/97d1e02744e788b3afe0f1a7d11d83b2/pa/WS87061_42578b9b55d0697c1a124154206abeb9.jpg',
'Width': 800}],
'postal_code': '48970',
'price': 0,
'price_includes_vat': True,
'province': 'Vizcaya',
'province_code': 'ES-BI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2013-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2013}
2026-04-27 08:08:58 [auto1.es] INFO: Saving data for WS87061: {'created_time': 1777277338.641503, 'last_price_update_time': 1777277338.641518, 'has_photos': True, 'auction_closing_time': 1777302469.0}
2026-04-27 08:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9abfad238ef8479dc3ea3749c389d9f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7550>
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b5cd34d0af876c5ce5162e3e6aadf8d8.jpg saved to cache
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207890>
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_e76308a7d7d3528c43bfabc04f83b4c1.jpg saved to cache
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d
2026-04-27 08:08:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c1fe03e-15ed-5f33-a843-ba34768bdc7d, skipping ID generation
2026-04-27 08:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d with scrape type 1
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c1fe03e-15ed-5f33-a843-ba34768bdc7d sending to next pipeline
2026-04-27 08:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c1fe03e-15ed-5f33-a843-ba34768bdc7d, identifier: MF48856
2026-04-27 08:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c1fe03e-15ed-5f33-a843-ba34768bdc7d with identifier: MF48856
2026-04-27 08:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c1fe03e-15ed-5f33-a843-ba34768bdc7d with identifier: MF48856
2026-04-27 08:08:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c1fe03e-15ed-5f33-a843-ba34768bdc7d with identifier: MF48856 to the API
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_e76308a7d7d3528c43bfabc04f83b4c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Sibuscascoche,O Milladoiro',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:01:08Z',
'fuel_type': 'diesel',
'id': '9c1fe03e-15ed-5f33-a843-ba34768bdc7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF48856',
'listing': 'auction',
'location': 'ES, Sibuscascoche,O Milladoiro',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Kuga',
'odometer': 223260,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_e76308a7d7d3528c43bfabc04f83b4c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b5cd34d0af876c5ce5162e3e6aadf8d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_23e5a03c4c22adc007f956d1ddbc9199.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_b8fe996f456916918f63d401d4e87533.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_098b7910dbb58abaa4cd3db05f221b0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_6200c0f76c82ad4c0fd2c4ff5281759e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_84e51309feba1cdb7b5fafce7188d9d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_5740f269c970e2d1f8964b982c2fb293.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_c516791b3cb749fbc192fad07897f785.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1fe03e-15ed-5f33-a843-ba34768bdc7d/9c1fe03e-15ed-5f33-a843-ba34768bdc7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/ec/87ecf17bf9075b028e1d0c196acd4d50/pa/MF48856_ec7d8f74c85d009fb528844fede84b17.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2012}
2026-04-27 08:08:59 [auto1.es] INFO: Saving data for MF48856: {'created_time': 1777277339.148957, 'last_price_update_time': 1777277339.148967, 'has_photos': True, 'auction_closing_time': 1777302068.0}
2026-04-27 08:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB97743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892590>
2026-04-27 08:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9abfad238ef8479dc3ea3749c389d9f4.jpg saved to cache
2026-04-27 08:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE80473> (referer: https://www.auto1.com/v1/car-details-view/VE80473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a5eb65c-68e4-58d1-af5a-583ef8f8debf with identifier: VE80473
2026-04-27 08:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf with scrape type 1
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_84f216c3f9e946ee62285f353f467053.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_61d77cdfbbd29e9a97afbbe58d3494e6.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_ec59aa6869db3e2c875cd8578c1d4638.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_270c25184dfb91ecb8e170a4b87d296f.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_a8d3c420fd8dfff124543d05268bb634.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_fa77faf88c4d87f91438821a11315193.jpg not downloaded yet
2026-04-27 08:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP54958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_fa77faf88c4d87f91438821a11315193.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048867f50>
2026-04-27 08:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_fa77faf88c4d87f91438821a11315193.jpg saved to cache
2026-04-27 08:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA39577> (referer: https://www.auto1.com/v1/car-details-view/BA39577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_a8d3c420fd8dfff124543d05268bb634.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9ad779a-2282-5533-a5e6-aeedd01c2aeb with identifier: BA39577
2026-04-27 08:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb with scrape type 1
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_d22c499bce3f511126dff36026a32737.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_c5c6b4b3bd426bebad5da9164d8809fc.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_4e46c2e901dd3fde86c3565d46cd6b9d.jpg not downloaded yet
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_270c25184dfb91ecb8e170a4b87d296f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_884e23603ee9ad01bdf4cb0fac513f3a.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_3564f95d3d3034dfeccc0ed2adc37ff9.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_f6e5ab7bde11a4f800a6f0be50e13402.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_bf12f9e1d5fe22e0c68cb089cd8b433f.jpg not downloaded yet
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e5bd0>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_a8d3c420fd8dfff124543d05268bb634.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_9e7604bfb89acf60293be319b24f42ff.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_e6e70c56a5bc795ea0f342c16a2bdfee.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_54ebc3ddbad8fc1e95fc15741e88d305.jpg not downloaded yet
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7910>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_270c25184dfb91ecb8e170a4b87d296f.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_4e46c2e901dd3fde86c3565d46cd6b9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_54ebc3ddbad8fc1e95fc15741e88d305.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865a690>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_4e46c2e901dd3fde86c3565d46cd6b9d.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_e6e70c56a5bc795ea0f342c16a2bdfee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ddbd0>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_54ebc3ddbad8fc1e95fc15741e88d305.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891f850>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_e6e70c56a5bc795ea0f342c16a2bdfee.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_9e7604bfb89acf60293be319b24f42ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dc1d0>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_9e7604bfb89acf60293be319b24f42ff.jpg saved to cache
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_bf12f9e1d5fe22e0c68cb089cd8b433f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_f6e5ab7bde11a4f800a6f0be50e13402.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3e90>
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_bf12f9e1d5fe22e0c68cb089cd8b433f.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483de610>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_f6e5ab7bde11a4f800a6f0be50e13402.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_3564f95d3d3034dfeccc0ed2adc37ff9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_884e23603ee9ad01bdf4cb0fac513f3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048593b50>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_3564f95d3d3034dfeccc0ed2adc37ff9.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_c5c6b4b3bd426bebad5da9164d8809fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483fff10>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_884e23603ee9ad01bdf4cb0fac513f3a.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481ffb90>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_c5c6b4b3bd426bebad5da9164d8809fc.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_d22c499bce3f511126dff36026a32737.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_ec59aa6869db3e2c875cd8578c1d4638.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048205590>
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_d22c499bce3f511126dff36026a32737.jpg saved to cache
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb
2026-04-27 08:09:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9ad779a-2282-5533-a5e6-aeedd01c2aeb, skipping ID generation
2026-04-27 08:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb with scrape type 1
2026-04-27 08:09:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9ad779a-2282-5533-a5e6-aeedd01c2aeb sending to next pipeline
2026-04-27 08:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9ad779a-2282-5533-a5e6-aeedd01c2aeb, identifier: BA39577
2026-04-27 08:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9ad779a-2282-5533-a5e6-aeedd01c2aeb with identifier: BA39577
2026-04-27 08:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9ad779a-2282-5533-a5e6-aeedd01c2aeb with identifier: BA39577
2026-04-27 08:09:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9ad779a-2282-5533-a5e6-aeedd01c2aeb with identifier: BA39577 to the API
2026-04-27 08:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_d22c499bce3f511126dff36026a32737.jpg>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'city': 'Lugones',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 211,
'expiration_date': '2026-04-27T15:08:35Z',
'fuel_type': 'diesel',
'id': 'd9ad779a-2282-5533-a5e6-aeedd01c2aeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 43.4027,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA39577',
'listing': 'auction',
'location': 'Lugones',
'location_confidence': 'geocoded',
'longitude': -5.8121,
'make': 'Volvo',
'model': 'XC60',
'odometer': 213844,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_d22c499bce3f511126dff36026a32737.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_c5c6b4b3bd426bebad5da9164d8809fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_4e46c2e901dd3fde86c3565d46cd6b9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_884e23603ee9ad01bdf4cb0fac513f3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_3564f95d3d3034dfeccc0ed2adc37ff9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_f6e5ab7bde11a4f800a6f0be50e13402.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_bf12f9e1d5fe22e0c68cb089cd8b433f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_9e7604bfb89acf60293be319b24f42ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_e6e70c56a5bc795ea0f342c16a2bdfee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9ad779a-2282-5533-a5e6-aeedd01c2aeb/d9ad779a-2282-5533-a5e6-aeedd01c2aeb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/94/74948a2406616343234fe9b54d4f9c52/pa/BA39577_54ebc3ddbad8fc1e95fc15741e88d305.jpg',
'Width': 800}],
'postal_code': '33420',
'price': 0,
'price_includes_vat': True,
'province': 'Asturias',
'province_code': 'ES-O',
'region': 'Asturias',
'region_code': 'ES-AS',
'registration_date': '2021-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2021}
2026-04-27 08:09:15 [auto1.es] INFO: Saving data for BA39577: {'created_time': 1777277355.197432, 'last_price_update_time': 1777277355.197442, 'has_photos': True, 'auction_closing_time': 1777302515.0}
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_61d77cdfbbd29e9a97afbbe58d3494e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a0ed0>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_ec59aa6869db3e2c875cd8578c1d4638.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528490>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_61d77cdfbbd29e9a97afbbe58d3494e6.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_84f216c3f9e946ee62285f353f467053.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c2610>
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_84f216c3f9e946ee62285f353f467053.jpg saved to cache
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf
2026-04-27 08:09:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a5eb65c-68e4-58d1-af5a-583ef8f8debf, skipping ID generation
2026-04-27 08:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf with scrape type 1
2026-04-27 08:09:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a5eb65c-68e4-58d1-af5a-583ef8f8debf sending to next pipeline
2026-04-27 08:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a5eb65c-68e4-58d1-af5a-583ef8f8debf, identifier: VE80473
2026-04-27 08:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a5eb65c-68e4-58d1-af5a-583ef8f8debf with identifier: VE80473
2026-04-27 08:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a5eb65c-68e4-58d1-af5a-583ef8f8debf with identifier: VE80473
2026-04-27 08:09:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a5eb65c-68e4-58d1-af5a-583ef8f8debf with identifier: VE80473 to the API
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_84f216c3f9e946ee62285f353f467053.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'city': 'Almeria',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 60,
'expiration_date': '2026-04-27T15:40:26Z',
'fuel_type': 'petrol',
'id': '2a5eb65c-68e4-58d1-af5a-583ef8f8debf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 36.8381,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE80473',
'listing': 'auction',
'location': 'ES, Almería',
'location_confidence': 'geocoded',
'longitude': -2.4597,
'make': 'Skoda',
'model': 'Fabia',
'odometer': 139494,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_84f216c3f9e946ee62285f353f467053.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_61d77cdfbbd29e9a97afbbe58d3494e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_ec59aa6869db3e2c875cd8578c1d4638.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_270c25184dfb91ecb8e170a4b87d296f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_a8d3c420fd8dfff124543d05268bb634.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2a5eb65c-68e4-58d1-af5a-583ef8f8debf/2a5eb65c-68e4-58d1-af5a-583ef8f8debf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/c7/63c7d9f8bb12cd2e437b544031a8ae32/pa/VE80473_fa77faf88c4d87f91438821a11315193.jpg',
'Width': 800}],
'postal_code': '04001',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2009-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Fabia 1.2 Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2009}
2026-04-27 08:09:15 [auto1.es] INFO: Saving data for VE80473: {'created_time': 1777277355.960796, 'last_price_update_time': 1777277355.960806, 'has_photos': True, 'auction_closing_time': 1777304426.0}
2026-04-27 08:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_e8403d50c636329ddb031273a279e4c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048842ed0>
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_e8403d50c636329ddb031273a279e4c6.jpg saved to cache
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_6d8c03c8b7eb43633445f037bfa7b061.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fa90>
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_6d8c03c8b7eb43633445f037bfa7b061.jpg saved to cache
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR04430> (referer: https://www.auto1.com/v1/car-details-view/NR04430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2e8911b497499960cdf3d5288ff1d34c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbfe2dd-878d-537a-9f09-f52d39019b6b with identifier: NR04430
2026-04-27 08:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbfe2dd-878d-537a-9f09-f52d39019b6b with scrape type 1
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_80ae91677025adbf76c942d7204c179b.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_402406c992cc436cf9aaec1e384fe5fc.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_4ffc2593955d509367d25266ce944366.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_6436e5ed969ca975fbfeba994a2785b8.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_ebacd11814cf73df4c4c37538a2cd671.jpg not downloaded yet
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048895dd0>
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2e8911b497499960cdf3d5288ff1d34c.jpg saved to cache
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84dbee4c-021a-5dce-935d-aa1cbf948647
2026-04-27 08:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84dbee4c-021a-5dce-935d-aa1cbf948647, skipping ID generation
2026-04-27 08:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84dbee4c-021a-5dce-935d-aa1cbf948647 with scrape type 1
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84dbee4c-021a-5dce-935d-aa1cbf948647 sending to next pipeline
2026-04-27 08:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 84dbee4c-021a-5dce-935d-aa1cbf948647, identifier: SS90788
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_f1a4ca1da2a7ffbf130b14cb7bf0f5cd.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 84dbee4c-021a-5dce-935d-aa1cbf948647 with identifier: SS90788
2026-04-27 08:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 84dbee4c-021a-5dce-935d-aa1cbf948647 with identifier: SS90788
2026-04-27 08:09:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 84dbee4c-021a-5dce-935d-aa1cbf948647 with identifier: SS90788 to the API
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2e8911b497499960cdf3d5288ff1d34c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'city': 'Sevilla',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 73,
'expiration_date': '2026-04-27T15:05:44Z',
'fuel_type': 'petrol',
'id': '84dbee4c-021a-5dce-935d-aa1cbf948647',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS90788',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Peugeot',
'model': '207',
'odometer': 110444,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2e8911b497499960cdf3d5288ff1d34c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_801cf9a3fd533901e3774420d70a8446.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_6d8c03c8b7eb43633445f037bfa7b061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_2c49c16a12c9df669f4c34e674b5e128.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_e8403d50c636329ddb031273a279e4c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9abfad238ef8479dc3ea3749c389d9f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_0172f0863f0b91355e6fb31cc82cf55d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_9bf952cdb379062ef9b16069c2d42310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_20854b403e3d48b1ecb48b691552d7d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84dbee4c-021a-5dce-935d-aa1cbf948647/84dbee4c-021a-5dce-935d-aa1cbf948647_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/09/320935ba851934f896b37dec472eea4f/pa/SS90788_314d3b1f33e26fa6e28d923b403e9ec1.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2012-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2012}
2026-04-27 08:09:24 [auto1.es] INFO: Saving data for SS90788: {'created_time': 1777277364.991998, 'last_price_update_time': 1777277364.992007, 'has_photos': True, 'auction_closing_time': 1777302344.0}
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL75156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_f1a4ca1da2a7ffbf130b14cb7bf0f5cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481db6d0>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_f1a4ca1da2a7ffbf130b14cb7bf0f5cd.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_ebacd11814cf73df4c4c37538a2cd671.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884e810>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_ebacd11814cf73df4c4c37538a2cd671.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH42219> (referer: https://www.auto1.com/v1/car-details-view/TH42219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_6436e5ed969ca975fbfeba994a2785b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 with identifier: TH42219
2026-04-27 08:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 with scrape type 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_a9edc9d9262231d9110d9a5054565527.jpg not downloaded yet
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_4ffc2593955d509367d25266ce944366.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_04f075d0d259f10580f5cc0e42cca0a2.jpg not downloaded yet
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9741397909c7313b9b904d842b1bf6a7.jpg not downloaded yet
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9e3f52068af0e31217bb37b0e4f65ea4.jpg not downloaded yet
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_5aa7812cb4626f04d45a3e062170efd9.jpg not downloaded yet
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5e50>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_6436e5ed969ca975fbfeba994a2785b8.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_30aa7b758ae395561ab0dbe1ad73d4f2.jpg not downloaded yet
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_4eb24fbf3c16da551e76b99269b6f608.jpg not downloaded yet
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_a9edc9d9262231d9110d9a5054565527.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_f6d339a862f679df2ff0fb35aa60e234.jpg not downloaded yet
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893d90>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_4ffc2593955d509367d25266ce944366.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_afceb7dcdd60620b9d9325c66260a73e.jpg not downloaded yet
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_78984377c90bbe07f38236623f7b0af2.jpg not downloaded yet
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885fcd0>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_a9edc9d9262231d9110d9a5054565527.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_4eb24fbf3c16da551e76b99269b6f608.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484a1910>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_4eb24fbf3c16da551e76b99269b6f608.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_78984377c90bbe07f38236623f7b0af2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_afceb7dcdd60620b9d9325c66260a73e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876e410>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_78984377c90bbe07f38236623f7b0af2.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_f6d339a862f679df2ff0fb35aa60e234.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488edc90>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_afceb7dcdd60620b9d9325c66260a73e.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852b790>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_f6d339a862f679df2ff0fb35aa60e234.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_30aa7b758ae395561ab0dbe1ad73d4f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dcf90>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_30aa7b758ae395561ab0dbe1ad73d4f2.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_5aa7812cb4626f04d45a3e062170efd9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9e3f52068af0e31217bb37b0e4f65ea4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482105d0>
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_5aa7812cb4626f04d45a3e062170efd9.jpg saved to cache
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877610>
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9e3f52068af0e31217bb37b0e4f65ea4.jpg saved to cache
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9741397909c7313b9b904d842b1bf6a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_04f075d0d259f10580f5cc0e42cca0a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dce90>
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9741397909c7313b9b904d842b1bf6a7.jpg saved to cache
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_402406c992cc436cf9aaec1e384fe5fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885d210>
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_04f075d0d259f10580f5cc0e42cca0a2.jpg saved to cache
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08
2026-04-27 08:09:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbc20cbb-eaf5-54d9-8df9-7d38077a7a08, skipping ID generation
2026-04-27 08:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 with scrape type 1
2026-04-27 08:09:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 sending to next pipeline
2026-04-27 08:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dbc20cbb-eaf5-54d9-8df9-7d38077a7a08, identifier: TH42219
2026-04-27 08:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 with identifier: TH42219
2026-04-27 08:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 with identifier: TH42219
2026-04-27 08:09:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dbc20cbb-eaf5-54d9-8df9-7d38077a7a08 with identifier: TH42219 to the API
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_04f075d0d259f10580f5cc0e42cca0a2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'city': 'Esquivias',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:07:10Z',
'fuel_type': 'diesel',
'id': 'dbc20cbb-eaf5-54d9-8df9-7d38077a7a08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.1047,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH42219',
'listing': 'auction',
'location': 'ES, ESQUIVIAS',
'location_confidence': 'geocoded',
'longitude': -3.7664,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 189670,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_a9edc9d9262231d9110d9a5054565527.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_04f075d0d259f10580f5cc0e42cca0a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9741397909c7313b9b904d842b1bf6a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_9e3f52068af0e31217bb37b0e4f65ea4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_5aa7812cb4626f04d45a3e062170efd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_30aa7b758ae395561ab0dbe1ad73d4f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_4eb24fbf3c16da551e76b99269b6f608.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_f6d339a862f679df2ff0fb35aa60e234.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_afceb7dcdd60620b9d9325c66260a73e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbc20cbb-eaf5-54d9-8df9-7d38077a7a08/dbc20cbb-eaf5-54d9-8df9-7d38077a7a08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/60/c9607396b5b41a7354aa1c2c6078ccf3/pa/TH42219_78984377c90bbe07f38236623f7b0af2.jpg',
'Width': 800}],
'postal_code': '45221',
'price': 0,
'price_includes_vat': True,
'province': 'Toledo',
'province_code': 'ES-TO',
'region': 'Castilla - La Mancha',
'region_code': 'ES-CM',
'registration_date': '2017-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2017}
2026-04-27 08:09:29 [auto1.es] INFO: Saving data for TH42219: {'created_time': 1777277369.914817, 'last_price_update_time': 1777277369.914827, 'has_photos': True, 'auction_closing_time': 1777302430.0}
2026-04-27 08:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_80ae91677025adbf76c942d7204c179b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU01953> (referer: https://www.auto1.com/v1/car-details-view/AU01953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d5dd0>
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_402406c992cc436cf9aaec1e384fe5fc.jpg saved to cache
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841f590>
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_80ae91677025adbf76c942d7204c179b.jpg saved to cache
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbbfe2dd-878d-537a-9f09-f52d39019b6b
2026-04-27 08:09:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbbfe2dd-878d-537a-9f09-f52d39019b6b, skipping ID generation
2026-04-27 08:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbfe2dd-878d-537a-9f09-f52d39019b6b with scrape type 1
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbbfe2dd-878d-537a-9f09-f52d39019b6b sending to next pipeline
2026-04-27 08:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fbbfe2dd-878d-537a-9f09-f52d39019b6b, identifier: NR04430
2026-04-27 08:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc4b030-9551-5455-bb51-9b6bd02eebe3 with identifier: AU01953
2026-04-27 08:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3 with scrape type 1
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_47ee79d32460d39153f75ec868f00a2f.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fbbfe2dd-878d-537a-9f09-f52d39019b6b with identifier: NR04430
2026-04-27 08:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fbbfe2dd-878d-537a-9f09-f52d39019b6b with identifier: NR04430
2026-04-27 08:09:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fbbfe2dd-878d-537a-9f09-f52d39019b6b with identifier: NR04430 to the API
2026-04-27 08:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_80ae91677025adbf76c942d7204c179b.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Cornella De Llobregat',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:42:17Z',
'fuel_type': 'diesel',
'id': 'fbbfe2dd-878d-537a-9f09-f52d39019b6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR04430',
'listing': 'auction',
'location': 'ES, Cornellà de Llobregat',
'location_confidence': 'geocoded',
'longitude': 2.0833,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 200846,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_80ae91677025adbf76c942d7204c179b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_402406c992cc436cf9aaec1e384fe5fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_4ffc2593955d509367d25266ce944366.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_6436e5ed969ca975fbfeba994a2785b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_ebacd11814cf73df4c4c37538a2cd671.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbbfe2dd-878d-537a-9f09-f52d39019b6b/fbbfe2dd-878d-537a-9f09-f52d39019b6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/71/ac71f5d7c6fc3858d1221fa51e9e8598/pa/NR04430_f1a4ca1da2a7ffbf130b14cb7bf0f5cd.jpg',
'Width': 800}],
'postal_code': '08940',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2005-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6 TDCi Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2005}
2026-04-27 08:09:30 [auto1.es] INFO: Saving data for NR04430: {'created_time': 1777277370.655341, 'last_price_update_time': 1777277370.655351, 'has_photos': True, 'auction_closing_time': 1777304537.0}
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_0f2d795f44f5e89a3d6be088e3397acf.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_763c567c2c6de186d85f23e5da1c0342.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_26f99795f3f80344ebd14dba86c9b40c.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_32f92bdd4b319d4cb54ccc4eb575e1da.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_4f38934175c5573d923963517d9ae461.jpg not downloaded yet
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ82632> (referer: https://www.auto1.com/v1/car-details-view/TZ82632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aeee3d6-325e-509d-a68b-0b227b7864b4 with identifier: TZ82632
2026-04-27 08:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aeee3d6-325e-509d-a68b-0b227b7864b4 with scrape type 1
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_3331fdacf57bf6ade9bd82f5e3d1b01f.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ec9778ca73c963b116e7c28d942a18e9.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_50a8be4e06cc7df963ea571b122f9308.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ecf3521f48b91d853cade0314dc8b8bd.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_612a72d949801b6cc62d8b8bda1f5788.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_0c2d565b0c2ad917203ce80eafae1dae.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dd12fb256b71dc311d7620b82b0b8d24.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dda76b00d6aaf8170fc9635f1371e068.jpg not downloaded yet
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_a59e4103b0b555aca4d823a144e015a5.jpg not downloaded yet
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_4f38934175c5573d923963517d9ae461.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_68da1d3189b87c3d1bb0af4c918441c3.jpg not downloaded yet
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT15109> (referer: https://www.auto1.com/v1/car-details-view/HT15109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048715490>
2026-04-27 08:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_4f38934175c5573d923963517d9ae461.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 with identifier: HT15109
2026-04-27 08:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 with scrape type 1
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_7f6c5b55b4467b9b3bc21855266cd54a.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_cc7cb7cef0bec93958b162c83974772b.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_a59e4103b0b555aca4d823a144e015a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_85466644c52548c3b8b021422d0e44c3.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_68da1d3189b87c3d1bb0af4c918441c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_b7adf5e7043786a4176d1be6c1eab0ca.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_968430e1e727b271b8c93c1238e91eb2.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC74373> (referer: https://www.auto1.com/v1/car-details-view/WC74373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_38b1839fbe9beddcc3915ef9211e64f7.jpg not downloaded yet
2026-04-27 08:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_a40719cc48c9735d7aa586bcd185813b.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_7f6c5b55b4467b9b3bc21855266cd54a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_c7db329605bceddf5a26216ba519c555.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_9da7c9e08c4861dbecd1193113dbb162.jpg not downloaded yet
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048989b90>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_a59e4103b0b555aca4d823a144e015a5.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_3b626c4caa151b26282e17b478dd3c90.jpg not downloaded yet
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891e990>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_68da1d3189b87c3d1bb0af4c918441c3.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e421335a-ca04-5a8a-9523-beb6bd9c8c08 with identifier: WC74373
2026-04-27 08:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e421335a-ca04-5a8a-9523-beb6bd9c8c08 with scrape type 1
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_26e91415ea9777f0ba2552df5c9c01d5.jpg not downloaded yet
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048715a50>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_7f6c5b55b4467b9b3bc21855266cd54a.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_69aa0dc45259b8f3c713b829627b1aad.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_968430e1e727b271b8c93c1238e91eb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_85466644c52548c3b8b021422d0e44c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_c2800c6fc4293254da78afad45b1615c.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_b065304008181de12cfc4d91c8769092.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_ffe7e2058c2e8c189d093c9b51b545e8.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_afb9555bbcb7c13b00ef830c21c406bb.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_a40719cc48c9735d7aa586bcd185813b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_48ee1e828645a3471ed175e6cc3068f8.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_3b626c4caa151b26282e17b478dd3c90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_26e91415ea9777f0ba2552df5c9c01d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_8a7d0e2a864cb5ec320f7eaa4bb7de16.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_1b33453c26ecb9d35e0da6db42580d0a.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_6c45aaa9fb6dee4450f8037cc33dfd12.jpg not downloaded yet
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c1f10>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_968430e1e727b271b8c93c1238e91eb2.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848d110>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_85466644c52548c3b8b021422d0e44c3.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048382310>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_a40719cc48c9735d7aa586bcd185813b.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482131d0>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_3b626c4caa151b26282e17b478dd3c90.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a68d0>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_26e91415ea9777f0ba2552df5c9c01d5.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_b065304008181de12cfc4d91c8769092.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_afb9555bbcb7c13b00ef830c21c406bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_ffe7e2058c2e8c189d093c9b51b545e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848f750>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_b065304008181de12cfc4d91c8769092.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048525e10>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_afb9555bbcb7c13b00ef830c21c406bb.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_1b33453c26ecb9d35e0da6db42580d0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fdf10>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_ffe7e2058c2e8c189d093c9b51b545e8.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD92229> (referer: https://www.auto1.com/v1/car-details-view/KD92229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_8a7d0e2a864cb5ec320f7eaa4bb7de16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_6c45aaa9fb6dee4450f8037cc33dfd12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d1610>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_1b33453c26ecb9d35e0da6db42580d0a.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_9da7c9e08c4861dbecd1193113dbb162.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_69aa0dc45259b8f3c713b829627b1aad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 032f8530-d0df-5183-9c10-743b7c8edcf3 with identifier: KD92229
2026-04-27 08:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 032f8530-d0df-5183-9c10-743b7c8edcf3 with scrape type 1
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_82d9336c9528195fa3f5cca915b79f97.jpg not downloaded yet
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_e023b6be3bdd23b7b79fac3e6d0c8d41.jpg not downloaded yet
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_c7db329605bceddf5a26216ba519c555.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB97743> (referer: https://www.auto1.com/v1/car-details-view/FB97743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_fd84344e07ee2a6320460c71826d3966.jpg not downloaded yet
2026-04-27 08:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04865be90>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_8a7d0e2a864cb5ec320f7eaa4bb7de16.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823fe90>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_6c45aaa9fb6dee4450f8037cc33dfd12.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_384c3129140bfb388092245cc4641af5.jpg not downloaded yet
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_48ee1e828645a3471ed175e6cc3068f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_c2800c6fc4293254da78afad45b1615c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048521890>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_9da7c9e08c4861dbecd1193113dbb162.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048251310>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_69aa0dc45259b8f3c713b829627b1aad.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_759f511ffbc0d2a170ab54612c77d3ab.jpg not downloaded yet
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_38b1839fbe9beddcc3915ef9211e64f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_e023b6be3bdd23b7b79fac3e6d0c8d41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_414c688a994cbfafb2388fd32ae6daaa.jpg not downloaded yet
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04869a490>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_c7db329605bceddf5a26216ba519c555.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47697526-76ad-5c42-b915-4adcd289eb75 with identifier: FB97743
2026-04-27 08:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47697526-76ad-5c42-b915-4adcd289eb75 with scrape type 1
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_adb162b8f70475f34ea6128a7b7a51a1.jpg not downloaded yet
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_ca8b830029041a8191a8df1a04ff98ca.jpg not downloaded yet
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_82d9336c9528195fa3f5cca915b79f97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_b7adf5e7043786a4176d1be6c1eab0ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_fd84344e07ee2a6320460c71826d3966.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529f50>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_48ee1e828645a3471ed175e6cc3068f8.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ed990>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_c2800c6fc4293254da78afad45b1615c.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e421335a-ca04-5a8a-9523-beb6bd9c8c08
2026-04-27 08:09:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e421335a-ca04-5a8a-9523-beb6bd9c8c08, skipping ID generation
2026-04-27 08:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e421335a-ca04-5a8a-9523-beb6bd9c8c08 with scrape type 1
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e421335a-ca04-5a8a-9523-beb6bd9c8c08 sending to next pipeline
2026-04-27 08:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e421335a-ca04-5a8a-9523-beb6bd9c8c08, identifier: WC74373
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_7c23a67d1d861adc91aad16bb821e95c.jpg not downloaded yet
2026-04-27 08:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e421335a-ca04-5a8a-9523-beb6bd9c8c08 with identifier: WC74373
2026-04-27 08:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e421335a-ca04-5a8a-9523-beb6bd9c8c08 with identifier: WC74373
2026-04-27 08:09:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e421335a-ca04-5a8a-9523-beb6bd9c8c08 with identifier: WC74373 to the API
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_c2800c6fc4293254da78afad45b1615c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'city': 'Oleiros',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:12:37Z',
'fuel_type': 'petrol',
'id': 'e421335a-ca04-5a8a-9523-beb6bd9c8c08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.7948,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC74373',
'listing': 'auction',
'location': 'ES, Oleiros',
'location_confidence': 'geocoded',
'longitude': -8.9884,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 50272,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_26e91415ea9777f0ba2552df5c9c01d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_69aa0dc45259b8f3c713b829627b1aad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_c2800c6fc4293254da78afad45b1615c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_b065304008181de12cfc4d91c8769092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_ffe7e2058c2e8c189d093c9b51b545e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_afb9555bbcb7c13b00ef830c21c406bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_48ee1e828645a3471ed175e6cc3068f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_8a7d0e2a864cb5ec320f7eaa4bb7de16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_1b33453c26ecb9d35e0da6db42580d0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e421335a-ca04-5a8a-9523-beb6bd9c8c08/e421335a-ca04-5a8a-9523-beb6bd9c8c08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/f8/f0f81131d21da8d388d72f13a23eba1e/pa/WC74373_6c45aaa9fb6dee4450f8037cc33dfd12.jpg',
'Width': 800}],
'postal_code': '15240',
'price': 0,
'price_includes_vat': True,
'province': 'A Coruña',
'province_code': 'ES-C',
'region': 'Galicia',
'region_code': 'ES-GA',
'registration_date': '2015-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.2',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-04-27 08:09:34 [auto1.es] INFO: Saving data for WC74373: {'created_time': 1777277374.199442, 'last_price_update_time': 1777277374.199452, 'has_photos': True, 'auction_closing_time': 1777302757.0}
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_384c3129140bfb388092245cc4641af5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [scrapy.extensions.logstats] INFO: Crawled 578 pages (at 30 pages/min), scraped 655 items (at 10 items/min)
2026-04-27 08:09:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_759f511ffbc0d2a170ab54612c77d3ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_4df6acd8107720ae67a3a7ffc0e75282.jpg not downloaded yet
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dd8d0>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_38b1839fbe9beddcc3915ef9211e64f7.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a86d0>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_e023b6be3bdd23b7b79fac3e6d0c8d41.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482babd0>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_82d9336c9528195fa3f5cca915b79f97.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048695f10>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_b7adf5e7043786a4176d1be6c1eab0ca.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a80510>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_fd84344e07ee2a6320460c71826d3966.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF99464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_aa23d6f89f6eeddcec34696d7d358544.jpg not downloaded yet
2026-04-27 08:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_adb162b8f70475f34ea6128a7b7a51a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_cc7cb7cef0bec93958b162c83974772b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b4cd0>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_384c3129140bfb388092245cc4641af5.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e390>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_759f511ffbc0d2a170ab54612c77d3ab.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e88d2483b6c0944d47a418af882d120a.jpg not downloaded yet
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_414c688a994cbfafb2388fd32ae6daaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e935e00966f55fedcfa7eca430339521.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_d89758f0bd651dfe5ea97d79d9125f6f.jpg not downloaded yet
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c3050>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_adb162b8f70475f34ea6128a7b7a51a1.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852da10>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_cc7cb7cef0bec93958b162c83974772b.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750
2026-04-27 08:09:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bdec24e-8d92-5a0b-b58c-597a5ff9d750, skipping ID generation
2026-04-27 08:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 with scrape type 1
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 sending to next pipeline
2026-04-27 08:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5bdec24e-8d92-5a0b-b58c-597a5ff9d750, identifier: HT15109
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_b7ee2485555caf079b33cb5994becd0e.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 with identifier: HT15109
2026-04-27 08:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 with identifier: HT15109
2026-04-27 08:09:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5bdec24e-8d92-5a0b-b58c-597a5ff9d750 with identifier: HT15109 to the API
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_cc7cb7cef0bec93958b162c83974772b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 74,
'category': None,
'city': 'Huelva',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 235,
'expiration_date': '2026-04-27T15:31:45Z',
'fuel_type': 'diesel',
'id': '5bdec24e-8d92-5a0b-b58c-597a5ff9d750',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.2566,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT15109',
'listing': 'auction',
'location': 'ES, Huelva',
'location_confidence': 'geocoded',
'longitude': -6.9551,
'make': 'Volvo',
'model': 'XC90',
'odometer': 188102,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_7f6c5b55b4467b9b3bc21855266cd54a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_cc7cb7cef0bec93958b162c83974772b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_85466644c52548c3b8b021422d0e44c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_b7adf5e7043786a4176d1be6c1eab0ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_968430e1e727b271b8c93c1238e91eb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_38b1839fbe9beddcc3915ef9211e64f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_a40719cc48c9735d7aa586bcd185813b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_c7db329605bceddf5a26216ba519c555.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_9da7c9e08c4861dbecd1193113dbb162.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5bdec24e-8d92-5a0b-b58c-597a5ff9d750/5bdec24e-8d92-5a0b-b58c-597a5ff9d750_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/2e/f02e6ba5662fb822a4776b5dfad32aa4/pa/HT15109_3b626c4caa151b26282e17b478dd3c90.jpg',
'Width': 800}],
'postal_code': '21001',
'price': 0,
'price_includes_vat': True,
'province': 'Huelva',
'province_code': 'ES-H',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-07-13',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2017}
2026-04-27 08:09:35 [auto1.es] INFO: Saving data for HT15109: {'created_time': 1777277375.087559, 'last_price_update_time': 1777277375.087577, 'has_photos': True, 'auction_closing_time': 1777303905.0}
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_7c23a67d1d861adc91aad16bb821e95c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_4df6acd8107720ae67a3a7ffc0e75282.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e88d2483b6c0944d47a418af882d120a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_ca8b830029041a8191a8df1a04ff98ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dd12fb256b71dc311d7620b82b0b8d24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dda76b00d6aaf8170fc9635f1371e068.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_c2cceca3df4ad824fd033d18615e72fd.jpg not downloaded yet
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a0f50>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_414c688a994cbfafb2388fd32ae6daaa.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 032f8530-d0df-5183-9c10-743b7c8edcf3
2026-04-27 08:09:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 032f8530-d0df-5183-9c10-743b7c8edcf3, skipping ID generation
2026-04-27 08:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 032f8530-d0df-5183-9c10-743b7c8edcf3 with scrape type 1
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 032f8530-d0df-5183-9c10-743b7c8edcf3 sending to next pipeline
2026-04-27 08:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 032f8530-d0df-5183-9c10-743b7c8edcf3, identifier: KD92229
2026-04-27 08:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 032f8530-d0df-5183-9c10-743b7c8edcf3 with identifier: KD92229
2026-04-27 08:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 032f8530-d0df-5183-9c10-743b7c8edcf3 with identifier: KD92229
2026-04-27 08:09:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 032f8530-d0df-5183-9c10-743b7c8edcf3 with identifier: KD92229 to the API
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_414c688a994cbfafb2388fd32ae6daaa.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Trasona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:53:39Z',
'fuel_type': 'petrol',
'id': '032f8530-d0df-5183-9c10-743b7c8edcf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 43.55,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD92229',
'listing': 'auction',
'location': 'ES, Trasona',
'location_confidence': 'geocoded',
'longitude': -5.8667,
'make': 'Renault',
'model': 'Clio',
'odometer': 64538,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_82d9336c9528195fa3f5cca915b79f97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_e023b6be3bdd23b7b79fac3e6d0c8d41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_fd84344e07ee2a6320460c71826d3966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_384c3129140bfb388092245cc4641af5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_759f511ffbc0d2a170ab54612c77d3ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_032f8530-d0df-5183-9c10-743b7c8edcf3/032f8530-d0df-5183-9c10-743b7c8edcf3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/40/82404b186b9acdba4f90e75f2481d2ae/pa/KD92229_414c688a994cbfafb2388fd32ae6daaa.jpg',
'Width': 800}],
'postal_code': '33468',
'price': 0,
'price_includes_vat': True,
'province': 'Asturias',
'province_code': 'ES-O',
'region': 'Asturias',
'region_code': 'ES-AS',
'registration_date': '2004-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.2 Pack Authentique',
'transmission': 'manual',
'trim': 'Pack Authentique',
'year': 2004}
2026-04-27 08:09:35 [auto1.es] INFO: Saving data for KD92229: {'created_time': 1777277375.563335, 'last_price_update_time': 1777277375.563347, 'has_photos': True, 'auction_closing_time': 1777305219.0}
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_d89758f0bd651dfe5ea97d79d9125f6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_aa23d6f89f6eeddcec34696d7d358544.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e935e00966f55fedcfa7eca430339521.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_b7ee2485555caf079b33cb5994becd0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f37d0>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_7c23a67d1d861adc91aad16bb821e95c.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824cd50>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_4df6acd8107720ae67a3a7ffc0e75282.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04824d750>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e88d2483b6c0944d47a418af882d120a.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048843890>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_ca8b830029041a8191a8df1a04ff98ca.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048696890>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dd12fb256b71dc311d7620b82b0b8d24.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048858290>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dda76b00d6aaf8170fc9635f1371e068.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_0c2d565b0c2ad917203ce80eafae1dae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487eff50>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_d89758f0bd651dfe5ea97d79d9125f6f.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0a90>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_aa23d6f89f6eeddcec34696d7d358544.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884e250>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e935e00966f55fedcfa7eca430339521.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0f90>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_b7ee2485555caf079b33cb5994becd0e.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_c2cceca3df4ad824fd033d18615e72fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ec9778ca73c963b116e7c28d942a18e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c0a90>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_0c2d565b0c2ad917203ce80eafae1dae.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ecf3521f48b91d853cade0314dc8b8bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_612a72d949801b6cc62d8b8bda1f5788.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_50a8be4e06cc7df963ea571b122f9308.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848c550>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_c2cceca3df4ad824fd033d18615e72fd.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47697526-76ad-5c42-b915-4adcd289eb75
2026-04-27 08:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47697526-76ad-5c42-b915-4adcd289eb75, skipping ID generation
2026-04-27 08:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47697526-76ad-5c42-b915-4adcd289eb75 with scrape type 1
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47697526-76ad-5c42-b915-4adcd289eb75 sending to next pipeline
2026-04-27 08:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 47697526-76ad-5c42-b915-4adcd289eb75, identifier: FB97743
2026-04-27 08:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 47697526-76ad-5c42-b915-4adcd289eb75 with identifier: FB97743
2026-04-27 08:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 47697526-76ad-5c42-b915-4adcd289eb75 with identifier: FB97743
2026-04-27 08:09:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 47697526-76ad-5c42-b915-4adcd289eb75 with identifier: FB97743 to the API
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_c2cceca3df4ad824fd033d18615e72fd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 195,
'category': None,
'city': 'Granyanella',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:09:05Z',
'fuel_type': 'petrol',
'id': '47697526-76ad-5c42-b915-4adcd289eb75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6874,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB97743',
'listing': 'auction',
'location': 'ES, Granyanella',
'location_confidence': 'geocoded',
'longitude': 1.2955,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 78284,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_adb162b8f70475f34ea6128a7b7a51a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_ca8b830029041a8191a8df1a04ff98ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_7c23a67d1d861adc91aad16bb821e95c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_4df6acd8107720ae67a3a7ffc0e75282.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_aa23d6f89f6eeddcec34696d7d358544.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e88d2483b6c0944d47a418af882d120a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_e935e00966f55fedcfa7eca430339521.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_d89758f0bd651dfe5ea97d79d9125f6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_b7ee2485555caf079b33cb5994becd0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47697526-76ad-5c42-b915-4adcd289eb75/47697526-76ad-5c42-b915-4adcd289eb75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/bf/e5bff992ae3b14f7a8b377670805b17d/pa/FB97743_c2cceca3df4ad824fd033d18615e72fd.jpg',
'Width': 800}],
'postal_code': '25218',
'price': 0,
'price_includes_vat': True,
'province': 'Lleida',
'province_code': 'ES-L',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2015-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI 4Motion Sport',
'transmission': 'automatic',
'trim': '4Motion Sport',
'year': 2015}
2026-04-27 08:09:36 [auto1.es] INFO: Saving data for FB97743: {'created_time': 1777277376.768271, 'last_price_update_time': 1777277376.768281, 'has_photos': True, 'auction_closing_time': 1777302545.0}
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_3331fdacf57bf6ade9bd82f5e3d1b01f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_32f92bdd4b319d4cb54ccc4eb575e1da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048842a50>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ec9778ca73c963b116e7c28d942a18e9.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ecf10>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ecf3521f48b91d853cade0314dc8b8bd.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f4850>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_612a72d949801b6cc62d8b8bda1f5788.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ed7d0>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_50a8be4e06cc7df963ea571b122f9308.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_0f2d795f44f5e89a3d6be088e3397acf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7c10>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_3331fdacf57bf6ade9bd82f5e3d1b01f.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1aeee3d6-325e-509d-a68b-0b227b7864b4
2026-04-27 08:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1aeee3d6-325e-509d-a68b-0b227b7864b4, skipping ID generation
2026-04-27 08:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aeee3d6-325e-509d-a68b-0b227b7864b4 with scrape type 1
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1aeee3d6-325e-509d-a68b-0b227b7864b4 sending to next pipeline
2026-04-27 08:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1aeee3d6-325e-509d-a68b-0b227b7864b4, identifier: TZ82632
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d7290>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_32f92bdd4b319d4cb54ccc4eb575e1da.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_763c567c2c6de186d85f23e5da1c0342.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1aeee3d6-325e-509d-a68b-0b227b7864b4 with identifier: TZ82632
2026-04-27 08:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1aeee3d6-325e-509d-a68b-0b227b7864b4 with identifier: TZ82632
2026-04-27 08:09:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1aeee3d6-325e-509d-a68b-0b227b7864b4 with identifier: TZ82632 to the API
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_3331fdacf57bf6ade9bd82f5e3d1b01f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'city': 'Aldaya',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:24:48Z',
'fuel_type': 'diesel',
'id': '1aeee3d6-325e-509d-a68b-0b227b7864b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ82632',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '2008',
'odometer': 63020,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_3331fdacf57bf6ade9bd82f5e3d1b01f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ec9778ca73c963b116e7c28d942a18e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_50a8be4e06cc7df963ea571b122f9308.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_ecf3521f48b91d853cade0314dc8b8bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_612a72d949801b6cc62d8b8bda1f5788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_0c2d565b0c2ad917203ce80eafae1dae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dd12fb256b71dc311d7620b82b0b8d24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_dda76b00d6aaf8170fc9635f1371e068.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_a59e4103b0b555aca4d823a144e015a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1aeee3d6-325e-509d-a68b-0b227b7864b4/1aeee3d6-325e-509d-a68b-0b227b7864b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/a3/b0a3df67061a055dd8a26864a540f6da/pa/TZ82632_68da1d3189b87c3d1bb0af4c918441c3.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-08-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2021}
2026-04-27 08:09:37 [auto1.es] INFO: Saving data for TZ82632: {'created_time': 1777277377.495865, 'last_price_update_time': 1777277377.495874, 'has_photos': True, 'auction_closing_time': 1777303488.0}
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_26f99795f3f80344ebd14dba86c9b40c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_47ee79d32460d39153f75ec868f00a2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048253350>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_0f2d795f44f5e89a3d6be088e3397acf.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4cd0>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_763c567c2c6de186d85f23e5da1c0342.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048253cd0>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_26f99795f3f80344ebd14dba86c9b40c.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876bc90>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_47ee79d32460d39153f75ec868f00a2f.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3
2026-04-27 08:09:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dc4b030-9551-5455-bb51-9b6bd02eebe3, skipping ID generation
2026-04-27 08:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3 with scrape type 1
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dc4b030-9551-5455-bb51-9b6bd02eebe3 sending to next pipeline
2026-04-27 08:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dc4b030-9551-5455-bb51-9b6bd02eebe3, identifier: AU01953
2026-04-27 08:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dc4b030-9551-5455-bb51-9b6bd02eebe3 with identifier: AU01953
2026-04-27 08:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dc4b030-9551-5455-bb51-9b6bd02eebe3 with identifier: AU01953
2026-04-27 08:09:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dc4b030-9551-5455-bb51-9b6bd02eebe3 with identifier: AU01953 to the API
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_47ee79d32460d39153f75ec868f00a2f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Madrid',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.8L',
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:55:37Z',
'fuel_type': 'petrol',
'id': '0dc4b030-9551-5455-bb51-9b6bd02eebe3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU01953',
'listing': 'auction',
'location': 'Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Toyota',
'model': 'Avensis',
'odometer': 247737,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_47ee79d32460d39153f75ec868f00a2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_0f2d795f44f5e89a3d6be088e3397acf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_763c567c2c6de186d85f23e5da1c0342.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_26f99795f3f80344ebd14dba86c9b40c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_32f92bdd4b319d4cb54ccc4eb575e1da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0dc4b030-9551-5455-bb51-9b6bd02eebe3/0dc4b030-9551-5455-bb51-9b6bd02eebe3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e8/58e8254928faac67d33c207bed3f3279/pa/AU01953_4f38934175c5573d923963517d9ae461.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2004-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Avensis 1.8 Sol Liftback',
'transmission': 'manual',
'trim': 'Sol Liftback',
'year': 2004}
2026-04-27 08:09:38 [auto1.es] INFO: Saving data for AU01953: {'created_time': 1777277378.189039, 'last_price_update_time': 1777277378.189051, 'has_photos': True, 'auction_closing_time': 1777305337.0}
2026-04-27 08:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL75156> (referer: https://www.auto1.com/v1/car-details-view/NL75156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369f25d0-c209-5c54-96ef-801fd74bf4ac with identifier: NL75156
2026-04-27 08:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369f25d0-c209-5c54-96ef-801fd74bf4ac with scrape type 1
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_0a7207d108a88f39b1aac1610a94af10.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_35be7356273de936e8b1e0b45ad0a8d7.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4323b7bb467371dbccaa2125d081e8.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_75eeec2e09d13838d7fa6e2a9e25f5c3.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_1adec48f5e02c19c7f0889e0ab9f78b4.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4ce2899f7a3b2f3327872d4852783f.jpg not downloaded yet
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY25635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4ce2899f7a3b2f3327872d4852783f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c8190>
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4ce2899f7a3b2f3327872d4852783f.jpg saved to cache
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_1adec48f5e02c19c7f0889e0ab9f78b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876a010>
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_1adec48f5e02c19c7f0889e0ab9f78b4.jpg saved to cache
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF55417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_75eeec2e09d13838d7fa6e2a9e25f5c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842a250>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_75eeec2e09d13838d7fa6e2a9e25f5c3.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH04096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4323b7bb467371dbccaa2125d081e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853a90>
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4323b7bb467371dbccaa2125d081e8.jpg saved to cache
2026-04-27 08:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_35be7356273de936e8b1e0b45ad0a8d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876bd90>
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_35be7356273de936e8b1e0b45ad0a8d7.jpg saved to cache
2026-04-27 08:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU29040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_0a7207d108a88f39b1aac1610a94af10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6550>
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_0a7207d108a88f39b1aac1610a94af10.jpg saved to cache
2026-04-27 08:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 369f25d0-c209-5c54-96ef-801fd74bf4ac
2026-04-27 08:10:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 369f25d0-c209-5c54-96ef-801fd74bf4ac, skipping ID generation
2026-04-27 08:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369f25d0-c209-5c54-96ef-801fd74bf4ac with scrape type 1
2026-04-27 08:10:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 369f25d0-c209-5c54-96ef-801fd74bf4ac sending to next pipeline
2026-04-27 08:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 369f25d0-c209-5c54-96ef-801fd74bf4ac, identifier: NL75156
2026-04-27 08:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 369f25d0-c209-5c54-96ef-801fd74bf4ac with identifier: NL75156
2026-04-27 08:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 369f25d0-c209-5c54-96ef-801fd74bf4ac with identifier: NL75156
2026-04-27 08:10:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 369f25d0-c209-5c54-96ef-801fd74bf4ac with identifier: NL75156 to the API
2026-04-27 08:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_0a7207d108a88f39b1aac1610a94af10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Sevilla',
'color': 'beige',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '1.5L',
'engine_horse_power': 85,
'expiration_date': '2026-04-27T15:13:13Z',
'fuel_type': 'diesel',
'id': '369f25d0-c209-5c54-96ef-801fd74bf4ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL75156',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Renault',
'model': 'Megane',
'odometer': 155644,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_0a7207d108a88f39b1aac1610a94af10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_35be7356273de936e8b1e0b45ad0a8d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4323b7bb467371dbccaa2125d081e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_75eeec2e09d13838d7fa6e2a9e25f5c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_1adec48f5e02c19c7f0889e0ab9f78b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_369f25d0-c209-5c54-96ef-801fd74bf4ac/369f25d0-c209-5c54-96ef-801fd74bf4ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/d3/d9d310a7744059f5332c505c8f282ffe/pa/NL75156_9c4ce2899f7a3b2f3327872d4852783f.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2009-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2009}
2026-04-27 08:10:04 [auto1.es] INFO: Saving data for NL75156: {'created_time': 1777277404.171057, 'last_price_update_time': 1777277404.171074, 'has_photos': True, 'auction_closing_time': 1777302793.0}
2026-04-27 08:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT20660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF99464> (referer: https://www.auto1.com/v1/car-details-view/TF99464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90d477dd-ad2c-502a-a5b4-0f43e2781864 with identifier: TF99464
2026-04-27 08:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90d477dd-ad2c-502a-a5b4-0f43e2781864 with scrape type 1
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_f0e5848c8068514ee82a7fd462ae4fd8.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_abeae83445d81d7912a9dfc3f628b20f.jpg not downloaded yet
2026-04-27 08:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_c80b5a33755556c6e5428eaea5ab044b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_c92bf46f893a4e5cba8142f178c28313.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_49133ccbe2ef254c33fe42b1da0a5901.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_82bfab990529256241aec986a7fe443e.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_77bcad1917ae32c7901beb54e80a38b2.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_5d6a24c9fc5dc672f8e871e5e39a8cd1.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_67dffca7da5e1907903847c2ca864c49.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_960a33d39452a76e1203646687b96a8a.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_fae4bf63b95eed91be022ad8e9580305.jpg not downloaded yet
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b3590>
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_c80b5a33755556c6e5428eaea5ab044b.jpg saved to cache
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20f6a285-f842-59c9-91d0-23069a183cf2
2026-04-27 08:10:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20f6a285-f842-59c9-91d0-23069a183cf2, skipping ID generation
2026-04-27 08:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f6a285-f842-59c9-91d0-23069a183cf2 with scrape type 1
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20f6a285-f842-59c9-91d0-23069a183cf2 sending to next pipeline
2026-04-27 08:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20f6a285-f842-59c9-91d0-23069a183cf2, identifier: EX06881
2026-04-27 08:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20f6a285-f842-59c9-91d0-23069a183cf2 with identifier: EX06881
2026-04-27 08:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20f6a285-f842-59c9-91d0-23069a183cf2 with identifier: EX06881
2026-04-27 08:10:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20f6a285-f842-59c9-91d0-23069a183cf2 with identifier: EX06881 to the API
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_c80b5a33755556c6e5428eaea5ab044b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'city': 'Pedrola',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:15:48Z',
'fuel_type': 'petrol',
'id': '20f6a285-f842-59c9-91d0-23069a183cf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.7881,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX06881',
'listing': 'auction',
'location': 'ES, Pedrola, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -1.2172,
'make': 'Opel',
'model': 'Grandland X',
'odometer': 186521,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_c80b5a33755556c6e5428eaea5ab044b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_2500716f82bad01cb81b585cd32c4029.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_87c3d50abd31c319c2586136776cc169.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_e1b4cba216219ae08579507ce7502704.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_5a138b68f0036d6a6a53337ae12c08d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_711c53001c0d849edeff522fc485f615.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_23d6fc22b4844640a27ee6236e5ce617.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_98555c9704d42cd07871372450e0d891.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_dab2579982fa08b94fe41ae3b9f91d19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f6a285-f842-59c9-91d0-23069a183cf2/20f6a285-f842-59c9-91d0-23069a183cf2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/3a/f13a99baf4ce9f47a9794111ab54e3a5/pa/EX06881_3c13f1562748a852b7934c548d1f7b87.jpg',
'Width': 800}],
'postal_code': '50690',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2017-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2017}
2026-04-27 08:10:06 [auto1.es] INFO: Saving data for EX06881: {'created_time': 1777277406.059864, 'last_price_update_time': 1777277406.059878, 'has_photos': True, 'auction_closing_time': 1777302948.0}
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_f0e5848c8068514ee82a7fd462ae4fd8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ee5d0>
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_f0e5848c8068514ee82a7fd462ae4fd8.jpg saved to cache
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_fae4bf63b95eed91be022ad8e9580305.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX79689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a7a50>
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_fae4bf63b95eed91be022ad8e9580305.jpg saved to cache
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_960a33d39452a76e1203646687b96a8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_67dffca7da5e1907903847c2ca864c49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048829550>
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_960a33d39452a76e1203646687b96a8a.jpg saved to cache
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487681d0>
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_67dffca7da5e1907903847c2ca864c49.jpg saved to cache
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_5d6a24c9fc5dc672f8e871e5e39a8cd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_77bcad1917ae32c7901beb54e80a38b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882a910>
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_5d6a24c9fc5dc672f8e871e5e39a8cd1.jpg saved to cache
2026-04-27 08:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA33031> (referer: https://www.auto1.com/v1/car-details-view/JA33031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_82bfab990529256241aec986a7fe443e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:10:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488b8b10>
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_77bcad1917ae32c7901beb54e80a38b2.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d294d9bd-19a8-5b17-94bc-b999652fabee with identifier: JA33031
2026-04-27 08:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d294d9bd-19a8-5b17-94bc-b999652fabee with scrape type 1
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_92a96dce812420ea5a271e298ca40711.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_c88485ed29d49f521394b2b9f9877bea.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_f84ab0333e79ed08c9ad6e98ac10ecde.jpg not downloaded yet
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b8e10>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_82bfab990529256241aec986a7fe443e.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_be1adb749a0b35d051a7f429dd8aed88.jpg not downloaded yet
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_49133ccbe2ef254c33fe42b1da0a5901.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_1a621f8fa2343f6fe4fba2874402d53e.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_12e6180271e998647bb42a6483363f27.jpg not downloaded yet
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_c92bf46f893a4e5cba8142f178c28313.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_f84ab0333e79ed08c9ad6e98ac10ecde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_1a621f8fa2343f6fe4fba2874402d53e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894d350>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_49133ccbe2ef254c33fe42b1da0a5901.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894c290>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_c92bf46f893a4e5cba8142f178c28313.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482522d0>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_f84ab0333e79ed08c9ad6e98ac10ecde.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_be1adb749a0b35d051a7f429dd8aed88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488bb890>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_1a621f8fa2343f6fe4fba2874402d53e.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_12e6180271e998647bb42a6483363f27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_c88485ed29d49f521394b2b9f9877bea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768a10>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_be1adb749a0b35d051a7f429dd8aed88.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_92a96dce812420ea5a271e298ca40711.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876d8d0>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_12e6180271e998647bb42a6483363f27.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b4790>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_c88485ed29d49f521394b2b9f9877bea.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ec310>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_92a96dce812420ea5a271e298ca40711.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d294d9bd-19a8-5b17-94bc-b999652fabee
2026-04-27 08:10:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d294d9bd-19a8-5b17-94bc-b999652fabee, skipping ID generation
2026-04-27 08:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d294d9bd-19a8-5b17-94bc-b999652fabee with scrape type 1
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d294d9bd-19a8-5b17-94bc-b999652fabee sending to next pipeline
2026-04-27 08:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d294d9bd-19a8-5b17-94bc-b999652fabee, identifier: JA33031
2026-04-27 08:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d294d9bd-19a8-5b17-94bc-b999652fabee with identifier: JA33031
2026-04-27 08:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d294d9bd-19a8-5b17-94bc-b999652fabee with identifier: JA33031
2026-04-27 08:10:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d294d9bd-19a8-5b17-94bc-b999652fabee with identifier: JA33031 to the API
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_92a96dce812420ea5a271e298ca40711.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Collado Villalba',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-04-27T15:35:45Z',
'fuel_type': 'petrol',
'id': 'd294d9bd-19a8-5b17-94bc-b999652fabee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.6424,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA33031',
'listing': 'auction',
'location': 'ES, Collado Villalba, Madrid',
'location_confidence': 'geocoded',
'longitude': -3.9981,
'make': 'Toyota',
'model': 'Aygo',
'odometer': 282029,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_92a96dce812420ea5a271e298ca40711.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_c88485ed29d49f521394b2b9f9877bea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_f84ab0333e79ed08c9ad6e98ac10ecde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_be1adb749a0b35d051a7f429dd8aed88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_1a621f8fa2343f6fe4fba2874402d53e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d294d9bd-19a8-5b17-94bc-b999652fabee/d294d9bd-19a8-5b17-94bc-b999652fabee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/6f/866f30a465568defa97c6ce07542605b/pa/JA33031_12e6180271e998647bb42a6483363f27.jpg',
'Width': 800}],
'postal_code': '28400',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2011-08-16',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-04-27 08:10:08 [auto1.es] INFO: Saving data for JA33031: {'created_time': 1777277408.31028, 'last_price_update_time': 1777277408.310294, 'has_photos': True, 'auction_closing_time': 1777304145.0}
2026-04-27 08:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK45669> (referer: https://www.auto1.com/v1/car-details-view/YK45669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_abeae83445d81d7912a9dfc3f628b20f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669
2026-04-27 08:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with scrape type 1
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_22f909c46e187c25e91c08b3588be79b.jpg not downloaded yet
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_eb3000deb696b27e2e68b535ec4d3f1d.jpg not downloaded yet
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_51a245e95bc7b19c1fc772f76fe8eb72.jpg not downloaded yet
2026-04-27 08:10:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884db90>
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_abeae83445d81d7912a9dfc3f628b20f.jpg saved to cache
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90d477dd-ad2c-502a-a5b4-0f43e2781864
2026-04-27 08:10:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90d477dd-ad2c-502a-a5b4-0f43e2781864, skipping ID generation
2026-04-27 08:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90d477dd-ad2c-502a-a5b4-0f43e2781864 with scrape type 1
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90d477dd-ad2c-502a-a5b4-0f43e2781864 sending to next pipeline
2026-04-27 08:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90d477dd-ad2c-502a-a5b4-0f43e2781864, identifier: TF99464
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_71513ad3e295dcd05bd6a9d3552623c8.jpg not downloaded yet
2026-04-27 08:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90d477dd-ad2c-502a-a5b4-0f43e2781864 with identifier: TF99464
2026-04-27 08:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90d477dd-ad2c-502a-a5b4-0f43e2781864 with identifier: TF99464
2026-04-27 08:10:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90d477dd-ad2c-502a-a5b4-0f43e2781864 with identifier: TF99464 to the API
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_abeae83445d81d7912a9dfc3f628b20f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.4L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:39:54Z',
'fuel_type': 'diesel',
'id': '90d477dd-ad2c-502a-a5b4-0f43e2781864',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF99464',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Volvo',
'model': 'S60',
'odometer': 131189,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428344,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_f0e5848c8068514ee82a7fd462ae4fd8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2633533,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_abeae83445d81d7912a9dfc3f628b20f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_c92bf46f893a4e5cba8142f178c28313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_49133ccbe2ef254c33fe42b1da0a5901.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_82bfab990529256241aec986a7fe443e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484916,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_77bcad1917ae32c7901beb54e80a38b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_5d6a24c9fc5dc672f8e871e5e39a8cd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2686173,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_67dffca7da5e1907903847c2ca864c49.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_960a33d39452a76e1203646687b96a8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90d477dd-ad2c-502a-a5b4-0f43e2781864/90d477dd-ad2c-502a-a5b4-0f43e2781864_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/6a/f86a7a5819ea4db36e67573daeb93370/pa/TF99464_fae4bf63b95eed91be022ad8e9580305.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2006-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo S60 2.4 D Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2006}
2026-04-27 08:10:09 [auto1.es] INFO: Saving data for TF99464: {'created_time': 1777277409.03808, 'last_price_update_time': 1777277409.038094, 'has_photos': True, 'auction_closing_time': 1777304394.0}
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_b8b4340bb3dd9defe0b5945e51805385.jpg not downloaded yet
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_543bdeb5825ae9d5ed9fd589849b012b.jpg not downloaded yet
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_2d06f4bf47f94bd927e3d5b4953b92bc.jpg not downloaded yet
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_3ae883aeff158654174fa7e97ab6a4f9.jpg not downloaded yet
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_8507a8175bf431e64ab0465694a86503.jpg not downloaded yet
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_9ad8c37a7476baf0e3c84271cd032753.jpg not downloaded yet
2026-04-27 08:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY25635> (referer: https://www.auto1.com/v1/car-details-view/XY25635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c857da-0083-5743-824d-34226ee87fc2 with identifier: XY25635
2026-04-27 08:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c857da-0083-5743-824d-34226ee87fc2 with scrape type 1
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b2a7c3c5fedb849fe5b56722aa8f0cad.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_69cac3d5de219fc9ce0b418c50a69348.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_151748142ef6bc1238441168de273db4.jpg not downloaded yet
2026-04-27 08:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_9ad8c37a7476baf0e3c84271cd032753.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b1b71be83a7c934deecc878bb2c80e75.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_2b5f43b879dc67e10241ce6108fbb8ae.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_9739f0999dc7e24e04baf221f080cc13.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_91fe72e4e0a7d4c97d6280e912286278.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_6c1d6dc645a63645647fbb5a6573209f.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_feed5b3a8dc61b495f4965aa1618326f.jpg not downloaded yet
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_ff13d71cd436d31c8920a783238b4890.jpg not downloaded yet
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048829e10>
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_9ad8c37a7476baf0e3c84271cd032753.jpg saved to cache
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_151748142ef6bc1238441168de273db4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884c690>
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_151748142ef6bc1238441168de273db4.jpg saved to cache
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_ff13d71cd436d31c8920a783238b4890.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d7d90>
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_ff13d71cd436d31c8920a783238b4890.jpg saved to cache
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_feed5b3a8dc61b495f4965aa1618326f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048825190>
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_feed5b3a8dc61b495f4965aa1618326f.jpg saved to cache
2026-04-27 08:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_6c1d6dc645a63645647fbb5a6573209f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842abd0>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_6c1d6dc645a63645647fbb5a6573209f.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_91fe72e4e0a7d4c97d6280e912286278.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF55417> (referer: https://www.auto1.com/v1/car-details-view/VF55417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b0c50>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_91fe72e4e0a7d4c97d6280e912286278.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417
2026-04-27 08:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e392ba05-d999-5f83-a788-7fcf2d3f45c9 with scrape type 1
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg not downloaded yet
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_9739f0999dc7e24e04baf221f080cc13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg not downloaded yet
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_2b5f43b879dc67e10241ce6108fbb8ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg not downloaded yet
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg not downloaded yet
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048891c50>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_9739f0999dc7e24e04baf221f080cc13.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489801d0>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_2b5f43b879dc67e10241ce6108fbb8ae.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b1b71be83a7c934deecc878bb2c80e75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057cc3990>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b1b71be83a7c934deecc878bb2c80e75.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a1550>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876c550>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048564d10>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d95d0>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c1050>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048876350>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048981cd0>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0489884d0>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_69cac3d5de219fc9ce0b418c50a69348.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a97710>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b2a7c3c5fedb849fe5b56722aa8f0cad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7710>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_69cac3d5de219fc9ce0b418c50a69348.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_8507a8175bf431e64ab0465694a86503.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841ee10>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-04-27 08:10:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e392ba05-d999-5f83-a788-7fcf2d3f45c9, skipping ID generation
2026-04-27 08:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e392ba05-d999-5f83-a788-7fcf2d3f45c9 with scrape type 1
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e392ba05-d999-5f83-a788-7fcf2d3f45c9 sending to next pipeline
2026-04-27 08:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e392ba05-d999-5f83-a788-7fcf2d3f45c9, identifier: VF55417
2026-04-27 08:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417
2026-04-27 08:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417
2026-04-27 08:10:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417 to the API
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': 'Rental',
'city': 'La Roda De Andalucia',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:31:53Z',
'fuel_type': 'diesel',
'id': 'e392ba05-d999-5f83-a788-7fcf2d3f45c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF55417',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Fiat',
'model': '500L',
'odometer': 137569,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Pop Star',
'transmission': 'automatic',
'trim': 'Pop Star',
'year': 2017}
2026-04-27 08:10:16 [auto1.es] INFO: Saving data for VF55417: {'created_time': 1777277416.16148, 'last_price_update_time': 1777277416.161494, 'has_photos': True, 'auction_closing_time': 1777303913.0}
2026-04-27 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_2d06f4bf47f94bd927e3d5b4953b92bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_3ae883aeff158654174fa7e97ab6a4f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048858e50>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b2a7c3c5fedb849fe5b56722aa8f0cad.jpg saved to cache
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76c857da-0083-5743-824d-34226ee87fc2
2026-04-27 08:10:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76c857da-0083-5743-824d-34226ee87fc2, skipping ID generation
2026-04-27 08:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c857da-0083-5743-824d-34226ee87fc2 with scrape type 1
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76c857da-0083-5743-824d-34226ee87fc2 sending to next pipeline
2026-04-27 08:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76c857da-0083-5743-824d-34226ee87fc2, identifier: XY25635
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884ccd0>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_8507a8175bf431e64ab0465694a86503.jpg saved to cache
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76c857da-0083-5743-824d-34226ee87fc2 with identifier: XY25635
2026-04-27 08:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76c857da-0083-5743-824d-34226ee87fc2 with identifier: XY25635
2026-04-27 08:10:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76c857da-0083-5743-824d-34226ee87fc2 with identifier: XY25635 to the API
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b2a7c3c5fedb849fe5b56722aa8f0cad.jpg>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'city': 'Madrid',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-27T15:03:47Z',
'fuel_type': 'diesel',
'id': '76c857da-0083-5743-824d-34226ee87fc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY25635',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 54968,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b2a7c3c5fedb849fe5b56722aa8f0cad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_69cac3d5de219fc9ce0b418c50a69348.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_151748142ef6bc1238441168de273db4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_b1b71be83a7c934deecc878bb2c80e75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_2b5f43b879dc67e10241ce6108fbb8ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_9739f0999dc7e24e04baf221f080cc13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_91fe72e4e0a7d4c97d6280e912286278.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_6c1d6dc645a63645647fbb5a6573209f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_feed5b3a8dc61b495f4965aa1618326f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_76c857da-0083-5743-824d-34226ee87fc2/76c857da-0083-5743-824d-34226ee87fc2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/33/9033b0a8da31c8aadafa9fc851367910/pa/XY25635_ff13d71cd436d31c8920a783238b4890.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2023-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure Business',
'transmission': 'manual',
'trim': 'Allure Business',
'year': 2023}
2026-04-27 08:10:16 [auto1.es] INFO: Saving data for XY25635: {'created_time': 1777277416.691953, 'last_price_update_time': 1777277416.691965, 'has_photos': True, 'auction_closing_time': 1777302227.0}
2026-04-27 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_b8b4340bb3dd9defe0b5945e51805385.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_543bdeb5825ae9d5ed9fd589849b012b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c0990>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_2d06f4bf47f94bd927e3d5b4953b92bc.jpg saved to cache
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048522c90>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_3ae883aeff158654174fa7e97ab6a4f9.jpg saved to cache
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487acb10>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_b8b4340bb3dd9defe0b5945e51805385.jpg saved to cache
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057218410>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_543bdeb5825ae9d5ed9fd589849b012b.jpg saved to cache
2026-04-27 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_71513ad3e295dcd05bd6a9d3552623c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_51a245e95bc7b19c1fc772f76fe8eb72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048768210>
2026-04-27 08:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_71513ad3e295dcd05bd6a9d3552623c8.jpg saved to cache
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_eb3000deb696b27e2e68b535ec4d3f1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_22f909c46e187c25e91c08b3588be79b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a96010>
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_51a245e95bc7b19c1fc772f76fe8eb72.jpg saved to cache
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_01d91db875b89ca325864cb3b14c2c78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ac6d0>
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_eb3000deb696b27e2e68b535ec4d3f1d.jpg saved to cache
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0588e1350>
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_22f909c46e187c25e91c08b3588be79b.jpg saved to cache
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb
2026-04-27 08:10:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb, skipping ID generation
2026-04-27 08:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with scrape type 1
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb sending to next pipeline
2026-04-27 08:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb, identifier: YK45669
2026-04-27 08:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669
2026-04-27 08:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669
2026-04-27 08:10:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669 to the API
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_22f909c46e187c25e91c08b3588be79b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': 'Rental',
'city': 'Madrid',
'color': 'gold',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:49:52Z',
'fuel_type': 'petrol',
'id': '7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK45669',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'MINI',
'model': 'MINI',
'odometer': 64930,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_22f909c46e187c25e91c08b3588be79b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_eb3000deb696b27e2e68b535ec4d3f1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_51a245e95bc7b19c1fc772f76fe8eb72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_71513ad3e295dcd05bd6a9d3552623c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_b8b4340bb3dd9defe0b5945e51805385.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_543bdeb5825ae9d5ed9fd589849b012b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_2d06f4bf47f94bd927e3d5b4953b92bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_3ae883aeff158654174fa7e97ab6a4f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_8507a8175bf431e64ab0465694a86503.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb/7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/e5/34e5ed93908da2436724121d6f6655da/pa/YK45669_9ad8c37a7476baf0e3c84271cd032753.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2008-02-13',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 08:10:17 [auto1.es] INFO: Saving data for YK45669: {'created_time': 1777277417.647552, 'last_price_update_time': 1777277417.647561, 'has_photos': True, 'auction_closing_time': 1777304992.0}
2026-04-27 08:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_b7655c88cffff915f6c556218f583d52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057230210>
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_01d91db875b89ca325864cb3b14c2c78.jpg saved to cache
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 08:10:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.993(s), this was the 1st time calling it.
2026-04-27 08:10:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.925744534435361 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048677850>
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_b7655c88cffff915f6c556218f583d52.jpg saved to cache
2026-04-27 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_990ce2a80cbd8eddd3441dfdc382b090.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048497ed0>
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_990ce2a80cbd8eddd3441dfdc382b090.jpg saved to cache
2026-04-27 08:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_453ff1966c734b762ce8a733ec692268.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_b578b474ebc8d3f6d175a5e362864058.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048591690>
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_453ff1966c734b762ce8a733ec692268.jpg saved to cache
2026-04-27 08:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a95f50>
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_b578b474ebc8d3f6d175a5e362864058.jpg saved to cache
2026-04-27 08:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT69557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_ac2dfea885ac13a040eedcd493dc1114.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048593f90>
2026-04-27 08:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_ac2dfea885ac13a040eedcd493dc1114.jpg saved to cache
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU29040> (referer: https://www.auto1.com/v1/car-details-view/WU29040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_277265dd1e8d3842eb47bff2da1d3ff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98e61b9-194e-5fff-b399-9f145fa2577f with identifier: WU29040
2026-04-27 08:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98e61b9-194e-5fff-b399-9f145fa2577f with scrape type 1
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_dd30f4bcadc9e956e1f9101da043ace2.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_aea49dbd6f3b06efe0000cf318b351d6.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_75aadad62ec2eb28ab76cf7558e021b5.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_f3c15c6ff3755aca89c9796cde0c3b0e.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e969cde53260333fba0c9d783e07f4b0.jpg not downloaded yet
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048497310>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_277265dd1e8d3842eb47bff2da1d3ff0.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a34bdf05795659b579a8fc9decdc6a9f.jpg not downloaded yet
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_96d85a4604102042e2e1e97eb68d05b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_00bf48fa94fa9c4d024eeba4f133cfe6.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e7d2ff22095d12cd5dd024cdfb42e9c6.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a17a183574f9bf6705b4a4cd3abf0b4b.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_225bab4aec8444ea945578fc6f044fc1.jpg not downloaded yet
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04896a6d0>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcb7d46-17b3-5132-9967-57de711375b1/7dcb7d46-17b3-5132-9967-57de711375b1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/ac/9cac06c57371518db93b5588bb5543f6/pa/AT34418_96d85a4604102042e2e1e97eb68d05b2.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dcb7d46-17b3-5132-9967-57de711375b1
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a34bdf05795659b579a8fc9decdc6a9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_225bab4aec8444ea945578fc6f044fc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b12d0>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a34bdf05795659b579a8fc9decdc6a9f.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872dc50>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_225bab4aec8444ea945578fc6f044fc1.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a17a183574f9bf6705b4a4cd3abf0b4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e9110>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a17a183574f9bf6705b4a4cd3abf0b4b.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e7d2ff22095d12cd5dd024cdfb42e9c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_00bf48fa94fa9c4d024eeba4f133cfe6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:10:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:10:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484e99d0>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e7d2ff22095d12cd5dd024cdfb42e9c6.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04872d250>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_00bf48fa94fa9c4d024eeba4f133cfe6.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e969cde53260333fba0c9d783e07f4b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_f3c15c6ff3755aca89c9796cde0c3b0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048968810>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e969cde53260333fba0c9d783e07f4b0.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048859890>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_f3c15c6ff3755aca89c9796cde0c3b0e.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_75aadad62ec2eb28ab76cf7558e021b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f9090>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_75aadad62ec2eb28ab76cf7558e021b5.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_dd30f4bcadc9e956e1f9101da043ace2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2044 | hits on page: 40
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: CS83553
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for CS83553: 0
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: ZB84973
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for ZB84973: 0
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: SR20555
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for SR20555: 0
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: TW94312
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for TW94312: 0
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: TF99464
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for TF99464: 0
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: NP54958
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: LN52681
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for LN52681: 0
2026-04-27 08:10:21 [auto1.es] INFO: Found listing with ID: JE22210
2026-04-27 08:10:21 [auto1.es] INFO: Scrape type for JE22210: 2
2026-04-27 08:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210
2026-04-27 08:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414f79f0-30ba-524e-b0f3-d3cfead89651 with scrape type 2
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414f79f0-30ba-524e-b0f3-d3cfead89651 with scrape type 2
2026-04-27 08:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 414f79f0-30ba-524e-b0f3-d3cfead89651, identifier: JE22210
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_d583d235ba9304fcfc9ff0fab24659a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_aea49dbd6f3b06efe0000cf318b351d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210
2026-04-27 08:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210
2026-04-27 08:10:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 414f79f0-30ba-524e-b0f3-d3cfead89651 with identifier: JE22210 to the API
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-04-27T15:07:30Z',
'fuel_type': 'petrol',
'id': '414f79f0-30ba-524e-b0f3-d3cfead89651',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE22210',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '208',
'odometer': 144604,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-02-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-04-27 08:10:22 [auto1.es] INFO: Saving data for JE22210: {'auction_closing_time': 1777302450.0, 'created_time': 1777021950.708462, 'has_photos': True, 'last_price_update_time': 1777277422.113908}
2026-04-27 08:10:22 [auto1.es] INFO: Found listing with ID: BC92412
2026-04-27 08:10:22 [auto1.es] INFO: Scrape type for BC92412: 1
2026-04-27 08:10:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:10:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b8a10>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_dd30f4bcadc9e956e1f9101da043ace2.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:22 [auto1.es] INFO: Found listing with ID: VE43460
2026-04-27 08:10:22 [auto1.es] INFO: Scrape type for VE43460: 1
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a7210>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1b83fb-901f-5566-b3d1-8b407e6e50bd/3b1b83fb-901f-5566-b3d1-8b407e6e50bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/7c/3c7c9186e0f570de8d304d8bbfe0938c/pa/SK85653_d583d235ba9304fcfc9ff0fab24659a3.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b1b83fb-901f-5566-b3d1-8b407e6e50bd
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048968d10>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_aea49dbd6f3b06efe0000cf318b351d6.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b98e61b9-194e-5fff-b399-9f145fa2577f
2026-04-27 08:10:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b98e61b9-194e-5fff-b399-9f145fa2577f, skipping ID generation
2026-04-27 08:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98e61b9-194e-5fff-b399-9f145fa2577f with scrape type 1
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b98e61b9-194e-5fff-b399-9f145fa2577f sending to next pipeline
2026-04-27 08:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b98e61b9-194e-5fff-b399-9f145fa2577f, identifier: WU29040
2026-04-27 08:10:22 [auto1.es] INFO: Found listing with ID: DD46195
2026-04-27 08:10:22 [auto1.es] INFO: Scrape type for DD46195: 2
2026-04-27 08:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195
2026-04-27 08:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9410c0cb-0471-58d9-a676-cadee62c927e with scrape type 2
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9410c0cb-0471-58d9-a676-cadee62c927e with scrape type 2
2026-04-27 08:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9410c0cb-0471-58d9-a676-cadee62c927e, identifier: DD46195
2026-04-27 08:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b98e61b9-194e-5fff-b399-9f145fa2577f with identifier: WU29040
2026-04-27 08:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b98e61b9-194e-5fff-b399-9f145fa2577f with identifier: WU29040
2026-04-27 08:10:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b98e61b9-194e-5fff-b399-9f145fa2577f with identifier: WU29040 to the API
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_aea49dbd6f3b06efe0000cf318b351d6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'city': 'Madrid',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-04-27T15:30:10Z',
'fuel_type': 'diesel',
'id': 'b98e61b9-194e-5fff-b399-9f145fa2577f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU29040',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 175433,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534488,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_dd30f4bcadc9e956e1f9101da043ace2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_aea49dbd6f3b06efe0000cf318b351d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_75aadad62ec2eb28ab76cf7558e021b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_f3c15c6ff3755aca89c9796cde0c3b0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e969cde53260333fba0c9d783e07f4b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a34bdf05795659b579a8fc9decdc6a9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_00bf48fa94fa9c4d024eeba4f133cfe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547173,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_e7d2ff22095d12cd5dd024cdfb42e9c6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_a17a183574f9bf6705b4a4cd3abf0b4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b98e61b9-194e-5fff-b399-9f145fa2577f/b98e61b9-194e-5fff-b399-9f145fa2577f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/41/f4419ef75b3fb873d35258f923ece573/pa/WU29040_225bab4aec8444ea945578fc6f044fc1.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2013-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 250 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2013}
2026-04-27 08:10:22 [auto1.es] INFO: Saving data for WU29040: {'created_time': 1777277422.942654, 'last_price_update_time': 1777277422.942668, 'has_photos': True, 'auction_closing_time': 1777303810.0}
2026-04-27 08:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195
2026-04-27 08:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195
2026-04-27 08:10:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195 to the API
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:10:06Z',
'fuel_type': 'petrol',
'id': '9410c0cb-0471-58d9-a676-cadee62c927e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD46195',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 82937,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-07-26',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.5 TSI ACT Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2018}
2026-04-27 08:10:23 [auto1.es] INFO: Saving data for DD46195: {'auction_closing_time': 1777302606.0, 'created_time': 1777018060.612645, 'has_photos': True, 'last_price_update_time': 1777277423.228917}
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: AS83743
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for AS83743: 1
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: MD94858
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for MD94858: 2
2026-04-27 08:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c5c7238-0a63-5f1b-b9f8-646712e4922c with identifier: MD94858
2026-04-27 08:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c5c7238-0a63-5f1b-b9f8-646712e4922c with scrape type 2
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c5c7238-0a63-5f1b-b9f8-646712e4922c with scrape type 2
2026-04-27 08:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c5c7238-0a63-5f1b-b9f8-646712e4922c, identifier: MD94858
2026-04-27 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c5c7238-0a63-5f1b-b9f8-646712e4922c with identifier: MD94858
2026-04-27 08:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c5c7238-0a63-5f1b-b9f8-646712e4922c with identifier: MD94858
2026-04-27 08:10:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c5c7238-0a63-5f1b-b9f8-646712e4922c with identifier: MD94858 to the API
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:24:48Z',
'fuel_type': 'diesel',
'id': '5c5c7238-0a63-5f1b-b9f8-646712e4922c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD94858',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 143802,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-12-15',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2016}
2026-04-27 08:10:23 [auto1.es] INFO: Saving data for MD94858: {'auction_closing_time': 1777303488.0, 'created_time': 1776940863.663104, 'has_photos': True, 'last_price_update_time': 1777277423.749364}
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: EH99020
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for EH99020: 1
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: TU26996
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for TU26996: 1
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: GT62572
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for GT62572: 1
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: WU73148
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for WU73148: 1
2026-04-27 08:10:23 [auto1.es] INFO: Found listing with ID: FE11610
2026-04-27 08:10:23 [auto1.es] INFO: Scrape type for FE11610: 2
2026-04-27 08:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb49d884-772b-5abb-84cd-e53357351bbf with identifier: FE11610
2026-04-27 08:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb49d884-772b-5abb-84cd-e53357351bbf with scrape type 2
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb49d884-772b-5abb-84cd-e53357351bbf with scrape type 2
2026-04-27 08:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb49d884-772b-5abb-84cd-e53357351bbf, identifier: FE11610
2026-04-27 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb49d884-772b-5abb-84cd-e53357351bbf with identifier: FE11610
2026-04-27 08:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb49d884-772b-5abb-84cd-e53357351bbf with identifier: FE11610
2026-04-27 08:10:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb49d884-772b-5abb-84cd-e53357351bbf with identifier: FE11610 to the API
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:09:26Z',
'fuel_type': 'diesel',
'id': 'bb49d884-772b-5abb-84cd-e53357351bbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE11610',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 293043,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-11-18',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2002}
2026-04-27 08:10:24 [auto1.es] INFO: Saving data for FE11610: {'auction_closing_time': 1777302566.0, 'created_time': 1777018056.841773, 'has_photos': True, 'last_price_update_time': 1777277424.263453}
2026-04-27 08:10:24 [auto1.es] INFO: Found listing with ID: XN25285
2026-04-27 08:10:24 [auto1.es] INFO: Scrape type for XN25285: 1
2026-04-27 08:10:24 [auto1.es] INFO: Found listing with ID: WB45679
2026-04-27 08:10:24 [auto1.es] INFO: Scrape type for WB45679: 2
2026-04-27 08:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddfe59ee-b86a-5a9c-836a-ae3a57cdae75 with identifier: WB45679
2026-04-27 08:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddfe59ee-b86a-5a9c-836a-ae3a57cdae75 with scrape type 2
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddfe59ee-b86a-5a9c-836a-ae3a57cdae75 with scrape type 2
2026-04-27 08:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ddfe59ee-b86a-5a9c-836a-ae3a57cdae75, identifier: WB45679
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX26645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ddfe59ee-b86a-5a9c-836a-ae3a57cdae75 with identifier: WB45679
2026-04-27 08:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ddfe59ee-b86a-5a9c-836a-ae3a57cdae75 with identifier: WB45679
2026-04-27 08:10:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ddfe59ee-b86a-5a9c-836a-ae3a57cdae75 with identifier: WB45679 to the API
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:18:34Z',
'fuel_type': 'diesel',
'id': 'ddfe59ee-b86a-5a9c-836a-ae3a57cdae75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB45679',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 242651,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2017}
2026-04-27 08:10:24 [auto1.es] INFO: Saving data for WB45679: {'auction_closing_time': 1777303114.0, 'created_time': 1777018537.179711, 'has_photos': True, 'last_price_update_time': 1777277424.725168}
2026-04-27 08:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:24 [auto1.es] INFO: Found listing with ID: KS57327
2026-04-27 08:10:24 [auto1.es] INFO: Scrape type for KS57327: 1
2026-04-27 08:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:10:24 [auto1.es] INFO: Found listing with ID: YW75057
2026-04-27 08:10:24 [auto1.es] INFO: Scrape type for YW75057: 2
2026-04-27 08:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057
2026-04-27 08:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0cfcee-9439-58a3-85e7-7044486801ac with scrape type 2
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e0cfcee-9439-58a3-85e7-7044486801ac with scrape type 2
2026-04-27 08:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e0cfcee-9439-58a3-85e7-7044486801ac, identifier: YW75057
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX79689> (referer: https://www.auto1.com/v1/car-details-view/WX79689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057
2026-04-27 08:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057
2026-04-27 08:10:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e0cfcee-9439-58a3-85e7-7044486801ac with identifier: YW75057 to the API
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:58:41Z',
'fuel_type': 'petrol',
'id': '4e0cfcee-9439-58a3-85e7-7044486801ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW75057',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Zafira',
'odometer': 175187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-02-24',
'seller_name': None,
'title': 'Opel Zafira 1.6 Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2009}
2026-04-27 08:10:25 [auto1.es] INFO: Saving data for YW75057: {'auction_closing_time': 1777305521.0, 'created_time': 1777019140.250207, 'has_photos': True, 'last_price_update_time': 1777277425.280782}
2026-04-27 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:25 [auto1.es] INFO: Found listing with ID: UL42245
2026-04-27 08:10:25 [auto1.es] INFO: Scrape type for UL42245: 2
2026-04-27 08:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 524e47b3-b4e7-57ae-a770-f8e76a5215a7 with identifier: UL42245
2026-04-27 08:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 524e47b3-b4e7-57ae-a770-f8e76a5215a7 with scrape type 2
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 524e47b3-b4e7-57ae-a770-f8e76a5215a7 with scrape type 2
2026-04-27 08:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 524e47b3-b4e7-57ae-a770-f8e76a5215a7, identifier: UL42245
2026-04-27 08:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 524e47b3-b4e7-57ae-a770-f8e76a5215a7 with identifier: UL42245
2026-04-27 08:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 524e47b3-b4e7-57ae-a770-f8e76a5215a7 with identifier: UL42245
2026-04-27 08:10:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 524e47b3-b4e7-57ae-a770-f8e76a5215a7 with identifier: UL42245 to the API
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:39:17Z',
'fuel_type': 'petrol',
'id': '524e47b3-b4e7-57ae-a770-f8e76a5215a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL42245',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'V40',
'odometer': 254465,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '1999-09-13',
'seller_name': None,
'title': 'Volvo V40 1.6',
'transmission': 'manual',
'trim': '',
'year': 1999}
2026-04-27 08:10:25 [auto1.es] INFO: Saving data for UL42245: {'auction_closing_time': 1777304357.0, 'created_time': 1777018418.330901, 'has_photos': True, 'last_price_update_time': 1777277425.675353}
2026-04-27 08:10:25 [auto1.es] INFO: Found listing with ID: GW85865
2026-04-27 08:10:25 [auto1.es] INFO: Scrape type for GW85865: 2
2026-04-27 08:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59c6d95a-670e-5da5-8994-be5882e0c22a with identifier: GW85865
2026-04-27 08:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c6d95a-670e-5da5-8994-be5882e0c22a with scrape type 2
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59c6d95a-670e-5da5-8994-be5882e0c22a with scrape type 2
2026-04-27 08:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 59c6d95a-670e-5da5-8994-be5882e0c22a, identifier: GW85865
2026-04-27 08:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 59c6d95a-670e-5da5-8994-be5882e0c22a with identifier: GW85865
2026-04-27 08:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 59c6d95a-670e-5da5-8994-be5882e0c22a with identifier: GW85865
2026-04-27 08:10:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 59c6d95a-670e-5da5-8994-be5882e0c22a with identifier: GW85865 to the API
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 193,
'expiration_date': '2026-04-27T15:12:20Z',
'fuel_type': 'petrol',
'id': '59c6d95a-670e-5da5-8994-be5882e0c22a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW85865',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Chevrolet',
'model': 'Camaro',
'odometer': 216645,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2001-12-20',
'seller_name': None,
'title': 'Chevrolet Camaro 3.8 V6 Coupe',
'transmission': 'automatic',
'trim': 'Coupe',
'year': 2001}
2026-04-27 08:10:26 [auto1.es] INFO: Saving data for GW85865: {'auction_closing_time': 1777302740.0, 'created_time': 1777018235.385177, 'has_photos': True, 'last_price_update_time': 1777277426.097796}
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15582ed8-9fec-550c-a928-3dc27baadd1a with identifier: WX79689
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15582ed8-9fec-550c-a928-3dc27baadd1a with scrape type 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15582ed8-9fec-550c-a928-3dc27baadd1a
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_7f11a164218e7b7eeb87771f6ec69a4f.jpg not downloaded yet
2026-04-27 08:10:26 [auto1.es] INFO: Found listing with ID: JF84968
2026-04-27 08:10:26 [auto1.es] INFO: Scrape type for JF84968: 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_a8a6526c620942fbc5999332d982f441.jpg not downloaded yet
2026-04-27 08:10:26 [auto1.es] INFO: Found listing with ID: AD24275
2026-04-27 08:10:26 [auto1.es] INFO: Scrape type for AD24275: 2
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071696d2-2c86-53f3-a598-7b8ac52bd41a with identifier: AD24275
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071696d2-2c86-53f3-a598-7b8ac52bd41a with scrape type 2
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071696d2-2c86-53f3-a598-7b8ac52bd41a with scrape type 2
2026-04-27 08:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 071696d2-2c86-53f3-a598-7b8ac52bd41a, identifier: AD24275
2026-04-27 08:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 071696d2-2c86-53f3-a598-7b8ac52bd41a with identifier: AD24275
2026-04-27 08:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 071696d2-2c86-53f3-a598-7b8ac52bd41a with identifier: AD24275
2026-04-27 08:10:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 071696d2-2c86-53f3-a598-7b8ac52bd41a with identifier: AD24275 to the API
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:19:47Z',
'fuel_type': 'petrol',
'id': '071696d2-2c86-53f3-a598-7b8ac52bd41a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD24275',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'Countryman',
'odometer': 134951,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-03-13',
'seller_name': None,
'title': 'MINI Countryman Cooper S ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2016}
2026-04-27 08:10:26 [auto1.es] INFO: Saving data for AD24275: {'auction_closing_time': 1777303187.0, 'created_time': 1777018304.618941, 'has_photos': True, 'last_price_update_time': 1777277426.608723}
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_99bafd0914c46aa687c27858a88cff97.jpg not downloaded yet
2026-04-27 08:10:26 [auto1.es] INFO: Found listing with ID: GG74327
2026-04-27 08:10:26 [auto1.es] INFO: Scrape type for GG74327: 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_60840b5635841a369995d8083690f763.jpg not downloaded yet
2026-04-27 08:10:26 [auto1.es] INFO: Found listing with ID: WH36858
2026-04-27 08:10:26 [auto1.es] INFO: Scrape type for WH36858: 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_5d8e93a6dd4831207582244642f09a29.jpg not downloaded yet
2026-04-27 08:10:26 [auto1.es] INFO: Found listing with ID: SL46390
2026-04-27 08:10:26 [auto1.es] INFO: Scrape type for SL46390: 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_1e51cd96f57ba61e84bb41cd98343c42.jpg not downloaded yet
2026-04-27 08:10:26 [auto1.es] INFO: Found listing with ID: PD42112
2026-04-27 08:10:26 [auto1.es] INFO: Scrape type for PD42112: 2
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35acd034-091c-56f5-b0bb-8bd0f3fff11d with identifier: PD42112
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35acd034-091c-56f5-b0bb-8bd0f3fff11d with scrape type 2
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35acd034-091c-56f5-b0bb-8bd0f3fff11d with scrape type 2
2026-04-27 08:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35acd034-091c-56f5-b0bb-8bd0f3fff11d, identifier: PD42112
2026-04-27 08:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35acd034-091c-56f5-b0bb-8bd0f3fff11d with identifier: PD42112
2026-04-27 08:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35acd034-091c-56f5-b0bb-8bd0f3fff11d with identifier: PD42112
2026-04-27 08:10:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35acd034-091c-56f5-b0bb-8bd0f3fff11d with identifier: PD42112 to the API
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:53:29Z',
'fuel_type': 'diesel',
'id': '35acd034-091c-56f5-b0bb-8bd0f3fff11d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD42112',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ateca',
'odometer': 129865,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-10-30',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence Edition',
'transmission': 'automatic',
'trim': 'Xcellence Edition',
'year': 2019}
2026-04-27 08:10:27 [auto1.es] INFO: Saving data for PD42112: {'auction_closing_time': 1777305209.0, 'created_time': 1777020654.417237, 'has_photos': True, 'last_price_update_time': 1777277427.151983}
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_fa10e9ac377f1a22b157aab4a8680e2e.jpg not downloaded yet
2026-04-27 08:10:27 [auto1.es] INFO: Found listing with ID: MX01380
2026-04-27 08:10:27 [auto1.es] INFO: Scrape type for MX01380: 1
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_d30e0efcfdfbdbff2b6aa83a4901e92a.jpg not downloaded yet
2026-04-27 08:10:27 [auto1.es] INFO: Found listing with ID: PZ80848
2026-04-27 08:10:27 [auto1.es] INFO: Scrape type for PZ80848: 1
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH04096> (referer: https://www.auto1.com/v1/car-details-view/EH04096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_a42f305b67ec6a6bb9d1f70e04fe89e2.jpg not downloaded yet
2026-04-27 08:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:27 [auto1.es] INFO: Found listing with ID: YY88672
2026-04-27 08:10:27 [auto1.es] INFO: Scrape type for YY88672: 2
2026-04-27 08:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672
2026-04-27 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fa713d-c99e-56ea-acde-52ecd7c71731 with scrape type 2
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91fa713d-c99e-56ea-acde-52ecd7c71731 with scrape type 2
2026-04-27 08:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91fa713d-c99e-56ea-acde-52ecd7c71731, identifier: YY88672
2026-04-27 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672
2026-04-27 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672
2026-04-27 08:10:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91fa713d-c99e-56ea-acde-52ecd7c71731 with identifier: YY88672 to the API
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 220,
'expiration_date': '2026-04-27T15:29:36Z',
'fuel_type': 'petrol',
'id': '91fa713d-c99e-56ea-acde-52ecd7c71731',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY88672',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Lexus',
'model': 'GS-Serie',
'odometer': 205601,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-07-11',
'seller_name': None,
'title': 'Lexus GS-Serie GS 300',
'transmission': 'automatic',
'trim': '',
'year': 2004}
2026-04-27 08:10:27 [auto1.es] INFO: Saving data for YY88672: {'auction_closing_time': 1777303776.0, 'created_time': 1777020970.236895, 'has_photos': True, 'last_price_update_time': 1777277427.730353}
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/09/a6098fed75786c4148e9bc3b756654a0/pa/WX79689_481146ce96ab200faa66df82a208afbe.jpg not downloaded yet
2026-04-27 08:10:27 [auto1.es] INFO: Found listing with ID: ME15018
2026-04-27 08:10:27 [auto1.es] INFO: Scrape type for ME15018: 2
2026-04-27 08:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e00abf3f-34d1-56cb-8fad-f1574298d362 with identifier: ME15018
2026-04-27 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e00abf3f-34d1-56cb-8fad-f1574298d362 with scrape type 2
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e00abf3f-34d1-56cb-8fad-f1574298d362 with scrape type 2
2026-04-27 08:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e00abf3f-34d1-56cb-8fad-f1574298d362, identifier: ME15018
2026-04-27 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e00abf3f-34d1-56cb-8fad-f1574298d362 with identifier: ME15018
2026-04-27 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e00abf3f-34d1-56cb-8fad-f1574298d362 with identifier: ME15018
2026-04-27 08:10:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e00abf3f-34d1-56cb-8fad-f1574298d362 with identifier: ME15018 to the API
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:54:54Z',
'fuel_type': 'diesel',
'id': 'e00abf3f-34d1-56cb-8fad-f1574298d362',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME15018',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Transit',
'odometer': 169905,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-09',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Kombi',
'transmission': 'manual',
'trim': 'Kombi',
'year': 2015}
2026-04-27 08:10:28 [auto1.es] INFO: Saving data for ME15018: {'auction_closing_time': 1777305294.0, 'created_time': 1776940881.989524, 'has_photos': True, 'last_price_update_time': 1777277428.298725}
2026-04-27 08:10:28 [auto1.es] INFO: Found listing with ID: DK66117
2026-04-27 08:10:28 [auto1.es] INFO: Scrape type for DK66117: 2
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa1b68c-73e4-514f-82bc-60a283a0914d with identifier: DK66117
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa1b68c-73e4-514f-82bc-60a283a0914d with scrape type 2
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aa1b68c-73e4-514f-82bc-60a283a0914d with scrape type 2
2026-04-27 08:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2aa1b68c-73e4-514f-82bc-60a283a0914d, identifier: DK66117
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1dd2ac-6045-57ab-9d42-13006fc7e63a with identifier: EH04096
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1dd2ac-6045-57ab-9d42-13006fc7e63a with scrape type 1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7a1dd2ac-6045-57ab-9d42-13006fc7e63a
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_e152ec4be59078c01a4c1e50b29ab61c.jpg not downloaded yet
2026-04-27 08:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2aa1b68c-73e4-514f-82bc-60a283a0914d with identifier: DK66117
2026-04-27 08:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2aa1b68c-73e4-514f-82bc-60a283a0914d with identifier: DK66117
2026-04-27 08:10:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2aa1b68c-73e4-514f-82bc-60a283a0914d with identifier: DK66117 to the API
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 392,
'expiration_date': '2026-04-27T15:28:16Z',
'fuel_type': 'hybrid',
'id': '2aa1b68c-73e4-514f-82bc-60a283a0914d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK66117',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'V90',
'odometer': 205409,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-05-07',
'seller_name': None,
'title': 'Volvo V90 2.0 T8 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2020}
2026-04-27 08:10:28 [auto1.es] INFO: Saving data for DK66117: {'auction_closing_time': 1777303696.0, 'created_time': 1777020406.840164, 'has_photos': True, 'last_price_update_time': 1777277428.788645}
2026-04-27 08:10:28 [auto1.es] INFO: Found listing with ID: AD26196
2026-04-27 08:10:28 [auto1.es] INFO: Scrape type for AD26196: 2
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd61a5f-9a83-5578-937a-024b10e89651 with identifier: AD26196
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd61a5f-9a83-5578-937a-024b10e89651 with scrape type 2
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dd61a5f-9a83-5578-937a-024b10e89651 with scrape type 2
2026-04-27 08:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5dd61a5f-9a83-5578-937a-024b10e89651, identifier: AD26196
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_63817fd6dba16f0c7f71967fbe5e783c.jpg not downloaded yet
2026-04-27 08:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5dd61a5f-9a83-5578-937a-024b10e89651 with identifier: AD26196
2026-04-27 08:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5dd61a5f-9a83-5578-937a-024b10e89651 with identifier: AD26196
2026-04-27 08:10:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5dd61a5f-9a83-5578-937a-024b10e89651 with identifier: AD26196 to the API
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:02:04Z',
'fuel_type': 'diesel',
'id': '5dd61a5f-9a83-5578-937a-024b10e89651',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD26196',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T5 Caravelle',
'odometer': 166804,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-09-15',
'seller_name': None,
'title': 'Volkswagen T5 Caravelle 2.0 TDI Comfortline lang',
'transmission': 'automatic',
'trim': 'Comfortline lang',
'year': 2013}
2026-04-27 08:10:29 [auto1.es] INFO: Saving data for AD26196: {'auction_closing_time': 1777302124.0, 'created_time': 1777020752.584068, 'has_photos': True, 'last_price_update_time': 1777277429.48339}
2026-04-27 08:10:29 [auto1.es] INFO: Found listing with ID: GS59637
2026-04-27 08:10:29 [auto1.es] INFO: Scrape type for GS59637: 2
2026-04-27 08:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeec151b-206c-537d-92e0-1269c0bd907b with identifier: GS59637
2026-04-27 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeec151b-206c-537d-92e0-1269c0bd907b with scrape type 2
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeec151b-206c-537d-92e0-1269c0bd907b with scrape type 2
2026-04-27 08:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aeec151b-206c-537d-92e0-1269c0bd907b, identifier: GS59637
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_1afd95e6e72eb850ec70cb090945ec33.jpg not downloaded yet
2026-04-27 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aeec151b-206c-537d-92e0-1269c0bd907b with identifier: GS59637
2026-04-27 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aeec151b-206c-537d-92e0-1269c0bd907b with identifier: GS59637
2026-04-27 08:10:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aeec151b-206c-537d-92e0-1269c0bd907b with identifier: GS59637 to the API
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-04-27T15:21:01Z',
'fuel_type': 'petrol',
'id': 'aeec151b-206c-537d-92e0-1269c0bd907b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS59637',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A6',
'odometer': 170344,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-12-28',
'seller_name': None,
'title': 'Audi A6 2.4 V6',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-04-27 08:10:29 [auto1.es] INFO: Saving data for GS59637: {'auction_closing_time': 1777303261.0, 'created_time': 1777020971.190315, 'has_photos': True, 'last_price_update_time': 1777277429.959878}
2026-04-27 08:10:29 [auto1.es] INFO: Found listing with ID: DW27035
2026-04-27 08:10:29 [auto1.es] INFO: Scrape type for DW27035: 2
2026-04-27 08:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f55e996d-669e-5005-abc7-933b6d4c2e6f with identifier: DW27035
2026-04-27 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55e996d-669e-5005-abc7-933b6d4c2e6f with scrape type 2
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f55e996d-669e-5005-abc7-933b6d4c2e6f with scrape type 2
2026-04-27 08:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f55e996d-669e-5005-abc7-933b6d4c2e6f, identifier: DW27035
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_585af8a62a54bb91d51de271db83a3e7.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f55e996d-669e-5005-abc7-933b6d4c2e6f with identifier: DW27035
2026-04-27 08:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f55e996d-669e-5005-abc7-933b6d4c2e6f with identifier: DW27035
2026-04-27 08:10:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f55e996d-669e-5005-abc7-933b6d4c2e6f with identifier: DW27035 to the API
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:54:03Z',
'fuel_type': 'diesel',
'id': 'f55e996d-669e-5005-abc7-933b6d4c2e6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW27035',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 292103,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-08-17',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2014}
2026-04-27 08:10:30 [auto1.es] INFO: Saving data for DW27035: {'auction_closing_time': 1777305243.0, 'created_time': 1777018230.455745, 'has_photos': True, 'last_price_update_time': 1777277430.478327}
2026-04-27 08:10:30 [auto1.es] INFO: Found listing with ID: BF69534
2026-04-27 08:10:30 [auto1.es] INFO: Scrape type for BF69534: 1
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_e7905d11ad43a31f0dfea60c07cf56e7.jpg not downloaded yet
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW86985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:30 [auto1.es] INFO: Found listing with ID: LN53973
2026-04-27 08:10:30 [auto1.es] INFO: Scrape type for LN53973: 1
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_b0d8d4ac3087b41a3f75dd56c0004e2b.jpg not downloaded yet
2026-04-27 08:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_e7905d11ad43a31f0dfea60c07cf56e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529e50>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1dd2ac-6045-57ab-9d42-13006fc7e63a/7a1dd2ac-6045-57ab-9d42-13006fc7e63a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_e7905d11ad43a31f0dfea60c07cf56e7.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a1dd2ac-6045-57ab-9d42-13006fc7e63a
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD85467> (referer: https://www.auto1.com/v1/car-details-view/WD85467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_b0d8d4ac3087b41a3f75dd56c0004e2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 with identifier: WD85467
2026-04-27 08:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 with scrape type 1
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_3d80e3d73924476b5be3b8a218493777.jpg not downloaded yet
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_808b69e14d2d4e3ef615a913c0463268.jpg not downloaded yet
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_fb2cbae1deb4af4123846c0538fd6329.jpg not downloaded yet
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_ef7959928088ecfb464e48dbd8c8b2f9.jpg not downloaded yet
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT20660> (referer: https://www.auto1.com/v1/car-details-view/AT20660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_0b025fb1a5f27cf0daddae56c3503fde.jpg not downloaded yet
2026-04-27 08:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_c64374c120d729f6237352c3a14efd75.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_862798948d377e739c216d941a2ac094.jpg not downloaded yet
2026-04-27 08:10:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.605(s), this was the 1st time calling it.
2026-04-27 08:10:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.509415592741582 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980750>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1dd2ac-6045-57ab-9d42-13006fc7e63a/7a1dd2ac-6045-57ab-9d42-13006fc7e63a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_b0d8d4ac3087b41a3f75dd56c0004e2b.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a1dd2ac-6045-57ab-9d42-13006fc7e63a
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_5503040b985188ff7b8eb52b271e2587.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_089f1629d2f5e9c78ed1777e3bd0785d.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_4fb9a4aab936ffe8a184243eaa849c0c.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675813b0-733d-59ae-ad39-bab5c4cfda9a with identifier: AT20660
2026-04-27 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675813b0-733d-59ae-ad39-bab5c4cfda9a with scrape type 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_81eeba9a8e8dafd7ef7c7c371b8c6565.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_edbc784719628bc1362a9d07522c9c09.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d335c6a3ce0037c71fe5cb689bc61b0b.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_b4301e56517c1cfc937c66681650ad70.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_0baa61b07e83cd18ffb0c7f351ad8636.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_ef7959928088ecfb464e48dbd8c8b2f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_30bd5667236291a03ea60c3d990f934a.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_2fa5b043c01b8f0654179e783a6e0a59.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d50146bf92e91935c84f6f94c556e511.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_1f1afa5db0051dda3536fe781a9b7dd0.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_5ed0b2e5629251d075eb19fa0bacf3eb.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d0d50>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_ef7959928088ecfb464e48dbd8c8b2f9.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_0baa61b07e83cd18ffb0c7f351ad8636.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cb990>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_0baa61b07e83cd18ffb0c7f351ad8636.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_5ed0b2e5629251d075eb19fa0bacf3eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d3d10>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_5ed0b2e5629251d075eb19fa0bacf3eb.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_1f1afa5db0051dda3536fe781a9b7dd0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC20815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a5e50>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_1f1afa5db0051dda3536fe781a9b7dd0.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d50146bf92e91935c84f6f94c556e511.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_2fa5b043c01b8f0654179e783a6e0a59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841e510>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d50146bf92e91935c84f6f94c556e511.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487efad0>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_2fa5b043c01b8f0654179e783a6e0a59.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_30bd5667236291a03ea60c3d990f934a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851010>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_30bd5667236291a03ea60c3d990f934a.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_b4301e56517c1cfc937c66681650ad70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c0350>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_b4301e56517c1cfc937c66681650ad70.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d335c6a3ce0037c71fe5cb689bc61b0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04848e4d0>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d335c6a3ce0037c71fe5cb689bc61b0b.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_edbc784719628bc1362a9d07522c9c09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_81eeba9a8e8dafd7ef7c7c371b8c6565.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [scrapy.extensions.logstats] INFO: Crawled 597 pages (at 19 pages/min), scraped 684 items (at 29 items/min)
2026-04-27 08:10:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048522150>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_edbc784719628bc1362a9d07522c9c09.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488ef850>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_81eeba9a8e8dafd7ef7c7c371b8c6565.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 675813b0-733d-59ae-ad39-bab5c4cfda9a
2026-04-27 08:10:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 675813b0-733d-59ae-ad39-bab5c4cfda9a, skipping ID generation
2026-04-27 08:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675813b0-733d-59ae-ad39-bab5c4cfda9a with scrape type 1
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 675813b0-733d-59ae-ad39-bab5c4cfda9a sending to next pipeline
2026-04-27 08:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 675813b0-733d-59ae-ad39-bab5c4cfda9a, identifier: AT20660
2026-04-27 08:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 675813b0-733d-59ae-ad39-bab5c4cfda9a with identifier: AT20660
2026-04-27 08:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 675813b0-733d-59ae-ad39-bab5c4cfda9a with identifier: AT20660
2026-04-27 08:10:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 675813b0-733d-59ae-ad39-bab5c4cfda9a with identifier: AT20660 to the API
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_81eeba9a8e8dafd7ef7c7c371b8c6565.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Madrid',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:14:15Z',
'fuel_type': 'petrol',
'id': '675813b0-733d-59ae-ad39-bab5c4cfda9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.4375,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT20660',
'listing': 'auction',
'location': 'ES, Madrid',
'location_confidence': 'geocoded',
'longitude': -2.256,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 112201,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_81eeba9a8e8dafd7ef7c7c371b8c6565.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_edbc784719628bc1362a9d07522c9c09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d335c6a3ce0037c71fe5cb689bc61b0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_b4301e56517c1cfc937c66681650ad70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_0baa61b07e83cd18ffb0c7f351ad8636.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_30bd5667236291a03ea60c3d990f934a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_2fa5b043c01b8f0654179e783a6e0a59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_d50146bf92e91935c84f6f94c556e511.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_1f1afa5db0051dda3536fe781a9b7dd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_675813b0-733d-59ae-ad39-bab5c4cfda9a/675813b0-733d-59ae-ad39-bab5c4cfda9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/58/19589ffb8c20bf68a1e4722ab2a2f343/pa/AT20660_5ed0b2e5629251d075eb19fa0bacf3eb.jpg',
'Width': 800}],
'postal_code': '04810',
'price': 0,
'price_includes_vat': True,
'province': 'Almería',
'province_code': 'ES-AL',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2013-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.4 TSI FR Tech',
'transmission': 'automatic',
'trim': 'FR Tech',
'year': 2013}
2026-04-27 08:10:34 [auto1.es] INFO: Saving data for AT20660: {'created_time': 1777277434.54017, 'last_price_update_time': 1777277434.540182, 'has_photos': True, 'auction_closing_time': 1777302855.0}
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_4fb9a4aab936ffe8a184243eaa849c0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04894fd10>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_4fb9a4aab936ffe8a184243eaa849c0c.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_089f1629d2f5e9c78ed1777e3bd0785d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_5503040b985188ff7b8eb52b271e2587.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ed450>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_089f1629d2f5e9c78ed1777e3bd0785d.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d8290>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_5503040b985188ff7b8eb52b271e2587.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_862798948d377e739c216d941a2ac094.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_c64374c120d729f6237352c3a14efd75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a0c90>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_862798948d377e739c216d941a2ac094.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_0b025fb1a5f27cf0daddae56c3503fde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cb8d0>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_c64374c120d729f6237352c3a14efd75.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_fb2cbae1deb4af4123846c0538fd6329.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048542690>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_0b025fb1a5f27cf0daddae56c3503fde.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d0890>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_fb2cbae1deb4af4123846c0538fd6329.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_808b69e14d2d4e3ef615a913c0463268.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_3d80e3d73924476b5be3b8a218493777.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048840890>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_808b69e14d2d4e3ef615a913c0463268.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04a86c190>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_3d80e3d73924476b5be3b8a218493777.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768
2026-04-27 08:10:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00cba815-5bb3-5d4d-b0ba-1c65b43ec768, skipping ID generation
2026-04-27 08:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 with scrape type 1
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 sending to next pipeline
2026-04-27 08:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00cba815-5bb3-5d4d-b0ba-1c65b43ec768, identifier: WD85467
2026-04-27 08:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 with identifier: WD85467
2026-04-27 08:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 with identifier: WD85467
2026-04-27 08:10:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00cba815-5bb3-5d4d-b0ba-1c65b43ec768 with identifier: WD85467 to the API
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_3d80e3d73924476b5be3b8a218493777.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': 'Rental',
'city': 'Sevilla',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:04:55Z',
'fuel_type': 'diesel',
'id': '00cba815-5bb3-5d4d-b0ba-1c65b43ec768',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD85467',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 175018,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_3d80e3d73924476b5be3b8a218493777.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_808b69e14d2d4e3ef615a913c0463268.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_fb2cbae1deb4af4123846c0538fd6329.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_ef7959928088ecfb464e48dbd8c8b2f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_0b025fb1a5f27cf0daddae56c3503fde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_c64374c120d729f6237352c3a14efd75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_862798948d377e739c216d941a2ac094.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_5503040b985188ff7b8eb52b271e2587.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_089f1629d2f5e9c78ed1777e3bd0785d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_00cba815-5bb3-5d4d-b0ba-1c65b43ec768/00cba815-5bb3-5d4d-b0ba-1c65b43ec768_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/ea/cfea71813a5f0b2184b968d9f96ab64f/pa/WD85467_4fb9a4aab936ffe8a184243eaa849c0c.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2015-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Picasso 1.6 HDi Collection',
'transmission': 'manual',
'trim': 'Collection',
'year': 2015}
2026-04-27 08:10:36 [auto1.es] INFO: Saving data for WD85467: {'created_time': 1777277436.229549, 'last_price_update_time': 1777277436.229558, 'has_photos': True, 'auction_closing_time': 1777302295.0}
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_585af8a62a54bb91d51de271db83a3e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2044 | hits on page: 40
2026-04-27 08:10:38 [auto1.es] INFO: Found listing with ID: FN47404
2026-04-27 08:10:38 [auto1.es] INFO: Scrape type for FN47404: 2
2026-04-27 08:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aeb0161-667c-57e1-b405-580fa75a276b with identifier: FN47404
2026-04-27 08:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aeb0161-667c-57e1-b405-580fa75a276b with scrape type 2
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aeb0161-667c-57e1-b405-580fa75a276b with scrape type 2
2026-04-27 08:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0aeb0161-667c-57e1-b405-580fa75a276b, identifier: FN47404
2026-04-27 08:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0aeb0161-667c-57e1-b405-580fa75a276b with identifier: FN47404
2026-04-27 08:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0aeb0161-667c-57e1-b405-580fa75a276b with identifier: FN47404
2026-04-27 08:10:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0aeb0161-667c-57e1-b405-580fa75a276b with identifier: FN47404 to the API
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:03:59Z',
'fuel_type': 'diesel',
'id': '0aeb0161-667c-57e1-b405-580fa75a276b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN47404',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '308',
'odometer': 118835,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-12-28',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-04-27 08:10:38 [auto1.es] INFO: Saving data for FN47404: {'auction_closing_time': 1777302239.0, 'created_time': 1777021780.981313, 'has_photos': True, 'last_price_update_time': 1777277438.609814}
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_1afd95e6e72eb850ec70cb090945ec33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [auto1.es] INFO: Found listing with ID: LS55149
2026-04-27 08:10:38 [auto1.es] INFO: Scrape type for LS55149: 2
2026-04-27 08:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149
2026-04-27 08:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with scrape type 2
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with scrape type 2
2026-04-27 08:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88, identifier: LS55149
2026-04-27 08:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149
2026-04-27 08:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149
2026-04-27 08:10:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149 to the API
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-04-27T15:54:42Z',
'fuel_type': 'petrol',
'id': 'e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS55149',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '208',
'odometer': 136212,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-08-26',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-04-27 08:10:39 [auto1.es] INFO: Saving data for LS55149: {'auction_closing_time': 1777305282.0, 'created_time': 1777018155.492403, 'has_photos': True, 'last_price_update_time': 1777277439.037678}
2026-04-27 08:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a2a50>
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1dd2ac-6045-57ab-9d42-13006fc7e63a/7a1dd2ac-6045-57ab-9d42-13006fc7e63a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_585af8a62a54bb91d51de271db83a3e7.jpg saved to cache
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a1dd2ac-6045-57ab-9d42-13006fc7e63a
2026-04-27 08:10:39 [auto1.es] INFO: Found listing with ID: PF07180
2026-04-27 08:10:39 [auto1.es] INFO: Scrape type for PF07180: 1
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876d710>
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1dd2ac-6045-57ab-9d42-13006fc7e63a/7a1dd2ac-6045-57ab-9d42-13006fc7e63a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/eb/e3ebc45d19ab81193583a155e8e64816/pa/EH04096_1afd95e6e72eb850ec70cb090945ec33.jpg saved to cache
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a1dd2ac-6045-57ab-9d42-13006fc7e63a
2026-04-27 08:10:39 [auto1.es] INFO: Found listing with ID: SU03093
2026-04-27 08:10:39 [auto1.es] INFO: Scrape type for SU03093: 1
2026-04-27 08:10:39 [auto1.es] INFO: Found listing with ID: SS82353
2026-04-27 08:10:39 [auto1.es] INFO: Scrape type for SS82353: 2
2026-04-27 08:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b205b97c-9d5d-575c-a8bb-68cf7d7d3e58 with identifier: SS82353
2026-04-27 08:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b205b97c-9d5d-575c-a8bb-68cf7d7d3e58 with scrape type 2
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b205b97c-9d5d-575c-a8bb-68cf7d7d3e58 with scrape type 2
2026-04-27 08:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b205b97c-9d5d-575c-a8bb-68cf7d7d3e58, identifier: SS82353
2026-04-27 08:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b205b97c-9d5d-575c-a8bb-68cf7d7d3e58 with identifier: SS82353
2026-04-27 08:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b205b97c-9d5d-575c-a8bb-68cf7d7d3e58 with identifier: SS82353
2026-04-27 08:10:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b205b97c-9d5d-575c-a8bb-68cf7d7d3e58 with identifier: SS82353 to the API
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:47:46Z',
'fuel_type': 'diesel',
'id': 'b205b97c-9d5d-575c-a8bb-68cf7d7d3e58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS82353',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 134505,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-04-27 08:10:39 [auto1.es] INFO: Saving data for SS82353: {'auction_closing_time': 1777304866.0, 'created_time': 1777021516.007366, 'has_photos': True, 'last_price_update_time': 1777277439.549431}
2026-04-27 08:10:39 [auto1.es] INFO: Found listing with ID: UV92160
2026-04-27 08:10:39 [auto1.es] INFO: Scrape type for UV92160: 2
2026-04-27 08:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e755e249-92de-547c-a963-6a6b8e63ec65 with identifier: UV92160
2026-04-27 08:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e755e249-92de-547c-a963-6a6b8e63ec65 with scrape type 2
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e755e249-92de-547c-a963-6a6b8e63ec65 with scrape type 2
2026-04-27 08:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e755e249-92de-547c-a963-6a6b8e63ec65, identifier: UV92160
2026-04-27 08:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e755e249-92de-547c-a963-6a6b8e63ec65 with identifier: UV92160
2026-04-27 08:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e755e249-92de-547c-a963-6a6b8e63ec65 with identifier: UV92160
2026-04-27 08:10:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e755e249-92de-547c-a963-6a6b8e63ec65 with identifier: UV92160 to the API
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:57:35Z',
'fuel_type': 'diesel',
'id': 'e755e249-92de-547c-a963-6a6b8e63ec65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV92160',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Altea',
'odometer': 143521,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-06-19',
'seller_name': None,
'title': 'Seat Altea 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2007}
2026-04-27 08:10:40 [auto1.es] INFO: Saving data for UV92160: {'auction_closing_time': 1777305455.0, 'created_time': 1777021930.376396, 'has_photos': True, 'last_price_update_time': 1777277440.030216}
2026-04-27 08:10:40 [auto1.es] INFO: Found listing with ID: MP31569
2026-04-27 08:10:40 [auto1.es] INFO: Scrape type for MP31569: 2
2026-04-27 08:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569
2026-04-27 08:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with scrape type 2
2026-04-27 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with scrape type 2
2026-04-27 08:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd, identifier: MP31569
2026-04-27 08:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569
2026-04-27 08:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569
2026-04-27 08:10:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569 to the API
2026-04-27 08:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:49:12Z',
'fuel_type': 'diesel',
'id': 'f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP31569',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 316866,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'BlueTEC AMG Line',
'year': 2015}
2026-04-27 08:10:40 [auto1.es] INFO: Saving data for MP31569: {'auction_closing_time': 1777304952.0, 'created_time': 1777018092.924484, 'has_photos': True, 'last_price_update_time': 1777277440.429169}
2026-04-27 08:10:40 [auto1.es] INFO: Found listing with ID: EG74552
2026-04-27 08:10:40 [auto1.es] INFO: Scrape type for EG74552: 2
2026-04-27 08:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80890140-ab10-5520-b721-20919074e7fe with identifier: EG74552
2026-04-27 08:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80890140-ab10-5520-b721-20919074e7fe with scrape type 2
2026-04-27 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80890140-ab10-5520-b721-20919074e7fe with scrape type 2
2026-04-27 08:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 80890140-ab10-5520-b721-20919074e7fe, identifier: EG74552
2026-04-27 08:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 80890140-ab10-5520-b721-20919074e7fe with identifier: EG74552
2026-04-27 08:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 80890140-ab10-5520-b721-20919074e7fe with identifier: EG74552
2026-04-27 08:10:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 80890140-ab10-5520-b721-20919074e7fe with identifier: EG74552 to the API
2026-04-27 08:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:54:51Z',
'fuel_type': 'diesel',
'id': '80890140-ab10-5520-b721-20919074e7fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG74552',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 194900,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-02-26',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-04-27 08:10:40 [auto1.es] INFO: Saving data for EG74552: {'auction_closing_time': 1777305291.0, 'created_time': 1777018250.52124, 'has_photos': True, 'last_price_update_time': 1777277440.828217}
2026-04-27 08:10:40 [auto1.es] INFO: Found listing with ID: EX91993
2026-04-27 08:10:40 [auto1.es] INFO: Scrape type for EX91993: 1
2026-04-27 08:10:40 [auto1.es] INFO: Found listing with ID: YX85928
2026-04-27 08:10:40 [auto1.es] INFO: Scrape type for YX85928: 2
2026-04-27 08:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4e3094a-d803-5fc4-a302-fc1b246f06f8 with identifier: YX85928
2026-04-27 08:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4e3094a-d803-5fc4-a302-fc1b246f06f8 with scrape type 2
2026-04-27 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4e3094a-d803-5fc4-a302-fc1b246f06f8 with scrape type 2
2026-04-27 08:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4e3094a-d803-5fc4-a302-fc1b246f06f8, identifier: YX85928
2026-04-27 08:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4e3094a-d803-5fc4-a302-fc1b246f06f8 with identifier: YX85928
2026-04-27 08:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4e3094a-d803-5fc4-a302-fc1b246f06f8 with identifier: YX85928
2026-04-27 08:10:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4e3094a-d803-5fc4-a302-fc1b246f06f8 with identifier: YX85928 to the API
2026-04-27 08:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:33:47Z',
'fuel_type': 'diesel',
'id': 'c4e3094a-d803-5fc4-a302-fc1b246f06f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX85928',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Combo Life',
'odometer': 46926,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-10-23',
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI',
'transmission': 'manual',
'trim': '',
'year': 2022}
2026-04-27 08:10:41 [auto1.es] INFO: Saving data for YX85928: {'auction_closing_time': 1777304027.0, 'created_time': 1777018042.19791, 'has_photos': True, 'last_price_update_time': 1777277441.24694}
2026-04-27 08:10:41 [auto1.es] INFO: Found listing with ID: PX22333
2026-04-27 08:10:41 [auto1.es] INFO: Scrape type for PX22333: 2
2026-04-27 08:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a96c204-a663-57cf-9380-2c4f2108b57b with identifier: PX22333
2026-04-27 08:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a96c204-a663-57cf-9380-2c4f2108b57b with scrape type 2
2026-04-27 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a96c204-a663-57cf-9380-2c4f2108b57b with scrape type 2
2026-04-27 08:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a96c204-a663-57cf-9380-2c4f2108b57b, identifier: PX22333
2026-04-27 08:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a96c204-a663-57cf-9380-2c4f2108b57b with identifier: PX22333
2026-04-27 08:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a96c204-a663-57cf-9380-2c4f2108b57b with identifier: PX22333
2026-04-27 08:10:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a96c204-a663-57cf-9380-2c4f2108b57b with identifier: PX22333 to the API
2026-04-27 08:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:31:51Z',
'fuel_type': 'petrol',
'id': '2a96c204-a663-57cf-9380-2c4f2108b57b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX22333',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Skoda',
'model': 'Fabia',
'odometer': 89342,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-10-25',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Comfort Line',
'transmission': 'manual',
'trim': 'Comfort Line',
'year': 2005}
2026-04-27 08:10:41 [auto1.es] INFO: Saving data for PX22333: {'auction_closing_time': 1777303911.0, 'created_time': 1777020975.160324, 'has_photos': True, 'last_price_update_time': 1777277441.704073}
2026-04-27 08:10:41 [auto1.es] INFO: Found listing with ID: EG02711
2026-04-27 08:10:41 [auto1.es] INFO: Scrape type for EG02711: 1
2026-04-27 08:10:41 [auto1.es] INFO: Found listing with ID: WW30264
2026-04-27 08:10:41 [auto1.es] INFO: Scrape type for WW30264: 1
2026-04-27 08:10:41 [auto1.es] INFO: Found listing with ID: YU54183
2026-04-27 08:10:41 [auto1.es] INFO: Scrape type for YU54183: 2
2026-04-27 08:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce with identifier: YU54183
2026-04-27 08:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce with scrape type 2
2026-04-27 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce with scrape type 2
2026-04-27 08:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce, identifier: YU54183
2026-04-27 08:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce with identifier: YU54183
2026-04-27 08:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce with identifier: YU54183
2026-04-27 08:10:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 176bfef4-d9cb-59e7-8d8a-9eab1794a4ce with identifier: YU54183 to the API
2026-04-27 08:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:30:00Z',
'fuel_type': 'petrol',
'id': '176bfef4-d9cb-59e7-8d8a-9eab1794a4ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU54183',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 81981,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-11-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2012}
2026-04-27 08:10:42 [auto1.es] INFO: Saving data for YU54183: {'auction_closing_time': 1777303800.0, 'created_time': 1777018306.209279, 'has_photos': True, 'last_price_update_time': 1777277442.134646}
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: ZY39357
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for ZY39357: 1
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: KF35009
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for KF35009: 1
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: UN70861
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for UN70861: 2
2026-04-27 08:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf9d8099-b0e8-559c-bb69-2e3e2d17654e with identifier: UN70861
2026-04-27 08:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf9d8099-b0e8-559c-bb69-2e3e2d17654e with scrape type 2
2026-04-27 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf9d8099-b0e8-559c-bb69-2e3e2d17654e with scrape type 2
2026-04-27 08:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf9d8099-b0e8-559c-bb69-2e3e2d17654e, identifier: UN70861
2026-04-27 08:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf9d8099-b0e8-559c-bb69-2e3e2d17654e with identifier: UN70861
2026-04-27 08:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf9d8099-b0e8-559c-bb69-2e3e2d17654e with identifier: UN70861
2026-04-27 08:10:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf9d8099-b0e8-559c-bb69-2e3e2d17654e with identifier: UN70861 to the API
2026-04-27 08:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:47:13Z',
'fuel_type': 'diesel',
'id': 'bf9d8099-b0e8-559c-bb69-2e3e2d17654e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN70861',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 225631,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-07',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2016}
2026-04-27 08:10:42 [auto1.es] INFO: Saving data for UN70861: {'auction_closing_time': 1777304833.0, 'created_time': 1777020494.313831, 'has_photos': True, 'last_price_update_time': 1777277442.550142}
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: RA01776
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for RA01776: 1
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: XF92968
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for XF92968: 1
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: MW04438
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for MW04438: 1
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: EL28751
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for EL28751: 1
2026-04-27 08:10:42 [auto1.es] INFO: Found listing with ID: FE94438
2026-04-27 08:10:42 [auto1.es] INFO: Scrape type for FE94438: 2
2026-04-27 08:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1343a27b-27df-587b-94f7-67d826b4cb0d with identifier: FE94438
2026-04-27 08:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1343a27b-27df-587b-94f7-67d826b4cb0d with scrape type 2
2026-04-27 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1343a27b-27df-587b-94f7-67d826b4cb0d with scrape type 2
2026-04-27 08:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1343a27b-27df-587b-94f7-67d826b4cb0d, identifier: FE94438
2026-04-27 08:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1343a27b-27df-587b-94f7-67d826b4cb0d with identifier: FE94438
2026-04-27 08:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1343a27b-27df-587b-94f7-67d826b4cb0d with identifier: FE94438
2026-04-27 08:10:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1343a27b-27df-587b-94f7-67d826b4cb0d with identifier: FE94438 to the API
2026-04-27 08:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:37:38Z',
'fuel_type': 'diesel',
'id': '1343a27b-27df-587b-94f7-67d826b4cb0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE94438',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Toledo',
'odometer': 212969,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2001-03-21',
'seller_name': None,
'title': 'Seat Toledo 1.9 TDI Stella',
'transmission': 'manual',
'trim': 'Stella',
'year': 2001}
2026-04-27 08:10:43 [auto1.es] INFO: Saving data for FE94438: {'auction_closing_time': 1777304258.0, 'created_time': 1777018055.390772, 'has_photos': True, 'last_price_update_time': 1777277443.104628}
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: LU23034
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for LU23034: 1
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: PC66548
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for PC66548: 2
2026-04-27 08:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6ee6d91-c1b0-53ed-960c-cc7d3c27f661 with identifier: PC66548
2026-04-27 08:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6ee6d91-c1b0-53ed-960c-cc7d3c27f661 with scrape type 2
2026-04-27 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6ee6d91-c1b0-53ed-960c-cc7d3c27f661 with scrape type 2
2026-04-27 08:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6ee6d91-c1b0-53ed-960c-cc7d3c27f661, identifier: PC66548
2026-04-27 08:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6ee6d91-c1b0-53ed-960c-cc7d3c27f661 with identifier: PC66548
2026-04-27 08:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6ee6d91-c1b0-53ed-960c-cc7d3c27f661 with identifier: PC66548
2026-04-27 08:10:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6ee6d91-c1b0-53ed-960c-cc7d3c27f661 with identifier: PC66548 to the API
2026-04-27 08:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-04-27T15:45:26Z',
'fuel_type': 'petrol',
'id': 'd6ee6d91-c1b0-53ed-960c-cc7d3c27f661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC66548',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Puma',
'odometer': 82729,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-08-27',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2023}
2026-04-27 08:10:43 [auto1.es] INFO: Saving data for PC66548: {'auction_closing_time': 1777304726.0, 'created_time': 1777021601.535723, 'has_photos': True, 'last_price_update_time': 1777277443.534127}
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: VR61452
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for VR61452: 1
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: ZG27045
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for ZG27045: 1
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: NW09077
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for NW09077: 1
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: MH40382
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for MH40382: 1
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: FV87391
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for FV87391: 1
2026-04-27 08:10:43 [auto1.es] INFO: Found listing with ID: EN17123
2026-04-27 08:10:43 [auto1.es] INFO: Scrape type for EN17123: 2
2026-04-27 08:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601e9393-87c4-5c7a-9a0c-2c251f5bcdef with identifier: EN17123
2026-04-27 08:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601e9393-87c4-5c7a-9a0c-2c251f5bcdef with scrape type 2
2026-04-27 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601e9393-87c4-5c7a-9a0c-2c251f5bcdef with scrape type 2
2026-04-27 08:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 601e9393-87c4-5c7a-9a0c-2c251f5bcdef, identifier: EN17123
2026-04-27 08:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 601e9393-87c4-5c7a-9a0c-2c251f5bcdef with identifier: EN17123
2026-04-27 08:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 601e9393-87c4-5c7a-9a0c-2c251f5bcdef with identifier: EN17123
2026-04-27 08:10:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 601e9393-87c4-5c7a-9a0c-2c251f5bcdef with identifier: EN17123 to the API
2026-04-27 08:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-04-27T15:18:59Z',
'fuel_type': 'petrol',
'id': '601e9393-87c4-5c7a-9a0c-2c251f5bcdef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN17123',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'B-Max',
'odometer': 132016,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-04-27 08:10:44 [auto1.es] INFO: Saving data for EN17123: {'auction_closing_time': 1777303139.0, 'created_time': 1777021823.941185, 'has_photos': True, 'last_price_update_time': 1777277444.002745}
2026-04-27 08:10:44 [auto1.es] INFO: Found listing with ID: MG43841
2026-04-27 08:10:44 [auto1.es] INFO: Scrape type for MG43841: 1
2026-04-27 08:10:44 [auto1.es] INFO: Found listing with ID: BK29333
2026-04-27 08:10:44 [auto1.es] INFO: Scrape type for BK29333: 2
2026-04-27 08:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602e16f6-b116-5945-85b7-1dc3d0870cea with identifier: BK29333
2026-04-27 08:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602e16f6-b116-5945-85b7-1dc3d0870cea with scrape type 2
2026-04-27 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 602e16f6-b116-5945-85b7-1dc3d0870cea with scrape type 2
2026-04-27 08:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 602e16f6-b116-5945-85b7-1dc3d0870cea, identifier: BK29333
2026-04-27 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA83192/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 602e16f6-b116-5945-85b7-1dc3d0870cea with identifier: BK29333
2026-04-27 08:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 602e16f6-b116-5945-85b7-1dc3d0870cea with identifier: BK29333
2026-04-27 08:10:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 602e16f6-b116-5945-85b7-1dc3d0870cea with identifier: BK29333 to the API
2026-04-27 08:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-04-27T15:18:50Z',
'fuel_type': 'petrol',
'id': '602e16f6-b116-5945-85b7-1dc3d0870cea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK29333',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 43244,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-03-24',
'seller_name': None,
'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2013}
2026-04-27 08:10:44 [auto1.es] INFO: Saving data for BK29333: {'auction_closing_time': 1777303130.0, 'created_time': 1777018618.191842, 'has_photos': True, 'last_price_update_time': 1777277444.486746}
2026-04-27 08:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:44 [auto1.es] INFO: Found listing with ID: FR52387
2026-04-27 08:10:44 [auto1.es] INFO: Scrape type for FR52387: 2
2026-04-27 08:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3 with identifier: FR52387
2026-04-27 08:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3 with scrape type 2
2026-04-27 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3 with scrape type 2
2026-04-27 08:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3, identifier: FR52387
2026-04-27 08:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3 with identifier: FR52387
2026-04-27 08:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3 with identifier: FR52387
2026-04-27 08:10:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3 with identifier: FR52387 to the API
2026-04-27 08:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-04-27T15:16:23Z',
'fuel_type': 'diesel',
'id': '8b7f0cb1-0af6-5bb4-95ee-e2ad035c01b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR52387',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 210339,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-12-29',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
'transmission': 'automatic',
'trim': 'SDV6 HSE',
'year': 2014}
2026-04-27 08:10:44 [auto1.es] INFO: Saving data for FR52387: {'auction_closing_time': 1777302983.0, 'created_time': 1777020445.900384, 'has_photos': True, 'last_price_update_time': 1777277444.88182}
2026-04-27 08:10:44 [auto1.es] INFO: Found listing with ID: YC44772
2026-04-27 08:10:44 [auto1.es] INFO: Scrape type for YC44772: 2
2026-04-27 08:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504e9f45-8900-5456-804c-ffb1faa6d8ce with identifier: YC44772
2026-04-27 08:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504e9f45-8900-5456-804c-ffb1faa6d8ce with scrape type 2
2026-04-27 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504e9f45-8900-5456-804c-ffb1faa6d8ce with scrape type 2
2026-04-27 08:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 504e9f45-8900-5456-804c-ffb1faa6d8ce, identifier: YC44772
2026-04-27 08:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 504e9f45-8900-5456-804c-ffb1faa6d8ce with identifier: YC44772
2026-04-27 08:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 504e9f45-8900-5456-804c-ffb1faa6d8ce with identifier: YC44772
2026-04-27 08:10:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 504e9f45-8900-5456-804c-ffb1faa6d8ce with identifier: YC44772 to the API
2026-04-27 08:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:06:14Z',
'fuel_type': 'diesel',
'id': '504e9f45-8900-5456-804c-ffb1faa6d8ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC44772',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C4',
'odometer': 119747,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-04-26',
'seller_name': None,
'title': 'Citroen C4 1.5 Blue-HDi Live Pack',
'transmission': 'manual',
'trim': 'Live Pack',
'year': 2022}
2026-04-27 08:10:45 [auto1.es] INFO: Saving data for YC44772: {'auction_closing_time': 1777302374.0, 'created_time': 1777021581.021167, 'has_photos': True, 'last_price_update_time': 1777277445.276754}
2026-04-27 08:10:45 [auto1.es] INFO: Found listing with ID: NK46924
2026-04-27 08:10:45 [auto1.es] INFO: Scrape type for NK46924: 1
2026-04-27 08:10:45 [auto1.es] INFO: Found listing with ID: FS39417
2026-04-27 08:10:45 [auto1.es] INFO: Scrape type for FS39417: 1
2026-04-27 08:10:45 [auto1.es] INFO: Found listing with ID: UY97217
2026-04-27 08:10:45 [auto1.es] INFO: Scrape type for UY97217: 2
2026-04-27 08:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f32a740-cadb-5c47-ab54-8f1e7f618dc8 with identifier: UY97217
2026-04-27 08:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f32a740-cadb-5c47-ab54-8f1e7f618dc8 with scrape type 2
2026-04-27 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f32a740-cadb-5c47-ab54-8f1e7f618dc8 with scrape type 2
2026-04-27 08:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f32a740-cadb-5c47-ab54-8f1e7f618dc8, identifier: UY97217
2026-04-27 08:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f32a740-cadb-5c47-ab54-8f1e7f618dc8 with identifier: UY97217
2026-04-27 08:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f32a740-cadb-5c47-ab54-8f1e7f618dc8 with identifier: UY97217
2026-04-27 08:10:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f32a740-cadb-5c47-ab54-8f1e7f618dc8 with identifier: UY97217 to the API
2026-04-27 08:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:34:32Z',
'fuel_type': 'diesel',
'id': '7f32a740-cadb-5c47-ab54-8f1e7f618dc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY97217',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 453359,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-04-29',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-04-27 08:10:45 [auto1.es] INFO: Saving data for UY97217: {'auction_closing_time': 1777304072.0, 'created_time': 1777018153.272375, 'has_photos': True, 'last_price_update_time': 1777277445.727896}
2026-04-27 08:10:45 [auto1.es] INFO: Found listing with ID: XT34146
2026-04-27 08:10:45 [auto1.es] INFO: Scrape type for XT34146: 1
2026-04-27 08:10:45 [auto1.es] INFO: Found listing with ID: EK14215
2026-04-27 08:10:45 [auto1.es] INFO: Scrape type for EK14215: 2
2026-04-27 08:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48dfd028-d388-5c6f-b05e-5926b7e6043f with identifier: EK14215
2026-04-27 08:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48dfd028-d388-5c6f-b05e-5926b7e6043f with scrape type 2
2026-04-27 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48dfd028-d388-5c6f-b05e-5926b7e6043f with scrape type 2
2026-04-27 08:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 48dfd028-d388-5c6f-b05e-5926b7e6043f, identifier: EK14215
2026-04-27 08:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 48dfd028-d388-5c6f-b05e-5926b7e6043f with identifier: EK14215
2026-04-27 08:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 48dfd028-d388-5c6f-b05e-5926b7e6043f with identifier: EK14215
2026-04-27 08:10:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 48dfd028-d388-5c6f-b05e-5926b7e6043f with identifier: EK14215 to the API
2026-04-27 08:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:07:05Z',
'fuel_type': 'petrol',
'id': '48dfd028-d388-5c6f-b05e-5926b7e6043f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK14215',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Meriva',
'odometer': 169150,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-03-18',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-04-27 08:10:46 [auto1.es] INFO: Saving data for EK14215: {'auction_closing_time': 1777302425.0, 'created_time': 1772028110.757316, 'has_photos': False, 'last_price_update_time': 1777277446.179808}
2026-04-27 08:10:46 [auto1.es] INFO: Found listing with ID: BB20751
2026-04-27 08:10:46 [auto1.es] INFO: Scrape type for BB20751: 1
2026-04-27 08:11:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.649(s), this was the 1st time calling it.
2026-04-27 08:11:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.795860984742126 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:33 [scrapy.extensions.logstats] INFO: Crawled 597 pages (at 0 pages/min), scraped 704 items (at 20 items/min)
2026-04-27 08:11:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:11:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.427(s), this was the 1st time calling it.
2026-04-27 08:11:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.696792545008586 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.751(s), this was the 1st time calling it.
2026-04-27 08:11:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.904610827449485 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX99272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP54958> (referer: https://www.auto1.com/v1/car-details-view/NP54958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff052a4-77ef-594a-be66-db7bf3cb42c0 with identifier: NP54958
2026-04-27 08:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0 with scrape type 1
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_f782ce6666ae6ee9ec0181b7bc230587.jpg not downloaded yet
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_1287b932e008eadd7e3e75b0415af07e.jpg not downloaded yet
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_a9be2b8c84cee9b3617dcdda19db4a97.jpg not downloaded yet
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_c430e5252cde24151a42c89378421e1c.jpg not downloaded yet
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_89810d93942c91e318317e9429d15509.jpg not downloaded yet
2026-04-27 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_3683936f4a16075a1564693ad1c4ae0f.jpg not downloaded yet
2026-04-27 08:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ80848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_3683936f4a16075a1564693ad1c4ae0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048983590>
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_3683936f4a16075a1564693ad1c4ae0f.jpg saved to cache
2026-04-27 08:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW86985> (referer: https://www.auto1.com/v1/car-details-view/ZW86985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c07a5f9-9582-5766-8bab-0bd5f25beb27 with identifier: ZW86985
2026-04-27 08:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27 with scrape type 1
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_b66d816c4c2042205de2dd28dd0b0d31.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_6187de399717beedb19c4e3621c759a3.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d8bad0f1e8950b48b897b3047138383c.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_9d220b3f09d18e7bfe2bd813a7264bff.jpg not downloaded yet
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_89810d93942c91e318317e9429d15509.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_caa41fa97f0158c29a76e935c81da747.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_2042789cd64d7fb6223f839764b1badc.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d481db3fc675c0d69f1afb5d3ce10fee.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_84faf6e724e061d9c1eeeb7bff5a8269.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_003d9460fc730e0429e07931ea1cdcba.jpg not downloaded yet
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_e1f4681dcdbbcbbdf1f381f48ef32842.jpg not downloaded yet
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572fa1d0>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_89810d93942c91e318317e9429d15509.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_9d220b3f09d18e7bfe2bd813a7264bff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS57327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c9e10>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_9d220b3f09d18e7bfe2bd813a7264bff.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_e1f4681dcdbbcbbdf1f381f48ef32842.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528250>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_e1f4681dcdbbcbbdf1f381f48ef32842.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_003d9460fc730e0429e07931ea1cdcba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_84faf6e724e061d9c1eeeb7bff5a8269.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5d10>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_003d9460fc730e0429e07931ea1cdcba.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a6650>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_84faf6e724e061d9c1eeeb7bff5a8269.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d481db3fc675c0d69f1afb5d3ce10fee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485256d0>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d481db3fc675c0d69f1afb5d3ce10fee.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_2042789cd64d7fb6223f839764b1badc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485245d0>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_2042789cd64d7fb6223f839764b1badc.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_caa41fa97f0158c29a76e935c81da747.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d0e10>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_caa41fa97f0158c29a76e935c81da747.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d8bad0f1e8950b48b897b3047138383c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841d590>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d8bad0f1e8950b48b897b3047138383c.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_6187de399717beedb19c4e3621c759a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_b66d816c4c2042205de2dd28dd0b0d31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_c430e5252cde24151a42c89378421e1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a3010>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_6187de399717beedb19c4e3621c759a3.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_a9be2b8c84cee9b3617dcdda19db4a97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048769e50>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_b66d816c4c2042205de2dd28dd0b0d31.jpg saved to cache
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27
2026-04-27 08:11:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c07a5f9-9582-5766-8bab-0bd5f25beb27, skipping ID generation
2026-04-27 08:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27 with scrape type 1
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c07a5f9-9582-5766-8bab-0bd5f25beb27 sending to next pipeline
2026-04-27 08:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c07a5f9-9582-5766-8bab-0bd5f25beb27, identifier: ZW86985
2026-04-27 08:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c07a5f9-9582-5766-8bab-0bd5f25beb27 with identifier: ZW86985
2026-04-27 08:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c07a5f9-9582-5766-8bab-0bd5f25beb27 with identifier: ZW86985
2026-04-27 08:11:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c07a5f9-9582-5766-8bab-0bd5f25beb27 with identifier: ZW86985 to the API
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_b66d816c4c2042205de2dd28dd0b0d31.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:26:48Z',
'fuel_type': 'diesel',
'id': '4c07a5f9-9582-5766-8bab-0bd5f25beb27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW86985',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Kangoo',
'odometer': 150612,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_b66d816c4c2042205de2dd28dd0b0d31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_6187de399717beedb19c4e3621c759a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d8bad0f1e8950b48b897b3047138383c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_9d220b3f09d18e7bfe2bd813a7264bff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_caa41fa97f0158c29a76e935c81da747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_2042789cd64d7fb6223f839764b1badc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_d481db3fc675c0d69f1afb5d3ce10fee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_84faf6e724e061d9c1eeeb7bff5a8269.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_003d9460fc730e0429e07931ea1cdcba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c07a5f9-9582-5766-8bab-0bd5f25beb27/4c07a5f9-9582-5766-8bab-0bd5f25beb27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a8/2ea8339b7caebda889484c3c060d3213/pa/ZW86985_e1f4681dcdbbcbbdf1f381f48ef32842.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Profesional',
'transmission': 'manual',
'trim': 'Profesional',
'year': 2021}
2026-04-27 08:11:59 [auto1.es] INFO: Saving data for ZW86985: {'created_time': 1777277519.59, 'last_price_update_time': 1777277519.590012, 'has_photos': True, 'auction_closing_time': 1777303608.0}
2026-04-27 08:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_1287b932e008eadd7e3e75b0415af07e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC20815> (referer: https://www.auto1.com/v1/car-details-view/KC20815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5290>
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_c430e5252cde24151a42c89378421e1c.jpg saved to cache
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529f10>
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_a9be2b8c84cee9b3617dcdda19db4a97.jpg saved to cache
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dfb10>
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_1287b932e008eadd7e3e75b0415af07e.jpg saved to cache
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_f782ce6666ae6ee9ec0181b7bc230587.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e0224f-e788-5c4f-8b3c-bd6cac11529f with identifier: KC20815
2026-04-27 08:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f with scrape type 1
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_f26d6602764c3a148c9301013055c300.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_d2b69ff82be9cae0d554b766483df0fa.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_17d310f713ba2a5c35bff28fda890056.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_b50f6a51131c3f132e554332671c0df9.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_a7e758fb26d869ccf4f985a8c6f21e81.jpg not downloaded yet
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_9680fb6b599e6f5b6e7e98b318ffb87e.jpg not downloaded yet
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048251690>
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_f782ce6666ae6ee9ec0181b7bc230587.jpg saved to cache
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0
2026-04-27 08:11:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ff052a4-77ef-594a-be66-db7bf3cb42c0, skipping ID generation
2026-04-27 08:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0 with scrape type 1
2026-04-27 08:11:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ff052a4-77ef-594a-be66-db7bf3cb42c0 sending to next pipeline
2026-04-27 08:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ff052a4-77ef-594a-be66-db7bf3cb42c0, identifier: NP54958
2026-04-27 08:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ff052a4-77ef-594a-be66-db7bf3cb42c0 with identifier: NP54958
2026-04-27 08:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ff052a4-77ef-594a-be66-db7bf3cb42c0 with identifier: NP54958
2026-04-27 08:12:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ff052a4-77ef-594a-be66-db7bf3cb42c0 with identifier: NP54958 to the API
2026-04-27 08:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_f782ce6666ae6ee9ec0181b7bc230587.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Malaga',
'color': 'gold',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.7L',
'engine_horse_power': 207,
'expiration_date': '2026-04-27T15:45:35Z',
'fuel_type': 'diesel',
'id': '9ff052a4-77ef-594a-be66-db7bf3cb42c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 36.7202,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP54958',
'listing': 'auction',
'location': 'ES, Málaga',
'location_confidence': 'geocoded',
'longitude': -4.4203,
'make': 'Jaguar',
'model': 'S-TYPE',
'odometer': 220781,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_f782ce6666ae6ee9ec0181b7bc230587.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_1287b932e008eadd7e3e75b0415af07e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_a9be2b8c84cee9b3617dcdda19db4a97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_c430e5252cde24151a42c89378421e1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_89810d93942c91e318317e9429d15509.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ff052a4-77ef-594a-be66-db7bf3cb42c0/9ff052a4-77ef-594a-be66-db7bf3cb42c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/b8/58b826ee9f28a847e3eef392f09bfb99/pa/NP54958_3683936f4a16075a1564693ad1c4ae0f.jpg',
'Width': 800}],
'postal_code': '29001',
'price': 0,
'price_includes_vat': True,
'province': 'Málaga',
'province_code': 'ES-MA',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2005-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar S-TYPE 2.7 D V6 Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2005}
2026-04-27 08:12:00 [auto1.es] INFO: Saving data for NP54958: {'created_time': 1777277520.333103, 'last_price_update_time': 1777277520.333115, 'has_photos': True, 'auction_closing_time': 1777304735.0}
2026-04-27 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC16015> (referer: https://www.auto1.com/v1/car-details-view/NC16015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_9680fb6b599e6f5b6e7e98b318ffb87e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc9033d6-4f9a-5afd-815d-55155779a0b1 with identifier: NC16015
2026-04-27 08:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc9033d6-4f9a-5afd-815d-55155779a0b1 with scrape type 1
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6249be4461b137eda75564c8821fc964.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_07da9765197b86b7633c6ac7f40caf46.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_a5550c4c380e7c13d8f47374f8eef29d.jpg not downloaded yet
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_a7e758fb26d869ccf4f985a8c6f21e81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6e9f10c933f96f61f43bfb281643bc1f.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_f1bd5b317e4f8ab1b48c2b4e7e5b8f54.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_d50dbe2380b1f37f941958f6072a2748.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_e58aa3b900f9a5da2737f97182223a41.jpg not downloaded yet
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048381f50>
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_9680fb6b599e6f5b6e7e98b318ffb87e.jpg saved to cache
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_26a841f6dba98c57c67bdfcf02b95760.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_994a17f0b3bbd392006a84a417f89a19.jpg not downloaded yet
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_29237245e14696ad37f945bc44668ecc.jpg not downloaded yet
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a2990>
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_a7e758fb26d869ccf4f985a8c6f21e81.jpg saved to cache
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_a5550c4c380e7c13d8f47374f8eef29d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:12:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:12:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485438d0>
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_a5550c4c380e7c13d8f47374f8eef29d.jpg saved to cache
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_29237245e14696ad37f945bc44668ecc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048969910>
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_29237245e14696ad37f945bc44668ecc.jpg saved to cache
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_994a17f0b3bbd392006a84a417f89a19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a7a50>
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_994a17f0b3bbd392006a84a417f89a19.jpg saved to cache
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_26a841f6dba98c57c67bdfcf02b95760.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488434d0>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_26a841f6dba98c57c67bdfcf02b95760.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_e58aa3b900f9a5da2737f97182223a41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882aa90>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_e58aa3b900f9a5da2737f97182223a41.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_d50dbe2380b1f37f941958f6072a2748.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_f1bd5b317e4f8ab1b48c2b4e7e5b8f54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f8a10>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_d50dbe2380b1f37f941958f6072a2748.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:12:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:12:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b15d0>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_f1bd5b317e4f8ab1b48c2b4e7e5b8f54.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6e9f10c933f96f61f43bfb281643bc1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882bbd0>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6e9f10c933f96f61f43bfb281643bc1f.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_07da9765197b86b7633c6ac7f40caf46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6249be4461b137eda75564c8821fc964.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488bbb10>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_07da9765197b86b7633c6ac7f40caf46.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048982ed0>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6249be4461b137eda75564c8821fc964.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc9033d6-4f9a-5afd-815d-55155779a0b1
2026-04-27 08:12:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc9033d6-4f9a-5afd-815d-55155779a0b1, skipping ID generation
2026-04-27 08:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc9033d6-4f9a-5afd-815d-55155779a0b1 with scrape type 1
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc9033d6-4f9a-5afd-815d-55155779a0b1 sending to next pipeline
2026-04-27 08:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc9033d6-4f9a-5afd-815d-55155779a0b1, identifier: NC16015
2026-04-27 08:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc9033d6-4f9a-5afd-815d-55155779a0b1 with identifier: NC16015
2026-04-27 08:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc9033d6-4f9a-5afd-815d-55155779a0b1 with identifier: NC16015
2026-04-27 08:12:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc9033d6-4f9a-5afd-815d-55155779a0b1 with identifier: NC16015 to the API
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6249be4461b137eda75564c8821fc964.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Alzira',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:01:35Z',
'fuel_type': 'petrol',
'id': 'fc9033d6-4f9a-5afd-815d-55155779a0b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 39.1518,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC16015',
'listing': 'auction',
'location': 'ES, Alzira',
'location_confidence': 'geocoded',
'longitude': -0.4333,
'make': 'Ford',
'model': 'EcoSport',
'odometer': 19066,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6249be4461b137eda75564c8821fc964.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_07da9765197b86b7633c6ac7f40caf46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407549,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_a5550c4c380e7c13d8f47374f8eef29d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_6e9f10c933f96f61f43bfb281643bc1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370922,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_f1bd5b317e4f8ab1b48c2b4e7e5b8f54.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_d50dbe2380b1f37f941958f6072a2748.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2449906,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_e58aa3b900f9a5da2737f97182223a41.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_26a841f6dba98c57c67bdfcf02b95760.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_994a17f0b3bbd392006a84a417f89a19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc9033d6-4f9a-5afd-815d-55155779a0b1/fc9033d6-4f9a-5afd-815d-55155779a0b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0eb529b790dca35435505e7fc5febc/pa/NC16015_29237245e14696ad37f945bc44668ecc.jpg',
'Width': 800}],
'postal_code': '46600',
'price': 0,
'price_includes_vat': True,
'province': 'Valencia',
'province_code': 'ES-V',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2019-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2019}
2026-04-27 08:12:04 [auto1.es] INFO: Saving data for NC16015: {'created_time': 1777277524.632718, 'last_price_update_time': 1777277524.632733, 'has_photos': True, 'auction_closing_time': 1777302095.0}
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_b50f6a51131c3f132e554332671c0df9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_17d310f713ba2a5c35bff28fda890056.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824690>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_b50f6a51131c3f132e554332671c0df9.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_d2b69ff82be9cae0d554b766483df0fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870f810>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_17d310f713ba2a5c35bff28fda890056.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_f26d6602764c3a148c9301013055c300.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c3090>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_d2b69ff82be9cae0d554b766483df0fa.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882a910>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_f26d6602764c3a148c9301013055c300.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f
2026-04-27 08:12:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71e0224f-e788-5c4f-8b3c-bd6cac11529f, skipping ID generation
2026-04-27 08:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f with scrape type 1
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71e0224f-e788-5c4f-8b3c-bd6cac11529f sending to next pipeline
2026-04-27 08:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71e0224f-e788-5c4f-8b3c-bd6cac11529f, identifier: KC20815
2026-04-27 08:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71e0224f-e788-5c4f-8b3c-bd6cac11529f with identifier: KC20815
2026-04-27 08:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71e0224f-e788-5c4f-8b3c-bd6cac11529f with identifier: KC20815
2026-04-27 08:12:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71e0224f-e788-5c4f-8b3c-bd6cac11529f with identifier: KC20815 to the API
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_f26d6602764c3a148c9301013055c300.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Araia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:30:12Z',
'fuel_type': 'diesel',
'id': '71e0224f-e788-5c4f-8b3c-bd6cac11529f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC20815',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 414381,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_f26d6602764c3a148c9301013055c300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_d2b69ff82be9cae0d554b766483df0fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_17d310f713ba2a5c35bff28fda890056.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_b50f6a51131c3f132e554332671c0df9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_a7e758fb26d869ccf4f985a8c6f21e81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71e0224f-e788-5c4f-8b3c-bd6cac11529f/71e0224f-e788-5c4f-8b3c-bd6cac11529f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/ef/b6ef0815021c86b373c2232a9e85edfc/pa/KC20815_9680fb6b599e6f5b6e7e98b318ffb87e.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2009-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-04-27 08:12:05 [auto1.es] INFO: Saving data for KC20815: {'created_time': 1777277525.501677, 'last_price_update_time': 1777277525.501692, 'has_photos': True, 'auction_closing_time': 1777303812.0}
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN53973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG43841/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP82638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB20751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ80848> (referer: https://www.auto1.com/v1/car-details-view/PZ80848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4523bbe9-e929-516e-9566-440d113b49d0 with identifier: PZ80848
2026-04-27 08:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4523bbe9-e929-516e-9566-440d113b49d0 with scrape type 1
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_be01888966e87f19c4ffe3883ec87d42.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_27ff948faacc2dc6ce0e6bfd45085acc.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_a202ac1be9d7fdaa016efb08b82798ed.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_0bc60f31c38ea614504a32a94e2f0bf4.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_34752d86a7879642f759b730d4853922.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_3109281a3adb861d9aba0a8265afb8f2.jpg not downloaded yet
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS57327> (referer: https://www.auto1.com/v1/car-details-view/KS57327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_3109281a3adb861d9aba0a8265afb8f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2140eec-f318-51f3-8e0c-3a062dc51da3 with identifier: KS57327
2026-04-27 08:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2140eec-f318-51f3-8e0c-3a062dc51da3 with scrape type 1
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_f3cb5c6f1143217ad0e9449f23d0c216.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_2993988c4ebb8ebf8a3ccbbde66ac2d2.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_118a4c341ba531d4d77172c873cfad40.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_551659b393097ca4501fa781a1f0f3c2.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8594ab241f70569d1a106382f67436cf.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_e76fe69024f4afc1404e3509dd050864.jpg not downloaded yet
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852aa50>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_3109281a3adb861d9aba0a8265afb8f2.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_3b076d4aadf3c78a036d656bf435873c.jpg not downloaded yet
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_34752d86a7879642f759b730d4853922.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_279080156d5023f0474e814207fde372.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_6bfe0d2b74e76de1730d9d22f1b29da3.jpg not downloaded yet
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8cde1e5da65e35d24c758ec9c0d10490.jpg not downloaded yet
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_3b076d4aadf3c78a036d656bf435873c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048858990>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_34752d86a7879642f759b730d4853922.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8cde1e5da65e35d24c758ec9c0d10490.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_6bfe0d2b74e76de1730d9d22f1b29da3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488b8590>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_3b076d4aadf3c78a036d656bf435873c.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_279080156d5023f0474e814207fde372.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ebc90>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8cde1e5da65e35d24c758ec9c0d10490.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_e76fe69024f4afc1404e3509dd050864.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048875610>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_6bfe0d2b74e76de1730d9d22f1b29da3.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048896dd0>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_279080156d5023f0474e814207fde372.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8594ab241f70569d1a106382f67436cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b79d0>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_e76fe69024f4afc1404e3509dd050864.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_551659b393097ca4501fa781a1f0f3c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9b50>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8594ab241f70569d1a106382f67436cf.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_118a4c341ba531d4d77172c873cfad40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a5ad0>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_551659b393097ca4501fa781a1f0f3c2.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_2993988c4ebb8ebf8a3ccbbde66ac2d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_f3cb5c6f1143217ad0e9449f23d0c216.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048541810>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_118a4c341ba531d4d77172c873cfad40.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c9ad0>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_2993988c4ebb8ebf8a3ccbbde66ac2d2.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048895890>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_f3cb5c6f1143217ad0e9449f23d0c216.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2140eec-f318-51f3-8e0c-3a062dc51da3
2026-04-27 08:12:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2140eec-f318-51f3-8e0c-3a062dc51da3, skipping ID generation
2026-04-27 08:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2140eec-f318-51f3-8e0c-3a062dc51da3 with scrape type 1
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2140eec-f318-51f3-8e0c-3a062dc51da3 sending to next pipeline
2026-04-27 08:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e2140eec-f318-51f3-8e0c-3a062dc51da3, identifier: KS57327
2026-04-27 08:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e2140eec-f318-51f3-8e0c-3a062dc51da3 with identifier: KS57327
2026-04-27 08:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e2140eec-f318-51f3-8e0c-3a062dc51da3 with identifier: KS57327
2026-04-27 08:12:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e2140eec-f318-51f3-8e0c-3a062dc51da3 with identifier: KS57327 to the API
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_f3cb5c6f1143217ad0e9449f23d0c216.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Campo Real',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:09:25Z',
'fuel_type': 'diesel',
'id': 'e2140eec-f318-51f3-8e0c-3a062dc51da3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.5445,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS57327',
'listing': 'auction',
'location': 'ES, Campo Real',
'location_confidence': 'geocoded',
'longitude': -1.2628,
'make': 'Volvo',
'model': 'XC40',
'odometer': 143216,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_f3cb5c6f1143217ad0e9449f23d0c216.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_2993988c4ebb8ebf8a3ccbbde66ac2d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_118a4c341ba531d4d77172c873cfad40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_551659b393097ca4501fa781a1f0f3c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8594ab241f70569d1a106382f67436cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_e76fe69024f4afc1404e3509dd050864.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_3b076d4aadf3c78a036d656bf435873c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_279080156d5023f0474e814207fde372.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_6bfe0d2b74e76de1730d9d22f1b29da3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2140eec-f318-51f3-8e0c-3a062dc51da3/e2140eec-f318-51f3-8e0c-3a062dc51da3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/6c/e96ce8e219e5e94cb18e74bdc473040a/pa/KS57327_8cde1e5da65e35d24c758ec9c0d10490.jpg',
'Width': 800}],
'postal_code': '50689',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2020-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 D3 Business Plus 2WD',
'transmission': 'automatic',
'trim': 'Business Plus 2WD',
'year': 2020}
2026-04-27 08:12:32 [auto1.es] INFO: Saving data for KS57327: {'created_time': 1777277552.570802, 'last_price_update_time': 1777277552.570811, 'has_photos': True, 'auction_closing_time': 1777302565.0}
2026-04-27 08:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_0bc60f31c38ea614504a32a94e2f0bf4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX99272> (referer: https://www.auto1.com/v1/car-details-view/KX99272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048769250>
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_0bc60f31c38ea614504a32a94e2f0bf4.jpg saved to cache
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272
2026-04-27 08:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with scrape type 1
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_c4bdda79280a5cbbafd8c22af1cea09b.jpg not downloaded yet
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_7a9848a23926fc1bbf495420225a4e94.jpg not downloaded yet
2026-04-27 08:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_a202ac1be9d7fdaa016efb08b82798ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ef93fc6e3e75c0909e6d16fe9271f5ac.jpg not downloaded yet
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_4707b7aeb5027d7e9ea4a49ec363b979.jpg not downloaded yet
2026-04-27 08:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_27ff948faacc2dc6ce0e6bfd45085acc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_a050c2ac1b67ba4d3d2c35cbfd74dfaa.jpg not downloaded yet
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_152376cb8917a05cb31ba3d0a0c5a26d.jpg not downloaded yet
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_aea411d04f722602654feed9fe0bff90.jpg not downloaded yet
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_bd2889f6fd4140b3530e7813ca78cbbd.jpg not downloaded yet
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870c190>
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_a202ac1be9d7fdaa016efb08b82798ed.jpg saved to cache
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_5f0d876132a1e5640ef849b3ed06f8b2.jpg not downloaded yet
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ff69f3095ad11af64be627b82ac166ed.jpg not downloaded yet
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870cfd0>
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_27ff948faacc2dc6ce0e6bfd45085acc.jpg saved to cache
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_4707b7aeb5027d7e9ea4a49ec363b979.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_7a9848a23926fc1bbf495420225a4e94.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057266310>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_4707b7aeb5027d7e9ea4a49ec363b979.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048540f10>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_7a9848a23926fc1bbf495420225a4e94.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ff69f3095ad11af64be627b82ac166ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_5f0d876132a1e5640ef849b3ed06f8b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484c8590>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ff69f3095ad11af64be627b82ac166ed.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b0390>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_5f0d876132a1e5640ef849b3ed06f8b2.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_aea411d04f722602654feed9fe0bff90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_bd2889f6fd4140b3530e7813ca78cbbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891d410>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_aea411d04f722602654feed9fe0bff90.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0a10>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_bd2889f6fd4140b3530e7813ca78cbbd.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF69534/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_a050c2ac1b67ba4d3d2c35cbfd74dfaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_152376cb8917a05cb31ba3d0a0c5a26d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_be01888966e87f19c4ffe3883ec87d42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a4050>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_a050c2ac1b67ba4d3d2c35cbfd74dfaa.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4f90>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_152376cb8917a05cb31ba3d0a0c5a26d.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ef93fc6e3e75c0909e6d16fe9271f5ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529210>
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_be01888966e87f19c4ffe3883ec87d42.jpg saved to cache
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4523bbe9-e929-516e-9566-440d113b49d0
2026-04-27 08:12:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4523bbe9-e929-516e-9566-440d113b49d0, skipping ID generation
2026-04-27 08:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4523bbe9-e929-516e-9566-440d113b49d0 with scrape type 1
2026-04-27 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4523bbe9-e929-516e-9566-440d113b49d0 sending to next pipeline
2026-04-27 08:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4523bbe9-e929-516e-9566-440d113b49d0, identifier: PZ80848
2026-04-27 08:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4523bbe9-e929-516e-9566-440d113b49d0 with identifier: PZ80848
2026-04-27 08:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4523bbe9-e929-516e-9566-440d113b49d0 with identifier: PZ80848
2026-04-27 08:12:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4523bbe9-e929-516e-9566-440d113b49d0 with identifier: PZ80848 to the API
2026-04-27 08:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_be01888966e87f19c4ffe3883ec87d42.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Pinto',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.1L',
'engine_horse_power': 65,
'expiration_date': '2026-04-27T15:28:13Z',
'fuel_type': 'petrol',
'id': '4523bbe9-e929-516e-9566-440d113b49d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 40.2466,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ80848',
'listing': 'auction',
'location': 'ES, Pinto',
'location_confidence': 'geocoded',
'longitude': -3.7007,
'make': 'Kia',
'model': 'Picanto',
'odometer': 125303,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_be01888966e87f19c4ffe3883ec87d42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_27ff948faacc2dc6ce0e6bfd45085acc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_a202ac1be9d7fdaa016efb08b82798ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_0bc60f31c38ea614504a32a94e2f0bf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_34752d86a7879642f759b730d4853922.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4523bbe9-e929-516e-9566-440d113b49d0/4523bbe9-e929-516e-9566-440d113b49d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/29/2c29aae60c32bd9aa3b378b93ddc32f2/pa/PZ80848_3109281a3adb861d9aba0a8265afb8f2.jpg',
'Width': 800}],
'postal_code': '28320',
'price': 0,
'price_includes_vat': True,
'province': 'Madrid',
'province_code': 'ES-M',
'region': 'Madrid',
'region_code': 'ES-MD',
'registration_date': '2006-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Picanto 1.1 LX',
'transmission': 'manual',
'trim': 'LX',
'year': 2006}
2026-04-27 08:12:34 [auto1.es] INFO: Saving data for PZ80848: {'created_time': 1777277554.473161, 'last_price_update_time': 1777277554.473173, 'has_photos': True, 'auction_closing_time': 1777303693.0}
2026-04-27 08:12:34 [scrapy.extensions.logstats] INFO: Crawled 613 pages (at 16 pages/min), scraped 710 items (at 6 items/min)
2026-04-27 08:12:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04876d410>
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ef93fc6e3e75c0909e6d16fe9271f5ac.jpg saved to cache
2026-04-27 08:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:36 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2050 | hits on page: 40
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: NK46924
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: FS39417
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: UY97217
2026-04-27 08:12:36 [auto1.es] INFO: Scrape type for UY97217: 0
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: XT34146
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: EK14215
2026-04-27 08:12:36 [auto1.es] INFO: Scrape type for EK14215: 0
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: BB20751
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: PM63338
2026-04-27 08:12:36 [auto1.es] INFO: Scrape type for PM63338: 2
2026-04-27 08:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491a1e97-2c7e-588d-9e01-e13ff365b3ea with identifier: PM63338
2026-04-27 08:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491a1e97-2c7e-588d-9e01-e13ff365b3ea with scrape type 2
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491a1e97-2c7e-588d-9e01-e13ff365b3ea with scrape type 2
2026-04-27 08:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 491a1e97-2c7e-588d-9e01-e13ff365b3ea, identifier: PM63338
2026-04-27 08:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 491a1e97-2c7e-588d-9e01-e13ff365b3ea with identifier: PM63338
2026-04-27 08:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 491a1e97-2c7e-588d-9e01-e13ff365b3ea with identifier: PM63338
2026-04-27 08:12:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 491a1e97-2c7e-588d-9e01-e13ff365b3ea with identifier: PM63338 to the API
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 230,
'expiration_date': '2026-04-27T15:58:59Z',
'fuel_type': 'petrol',
'id': '491a1e97-2c7e-588d-9e01-e13ff365b3ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM63338',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '5er',
'odometer': 175159,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-12-28',
'seller_name': None,
'title': 'BMW 5er 530i',
'transmission': 'manual',
'trim': '',
'year': 2004}
2026-04-27 08:12:36 [auto1.es] INFO: Saving data for PM63338: {'auction_closing_time': 1777305539.0, 'created_time': 1777018122.724597, 'has_photos': True, 'last_price_update_time': 1777277556.62785}
2026-04-27 08:12:36 [auto1.es] INFO: Found listing with ID: UF23429
2026-04-27 08:12:36 [auto1.es] INFO: Scrape type for UF23429: 2
2026-04-27 08:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429
2026-04-27 08:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with scrape type 2
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with scrape type 2
2026-04-27 08:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13619934-ca5f-51b9-b4b8-0392cc49a6e6, identifier: UF23429
2026-04-27 08:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429
2026-04-27 08:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429
2026-04-27 08:12:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13619934-ca5f-51b9-b4b8-0392cc49a6e6 with identifier: UF23429 to the API
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:22:22Z',
'fuel_type': 'petrol',
'id': '13619934-ca5f-51b9-b4b8-0392cc49a6e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF23429',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 82605,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-11-21',
'seller_name': None,
'title': 'BMW 3er 320i',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-04-27 08:12:37 [auto1.es] INFO: Saving data for UF23429: {'auction_closing_time': 1777303342.0, 'created_time': 1777018221.735135, 'has_photos': True, 'last_price_update_time': 1777277557.125316}
2026-04-27 08:12:37 [auto1.es] INFO: Found listing with ID: SY46095
2026-04-27 08:12:37 [auto1.es] INFO: Scrape type for SY46095: 2
2026-04-27 08:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095
2026-04-27 08:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98cb742-c253-500c-a7a6-11b7c1355adf with scrape type 2
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98cb742-c253-500c-a7a6-11b7c1355adf with scrape type 2
2026-04-27 08:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b98cb742-c253-500c-a7a6-11b7c1355adf, identifier: SY46095
2026-04-27 08:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095
2026-04-27 08:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095
2026-04-27 08:12:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b98cb742-c253-500c-a7a6-11b7c1355adf with identifier: SY46095 to the API
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-04-27T15:51:02Z',
'fuel_type': 'diesel',
'id': 'b98cb742-c253-500c-a7a6-11b7c1355adf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY46095',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '205',
'odometer': 152136,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '1990-02-18',
'seller_name': None,
'title': 'Peugeot 205 1.8 Diesel GRD',
'transmission': 'manual',
'trim': 'GRD',
'year': 1990}
2026-04-27 08:12:37 [auto1.es] INFO: Saving data for SY46095: {'auction_closing_time': 1777305062.0, 'created_time': 1777018197.204369, 'has_photos': True, 'last_price_update_time': 1777277557.535142}
2026-04-27 08:12:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.302(s), this was the 1st time calling it.
2026-04-27 08:12:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.5899229293258457 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:37 [auto1.es] INFO: Found listing with ID: EX84991
2026-04-27 08:12:37 [auto1.es] INFO: Scrape type for EX84991: 2
2026-04-27 08:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da98d7dd-4c3e-551a-ae71-938b6fb1af0d with identifier: EX84991
2026-04-27 08:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da98d7dd-4c3e-551a-ae71-938b6fb1af0d with scrape type 2
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da98d7dd-4c3e-551a-ae71-938b6fb1af0d with scrape type 2
2026-04-27 08:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da98d7dd-4c3e-551a-ae71-938b6fb1af0d, identifier: EX84991
2026-04-27 08:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS39417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da98d7dd-4c3e-551a-ae71-938b6fb1af0d with identifier: EX84991
2026-04-27 08:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da98d7dd-4c3e-551a-ae71-938b6fb1af0d with identifier: EX84991
2026-04-27 08:12:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da98d7dd-4c3e-551a-ae71-938b6fb1af0d with identifier: EX84991 to the API
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:08:49Z',
'fuel_type': 'diesel',
'id': 'da98d7dd-4c3e-551a-ae71-938b6fb1af0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX84991',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 190522,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-02-21',
'seller_name': None,
'title': 'BMW 1er 114d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-04-27 08:12:37 [auto1.es] INFO: Saving data for EX84991: {'auction_closing_time': 1777302529.0, 'created_time': 1777021787.650144, 'has_photos': True, 'last_price_update_time': 1777277557.952343}
2026-04-27 08:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:37 [auto1.es] INFO: Found listing with ID: UR82968
2026-04-27 08:12:37 [auto1.es] INFO: Scrape type for UR82968: 2
2026-04-27 08:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e139a974-0d5e-5874-830f-0cd93df2603f with identifier: UR82968
2026-04-27 08:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e139a974-0d5e-5874-830f-0cd93df2603f with scrape type 2
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e139a974-0d5e-5874-830f-0cd93df2603f with scrape type 2
2026-04-27 08:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e139a974-0d5e-5874-830f-0cd93df2603f, identifier: UR82968
2026-04-27 08:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e139a974-0d5e-5874-830f-0cd93df2603f with identifier: UR82968
2026-04-27 08:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e139a974-0d5e-5874-830f-0cd93df2603f with identifier: UR82968
2026-04-27 08:12:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e139a974-0d5e-5874-830f-0cd93df2603f with identifier: UR82968 to the API
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:10:43Z',
'fuel_type': 'diesel',
'id': 'e139a974-0d5e-5874-830f-0cd93df2603f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR82968',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 80830,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'BMW 1er 116d M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2017}
2026-04-27 08:12:38 [auto1.es] INFO: Saving data for UR82968: {'auction_closing_time': 1777302643.0, 'created_time': 1777018152.26261, 'has_photos': True, 'last_price_update_time': 1777277558.395063}
2026-04-27 08:12:38 [auto1.es] INFO: Found listing with ID: MN11557
2026-04-27 08:12:38 [auto1.es] INFO: Scrape type for MN11557: 2
2026-04-27 08:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef92baf8-230c-5214-b238-4e9ad15c3d63 with identifier: MN11557
2026-04-27 08:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef92baf8-230c-5214-b238-4e9ad15c3d63 with scrape type 2
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef92baf8-230c-5214-b238-4e9ad15c3d63 with scrape type 2
2026-04-27 08:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef92baf8-230c-5214-b238-4e9ad15c3d63, identifier: MN11557
2026-04-27 08:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef92baf8-230c-5214-b238-4e9ad15c3d63 with identifier: MN11557
2026-04-27 08:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef92baf8-230c-5214-b238-4e9ad15c3d63 with identifier: MN11557
2026-04-27 08:12:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ef92baf8-230c-5214-b238-4e9ad15c3d63 with identifier: MN11557 to the API
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:59:49Z',
'fuel_type': 'diesel',
'id': 'ef92baf8-230c-5214-b238-4e9ad15c3d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN11557',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Combo Life',
'odometer': 171939,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-09-29',
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2020}
2026-04-27 08:12:38 [auto1.es] INFO: Saving data for MN11557: {'auction_closing_time': 1777305589.0, 'created_time': 1777021371.242168, 'has_photos': True, 'last_price_update_time': 1777277558.843989}
2026-04-27 08:12:38 [auto1.es] INFO: Found listing with ID: CD32787
2026-04-27 08:12:38 [auto1.es] INFO: Scrape type for CD32787: 2
2026-04-27 08:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e26d08ad-27b6-555c-a053-419712d58b2f with identifier: CD32787
2026-04-27 08:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e26d08ad-27b6-555c-a053-419712d58b2f with scrape type 2
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e26d08ad-27b6-555c-a053-419712d58b2f with scrape type 2
2026-04-27 08:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e26d08ad-27b6-555c-a053-419712d58b2f, identifier: CD32787
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA83192> (referer: https://www.auto1.com/v1/car-details-view/XA83192/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e26d08ad-27b6-555c-a053-419712d58b2f with identifier: CD32787
2026-04-27 08:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e26d08ad-27b6-555c-a053-419712d58b2f with identifier: CD32787
2026-04-27 08:12:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e26d08ad-27b6-555c-a053-419712d58b2f with identifier: CD32787 to the API
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:09:07Z',
'fuel_type': 'diesel',
'id': 'e26d08ad-27b6-555c-a053-419712d58b2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD32787',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 268150,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-09-06',
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-04-27 08:12:39 [auto1.es] INFO: Saving data for CD32787: {'auction_closing_time': 1777302547.0, 'created_time': 1777018116.100192, 'has_photos': True, 'last_price_update_time': 1777277559.259765}
2026-04-27 08:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:39 [auto1.es] INFO: Found listing with ID: NS23187
2026-04-27 08:12:39 [auto1.es] INFO: Scrape type for NS23187: 2
2026-04-27 08:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 544e1d1f-3cae-5783-bf39-6544b8b443a3 with identifier: NS23187
2026-04-27 08:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 544e1d1f-3cae-5783-bf39-6544b8b443a3 with scrape type 2
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 544e1d1f-3cae-5783-bf39-6544b8b443a3 with scrape type 2
2026-04-27 08:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 544e1d1f-3cae-5783-bf39-6544b8b443a3, identifier: NS23187
2026-04-27 08:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_c4bdda79280a5cbbafd8c22af1cea09b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 544e1d1f-3cae-5783-bf39-6544b8b443a3 with identifier: NS23187
2026-04-27 08:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 544e1d1f-3cae-5783-bf39-6544b8b443a3 with identifier: NS23187
2026-04-27 08:12:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 544e1d1f-3cae-5783-bf39-6544b8b443a3 with identifier: NS23187 to the API
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-04-27T15:54:34Z',
'fuel_type': 'diesel',
'id': '544e1d1f-3cae-5783-bf39-6544b8b443a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS23187',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 198196,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-10-09',
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-04-27 08:12:39 [auto1.es] INFO: Saving data for NS23187: {'auction_closing_time': 1777305274.0, 'created_time': 1777018577.04696, 'has_photos': True, 'last_price_update_time': 1777277559.666455}
2026-04-27 08:12:39 [auto1.es] INFO: Found listing with ID: MN90156
2026-04-27 08:12:39 [auto1.es] INFO: Scrape type for MN90156: 2
2026-04-27 08:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca with identifier: MN90156
2026-04-27 08:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca with scrape type 2
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca with scrape type 2
2026-04-27 08:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca, identifier: MN90156
2026-04-27 08:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca with identifier: MN90156
2026-04-27 08:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca with identifier: MN90156
2026-04-27 08:12:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca with identifier: MN90156 to the API
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:23:29Z',
'fuel_type': 'petrol',
'id': '4fd1b3b5-cd31-5c33-bcf4-58bfcb63e5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN90156',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Corolla Verso',
'odometer': 181518,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-02-23',
'seller_name': None,
'title': 'Toyota Corolla Verso 1.8 Luna',
'transmission': 'manual',
'trim': 'Luna',
'year': 2005}
2026-04-27 08:12:40 [auto1.es] INFO: Saving data for MN90156: {'auction_closing_time': 1777303409.0, 'created_time': 1777021458.21023, 'has_photos': True, 'last_price_update_time': 1777277560.086827}
2026-04-27 08:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e2abe02-0e0f-5a2a-b407-6c341e2c2231 with identifier: XA83192
2026-04-27 08:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e2abe02-0e0f-5a2a-b407-6c341e2c2231 with scrape type 1
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e2abe02-0e0f-5a2a-b407-6c341e2c2231
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_ba52350bab8f093fe5d214825b5d0e90.jpg not downloaded yet
2026-04-27 08:12:40 [auto1.es] INFO: Found listing with ID: KP35991
2026-04-27 08:12:40 [auto1.es] INFO: Scrape type for KP35991: 1
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_c12fed25c59c0306b24ef411c29dea2b.jpg not downloaded yet
2026-04-27 08:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898b790>
2026-04-27 08:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_c4bdda79280a5cbbafd8c22af1cea09b.jpg saved to cache
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6
2026-04-27 08:12:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6, skipping ID generation
2026-04-27 08:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with scrape type 1
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 sending to next pipeline
2026-04-27 08:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6, identifier: KX99272
2026-04-27 08:12:40 [auto1.es] INFO: Found listing with ID: FM86899
2026-04-27 08:12:40 [auto1.es] INFO: Scrape type for FM86899: 2
2026-04-27 08:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45857b24-0d6d-5a22-b6f8-0c0790ccc76e with identifier: FM86899
2026-04-27 08:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45857b24-0d6d-5a22-b6f8-0c0790ccc76e with scrape type 2
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45857b24-0d6d-5a22-b6f8-0c0790ccc76e with scrape type 2
2026-04-27 08:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45857b24-0d6d-5a22-b6f8-0c0790ccc76e, identifier: FM86899
2026-04-27 08:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272
2026-04-27 08:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272
2026-04-27 08:12:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272 to the API
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_c4bdda79280a5cbbafd8c22af1cea09b.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Oleiros',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:39:01Z',
'fuel_type': 'diesel',
'id': '05eccaec-cab8-5dc2-b5ba-0271bd55bdc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 42.7948,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX99272',
'listing': 'auction',
'location': 'ES, Oleiros',
'location_confidence': 'geocoded',
'longitude': -8.9884,
'make': 'Ford',
'model': 'Transit',
'odometer': 108271,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_c4bdda79280a5cbbafd8c22af1cea09b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_7a9848a23926fc1bbf495420225a4e94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ef93fc6e3e75c0909e6d16fe9271f5ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_4707b7aeb5027d7e9ea4a49ec363b979.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_a050c2ac1b67ba4d3d2c35cbfd74dfaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_152376cb8917a05cb31ba3d0a0c5a26d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_aea411d04f722602654feed9fe0bff90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_bd2889f6fd4140b3530e7813ca78cbbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_5f0d876132a1e5640ef849b3ed06f8b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05eccaec-cab8-5dc2-b5ba-0271bd55bdc6/05eccaec-cab8-5dc2-b5ba-0271bd55bdc6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/04/2a04b9a6dee897923149acc0cb8c293e/pa/KX99272_ff69f3095ad11af64be627b82ac166ed.jpg',
'Width': 800}],
'postal_code': '15240',
'price': 0,
'price_includes_vat': True,
'province': 'A Coruña',
'province_code': 'ES-C',
'region': 'Galicia',
'region_code': 'ES-GA',
'registration_date': '2020-12-22',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2020}
2026-04-27 08:12:40 [auto1.es] INFO: Saving data for KX99272: {'created_time': 1777277560.707487, 'last_price_update_time': 1777277560.707498, 'has_photos': True, 'auction_closing_time': 1777304341.0}
2026-04-27 08:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45857b24-0d6d-5a22-b6f8-0c0790ccc76e with identifier: FM86899
2026-04-27 08:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45857b24-0d6d-5a22-b6f8-0c0790ccc76e with identifier: FM86899
2026-04-27 08:12:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 45857b24-0d6d-5a22-b6f8-0c0790ccc76e with identifier: FM86899 to the API
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:06:12Z',
'fuel_type': 'diesel',
'id': '45857b24-0d6d-5a22-b6f8-0c0790ccc76e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM86899',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Combo Life',
'odometer': 172076,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-10-24',
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2020}
2026-04-27 08:12:40 [auto1.es] INFO: Saving data for FM86899: {'auction_closing_time': 1777302372.0, 'created_time': 1777021162.002292, 'has_photos': True, 'last_price_update_time': 1777277560.97925}
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_430a2ec4f5e8b229de2ff235a03a6d17.jpg not downloaded yet
2026-04-27 08:12:41 [auto1.es] INFO: Found listing with ID: KC77092
2026-04-27 08:12:41 [auto1.es] INFO: Scrape type for KC77092: 2
2026-04-27 08:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50a06238-1d00-505c-9215-6c43fc597845 with identifier: KC77092
2026-04-27 08:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a06238-1d00-505c-9215-6c43fc597845 with scrape type 2
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50a06238-1d00-505c-9215-6c43fc597845 with scrape type 2
2026-04-27 08:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50a06238-1d00-505c-9215-6c43fc597845, identifier: KC77092
2026-04-27 08:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50a06238-1d00-505c-9215-6c43fc597845 with identifier: KC77092
2026-04-27 08:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50a06238-1d00-505c-9215-6c43fc597845 with identifier: KC77092
2026-04-27 08:12:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50a06238-1d00-505c-9215-6c43fc597845 with identifier: KC77092 to the API
2026-04-27 08:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:28:07Z',
'fuel_type': 'petrol',
'id': '50a06238-1d00-505c-9215-6c43fc597845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC77092',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 175948,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-09-30',
'seller_name': None,
'title': 'Ford Focus 1.6 Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2010}
2026-04-27 08:12:41 [auto1.es] INFO: Saving data for KC77092: {'auction_closing_time': 1777303687.0, 'created_time': 1777018199.519645, 'has_photos': True, 'last_price_update_time': 1777277561.392451}
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_30d23409b2b8eec7cabedb2e24af96ee.jpg not downloaded yet
2026-04-27 08:12:41 [auto1.es] INFO: Found listing with ID: NV59571
2026-04-27 08:12:41 [auto1.es] INFO: Scrape type for NV59571: 2
2026-04-27 08:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e44712-d66a-5d21-bfc6-f48e3cef3de2 with identifier: NV59571
2026-04-27 08:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e44712-d66a-5d21-bfc6-f48e3cef3de2 with scrape type 2
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95e44712-d66a-5d21-bfc6-f48e3cef3de2 with scrape type 2
2026-04-27 08:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95e44712-d66a-5d21-bfc6-f48e3cef3de2, identifier: NV59571
2026-04-27 08:12:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.850(s), this was the 1st time calling it.
2026-04-27 08:12:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.289034300944282 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95e44712-d66a-5d21-bfc6-f48e3cef3de2 with identifier: NV59571
2026-04-27 08:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95e44712-d66a-5d21-bfc6-f48e3cef3de2 with identifier: NV59571
2026-04-27 08:12:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95e44712-d66a-5d21-bfc6-f48e3cef3de2 with identifier: NV59571 to the API
2026-04-27 08:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 400,
'expiration_date': '2026-04-27T15:34:00Z',
'fuel_type': 'petrol',
'id': '95e44712-d66a-5d21-bfc6-f48e3cef3de2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV59571',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Porsche',
'model': 'Panamera',
'odometer': 134959,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-10-11',
'seller_name': None,
'title': 'Porsche Panamera S',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 08:12:41 [auto1.es] INFO: Saving data for NV59571: {'auction_closing_time': 1777304040.0, 'created_time': 1777018273.22415, 'has_photos': True, 'last_price_update_time': 1777277561.943454}
2026-04-27 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_712d49f1e07116d8c1b39b088519f741.jpg not downloaded yet
2026-04-27 08:12:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:41 [auto1.es] INFO: Found listing with ID: FU26797
2026-04-27 08:12:41 [auto1.es] INFO: Scrape type for FU26797: 1
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_7e67fb67287c22b3b9509d3eb69c9717.jpg not downloaded yet
2026-04-27 08:12:42 [auto1.es] INFO: Found listing with ID: KE44681
2026-04-27 08:12:42 [auto1.es] INFO: Scrape type for KE44681: 2
2026-04-27 08:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681
2026-04-27 08:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23651d85-97bf-59e0-b45a-962eab987b76 with scrape type 2
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23651d85-97bf-59e0-b45a-962eab987b76 with scrape type 2
2026-04-27 08:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 23651d85-97bf-59e0-b45a-962eab987b76, identifier: KE44681
2026-04-27 08:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681
2026-04-27 08:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681
2026-04-27 08:12:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681 to the API
2026-04-27 08:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-04-27T15:46:12Z',
'fuel_type': 'petrol',
'id': '23651d85-97bf-59e0-b45a-962eab987b76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE44681',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 66295,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2002-10-15',
'seller_name': None,
'title': 'Renault Megane 1.4 Century',
'transmission': 'manual',
'trim': 'Century',
'year': 2002}
2026-04-27 08:12:42 [auto1.es] INFO: Saving data for KE44681: {'auction_closing_time': 1777304772.0, 'created_time': 1777018205.681463, 'has_photos': True, 'last_price_update_time': 1777277562.41249}
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_875c3218a4285087c1ea6ef8ca13f46e.jpg not downloaded yet
2026-04-27 08:12:42 [auto1.es] INFO: Found listing with ID: DU20994
2026-04-27 08:12:42 [auto1.es] INFO: Scrape type for DU20994: 1
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_4a41b1385f25da371ebf07485b2dd5d0.jpg not downloaded yet
2026-04-27 08:12:42 [auto1.es] INFO: Found listing with ID: XT27865
2026-04-27 08:12:42 [auto1.es] INFO: Scrape type for XT27865: 2
2026-04-27 08:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef07849-6a23-57e6-aa55-a0ce473ef954 with identifier: XT27865
2026-04-27 08:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef07849-6a23-57e6-aa55-a0ce473ef954 with scrape type 2
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ef07849-6a23-57e6-aa55-a0ce473ef954 with scrape type 2
2026-04-27 08:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ef07849-6a23-57e6-aa55-a0ce473ef954, identifier: XT27865
2026-04-27 08:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ef07849-6a23-57e6-aa55-a0ce473ef954 with identifier: XT27865
2026-04-27 08:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ef07849-6a23-57e6-aa55-a0ce473ef954 with identifier: XT27865
2026-04-27 08:12:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ef07849-6a23-57e6-aa55-a0ce473ef954 with identifier: XT27865 to the API
2026-04-27 08:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:36:53Z',
'fuel_type': 'diesel',
'id': '1ef07849-6a23-57e6-aa55-a0ce473ef954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT27865',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 371683,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-09-07',
'seller_name': None,
'title': 'Volkswagen Golf V 2.0 TDI GT Sport 4Motion',
'transmission': 'manual',
'trim': 'GT Sport 4Motion',
'year': 2008}
2026-04-27 08:12:42 [auto1.es] INFO: Saving data for XT27865: {'auction_closing_time': 1777304213.0, 'created_time': 1777021533.533769, 'has_photos': True, 'last_price_update_time': 1777277562.859494}
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_6d7950e7924f634538bcd107f02aa7de.jpg not downloaded yet
2026-04-27 08:12:42 [auto1.es] INFO: Found listing with ID: LA18575
2026-04-27 08:12:42 [auto1.es] INFO: Scrape type for LA18575: 2
2026-04-27 08:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb with identifier: LA18575
2026-04-27 08:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb with scrape type 2
2026-04-27 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb with scrape type 2
2026-04-27 08:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb, identifier: LA18575
2026-04-27 08:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb with identifier: LA18575
2026-04-27 08:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb with identifier: LA18575
2026-04-27 08:12:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb with identifier: LA18575 to the API
2026-04-27 08:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-04-27T15:32:16Z',
'fuel_type': 'diesel',
'id': '8d6fb70d-5ce2-59bd-aecc-8f2c816b02cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA18575',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mazda',
'model': 'CX-5',
'odometer': 93433,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-06-08',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Luxury 4WD',
'transmission': 'automatic',
'trim': 'Luxury 4WD',
'year': 2016}
2026-04-27 08:12:43 [auto1.es] INFO: Saving data for LA18575: {'auction_closing_time': 1777303936.0, 'created_time': 1777021375.693677, 'has_photos': True, 'last_price_update_time': 1777277563.267626}
2026-04-27 08:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/7c/887cd7aeee1fb378cbbe68848f0fbdcf/pa/XA83192_c674e840024e338355e313b17b112da2.jpg not downloaded yet
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: VH23688
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for VH23688: 1
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.307(s), this was the 1st time calling it.
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.7743976657335 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: TY90466
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for TY90466: 1
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: UU97245
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for UU97245: 1
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: AT54549
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for AT54549: 1
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: AP25017
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for AP25017: 1
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: LE77947
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for LE77947: 2
2026-04-27 08:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6759e4f-b20d-51bc-863f-5d38b6f27f45 with identifier: LE77947
2026-04-27 08:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6759e4f-b20d-51bc-863f-5d38b6f27f45 with scrape type 2
2026-04-27 08:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6759e4f-b20d-51bc-863f-5d38b6f27f45 with scrape type 2
2026-04-27 08:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6759e4f-b20d-51bc-863f-5d38b6f27f45, identifier: LE77947
2026-04-27 08:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6759e4f-b20d-51bc-863f-5d38b6f27f45 with identifier: LE77947
2026-04-27 08:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6759e4f-b20d-51bc-863f-5d38b6f27f45 with identifier: LE77947
2026-04-27 08:12:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6759e4f-b20d-51bc-863f-5d38b6f27f45 with identifier: LE77947 to the API
2026-04-27 08:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:42:28Z',
'fuel_type': 'diesel',
'id': 'd6759e4f-b20d-51bc-863f-5d38b6f27f45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE77947',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 154786,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-04-30',
'seller_name': None,
'title': 'Ford Focus 1.8 TDCi Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2007}
2026-04-27 08:12:43 [auto1.es] INFO: Saving data for LE77947: {'auction_closing_time': 1777304548.0, 'created_time': 1777020729.479147, 'has_photos': True, 'last_price_update_time': 1777277563.772299}
2026-04-27 08:12:43 [auto1.es] INFO: Found listing with ID: XB93468
2026-04-27 08:12:43 [auto1.es] INFO: Scrape type for XB93468: 2
2026-04-27 08:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd with identifier: XB93468
2026-04-27 08:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd with scrape type 2
2026-04-27 08:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd with scrape type 2
2026-04-27 08:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd, identifier: XB93468
2026-04-27 08:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd with identifier: XB93468
2026-04-27 08:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd with identifier: XB93468
2026-04-27 08:12:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f5ba0ed-d51f-53ae-a3d6-78a929275ffd with identifier: XB93468 to the API
2026-04-27 08:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-04-27T15:07:12Z',
'fuel_type': 'diesel',
'id': '2f5ba0ed-d51f-53ae-a3d6-78a929275ffd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB93468',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Phaeton',
'odometer': 201018,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-02-13',
'seller_name': None,
'title': 'Volkswagen Phaeton 3.0 V6 TDI 4Motion',
'transmission': 'automatic',
'trim': '4Motion',
'year': 2006}
2026-04-27 08:12:44 [auto1.es] INFO: Saving data for XB93468: {'auction_closing_time': 1777302432.0, 'created_time': 1777018390.713667, 'has_photos': True, 'last_price_update_time': 1777277564.257715}
2026-04-27 08:12:44 [auto1.es] INFO: Found listing with ID: ZT01527
2026-04-27 08:12:44 [auto1.es] INFO: Scrape type for ZT01527: 1
2026-04-27 08:12:44 [auto1.es] INFO: Found listing with ID: MR36516
2026-04-27 08:12:44 [auto1.es] INFO: Scrape type for MR36516: 1
2026-04-27 08:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT01986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:44 [auto1.es] INFO: Found listing with ID: ZE41555
2026-04-27 08:12:44 [auto1.es] INFO: Scrape type for ZE41555: 2
2026-04-27 08:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555
2026-04-27 08:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c6fd423-065b-543b-aa3e-b5687f36610b with scrape type 2
2026-04-27 08:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c6fd423-065b-543b-aa3e-b5687f36610b with scrape type 2
2026-04-27 08:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c6fd423-065b-543b-aa3e-b5687f36610b, identifier: ZE41555
2026-04-27 08:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555
2026-04-27 08:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555
2026-04-27 08:12:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c6fd423-065b-543b-aa3e-b5687f36610b with identifier: ZE41555 to the API
2026-04-27 08:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:56:22Z',
'fuel_type': 'diesel',
'id': '8c6fd423-065b-543b-aa3e-b5687f36610b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE41555',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '807',
'odometer': 198886,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-10-20',
'seller_name': None,
'title': 'Peugeot 807 2.0 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2008}
2026-04-27 08:12:44 [auto1.es] INFO: Saving data for ZE41555: {'auction_closing_time': 1777305382.0, 'created_time': 1777018210.986977, 'has_photos': True, 'last_price_update_time': 1777277564.695703}
2026-04-27 08:12:44 [auto1.es] INFO: Found listing with ID: VR04219
2026-04-27 08:12:44 [auto1.es] INFO: Scrape type for VR04219: 1
2026-04-27 08:12:44 [auto1.es] INFO: Found listing with ID: TV56423
2026-04-27 08:12:44 [auto1.es] INFO: Scrape type for TV56423: 1
2026-04-27 08:12:44 [auto1.es] INFO: Found listing with ID: WC72839
2026-04-27 08:12:44 [auto1.es] INFO: Scrape type for WC72839: 2
2026-04-27 08:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743a6b6e-d478-5d76-b13f-cd6df9243e70 with identifier: WC72839
2026-04-27 08:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743a6b6e-d478-5d76-b13f-cd6df9243e70 with scrape type 2
2026-04-27 08:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743a6b6e-d478-5d76-b13f-cd6df9243e70 with scrape type 2
2026-04-27 08:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 743a6b6e-d478-5d76-b13f-cd6df9243e70, identifier: WC72839
2026-04-27 08:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 743a6b6e-d478-5d76-b13f-cd6df9243e70 with identifier: WC72839
2026-04-27 08:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 743a6b6e-d478-5d76-b13f-cd6df9243e70 with identifier: WC72839
2026-04-27 08:12:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 743a6b6e-d478-5d76-b13f-cd6df9243e70 with identifier: WC72839 to the API
2026-04-27 08:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 254,
'expiration_date': '2026-04-27T15:00:33Z',
'fuel_type': 'diesel',
'id': '743a6b6e-d478-5d76-b13f-cd6df9243e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC72839',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mazda',
'model': 'CX-60',
'odometer': 133350,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-11-28',
'seller_name': None,
'title': 'Mazda CX-60 3.3 e-Skyactiv-D Homura AWD',
'transmission': 'automatic',
'trim': 'Homura AWD',
'year': 2023}
2026-04-27 08:12:45 [auto1.es] INFO: Saving data for WC72839: {'auction_closing_time': 1777302033.0, 'created_time': 1777021943.258456, 'has_photos': True, 'last_price_update_time': 1777277565.111662}
2026-04-27 08:12:45 [auto1.es] INFO: Found listing with ID: UT89838
2026-04-27 08:12:45 [auto1.es] INFO: Scrape type for UT89838: 1
2026-04-27 08:12:45 [auto1.es] INFO: Found listing with ID: VZ76792
2026-04-27 08:12:45 [auto1.es] INFO: Scrape type for VZ76792: 2
2026-04-27 08:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792
2026-04-27 08:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with scrape type 2
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with scrape type 2
2026-04-27 08:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e, identifier: VZ76792
2026-04-27 08:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792
2026-04-27 08:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792
2026-04-27 08:12:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6be9cc1-df1b-54c1-9f97-db99eaf33c0e with identifier: VZ76792 to the API
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-04-27T15:41:49Z',
'fuel_type': 'diesel',
'id': 'f6be9cc1-df1b-54c1-9f97-db99eaf33c0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ76792',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 129695,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-02',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi XTR Plus',
'transmission': 'manual',
'trim': 'XTR Plus',
'year': 2015}
2026-04-27 08:12:45 [auto1.es] INFO: Saving data for VZ76792: {'auction_closing_time': 1777304509.0, 'created_time': 1777018223.911152, 'has_photos': True, 'last_price_update_time': 1777277565.513579}
2026-04-27 08:12:45 [auto1.es] INFO: Found listing with ID: RW97084
2026-04-27 08:12:45 [auto1.es] INFO: Scrape type for RW97084: 2
2026-04-27 08:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec with identifier: RW97084
2026-04-27 08:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec with scrape type 2
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec with scrape type 2
2026-04-27 08:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec, identifier: RW97084
2026-04-27 08:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec with identifier: RW97084
2026-04-27 08:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec with identifier: RW97084
2026-04-27 08:12:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec with identifier: RW97084 to the API
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:59:55Z',
'fuel_type': 'diesel',
'id': '6e9cbd7f-fe6c-5029-9829-0e1a0c6d2cec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW97084',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X1',
'odometer': 97572,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-12-12',
'seller_name': None,
'title': 'BMW X1 sDrive 18d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2016}
2026-04-27 08:12:45 [auto1.es] INFO: Saving data for RW97084: {'auction_closing_time': 1777305595.0, 'created_time': 1777021458.952074, 'has_photos': True, 'last_price_update_time': 1777277565.906225}
2026-04-27 08:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK46924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP82638> (referer: https://www.auto1.com/v1/car-details-view/KP82638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d6aa8f-4da9-5f2e-a911-b416e6c0cfb3 with identifier: KP82638
2026-04-27 08:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d6aa8f-4da9-5f2e-a911-b416e6c0cfb3 with scrape type 1
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85d6aa8f-4da9-5f2e-a911-b416e6c0cfb3
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_9b3ca8c624ca7d70c21e1df3296226c3.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_c8c032df0a9d3e2ef0f6c2c6a3cd8bcb.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_58aeceb57e8c29b70ab5664f5d937b82.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_b44309311e21ea46e0ae33b28de54fda.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_64862ce0aaee96db063a8a63285b33a4.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_494505b0459dab62b4b9d15a580ceb9a.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_f10b13c4b0fb0f82c03a40dcbe3dcfe3.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_4bd419c11defffef1be1b5935905f5d6.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_862ff91b1881fe087d52d26ba87826df.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_09e1732434961cc47ae967b32b3dd9df.jpg not downloaded yet
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG43841> (referer: https://www.auto1.com/v1/car-details-view/MG43841/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b29a0d36-b431-5d6c-9446-a313922f3435 with identifier: MG43841
2026-04-27 08:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b29a0d36-b431-5d6c-9446-a313922f3435 with scrape type 1
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b29a0d36-b431-5d6c-9446-a313922f3435
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_b3b9d6368ce87eb68026cd0592efd4d5.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_bc12cae187523623829ec8889e1e63bb.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_c3e08abf633de07db291750013e12795.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_1e0b7177e33b87c44c42af403282c755.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_1d4a59a130508e426f15c0834cf3ccbd.jpg not downloaded yet
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_74458c1be731176491c49c7f46230cd8.jpg not downloaded yet
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_09e1732434961cc47ae967b32b3dd9df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_74458c1be731176491c49c7f46230cd8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b9510>
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d6aa8f-4da9-5f2e-a911-b416e6c0cfb3/85d6aa8f-4da9-5f2e-a911-b416e6c0cfb3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8a/998a8feb35ce5be6b55cc23992251b14/pa/KP82638_09e1732434961cc47ae967b32b3dd9df.jpg saved to cache
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85d6aa8f-4da9-5f2e-a911-b416e6c0cfb3
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e2f10>
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b29a0d36-b431-5d6c-9446-a313922f3435/b29a0d36-b431-5d6c-9446-a313922f3435_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_74458c1be731176491c49c7f46230cd8.jpg saved to cache
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b29a0d36-b431-5d6c-9446-a313922f3435
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV87391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_1e0b7177e33b87c44c42af403282c755.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048520390>
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b29a0d36-b431-5d6c-9446-a313922f3435/b29a0d36-b431-5d6c-9446-a313922f3435_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_1e0b7177e33b87c44c42af403282c755.jpg saved to cache
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b29a0d36-b431-5d6c-9446-a313922f3435
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF69534> (referer: https://www.auto1.com/v1/car-details-view/BF69534/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_c3e08abf633de07db291750013e12795.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb413681-89cf-50f9-9579-bcc8ca3603bf with identifier: BF69534
2026-04-27 08:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb413681-89cf-50f9-9579-bcc8ca3603bf with scrape type 1
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_6d721d861e5196f495f71c82257b8ce5.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_93ef39e1ea43a152459dbe0fa9ee940f.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_89e39030e902fc519c8507dccdacff0d.jpg not downloaded yet
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_9c47f0c565e95e4b6cfbf110ccca8d6e.jpg not downloaded yet
2026-04-27 08:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_8f119c641cb36d14ba3b8a7563e30b71.jpg not downloaded yet
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048525090>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b29a0d36-b431-5d6c-9446-a313922f3435/b29a0d36-b431-5d6c-9446-a313922f3435_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_c3e08abf633de07db291750013e12795.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b29a0d36-b431-5d6c-9446-a313922f3435
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_1d4a59a130508e426f15c0834cf3ccbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_bc12cae187523623829ec8889e1e63bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_5cf5139807d4d2c0c4d4110494a0df6c.jpg not downloaded yet
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_ec6806faee55bf3025a90aa5189f3d2a.jpg not downloaded yet
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_6ba3b861d6dfcb06ec6b95ff90c6707a.jpg not downloaded yet
2026-04-27 08:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_1a399c6da1b4b28f5faf775f8654a6ff.jpg not downloaded yet
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_efa1e1da0188aec50438d772420c242f.jpg not downloaded yet
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048740d50>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b29a0d36-b431-5d6c-9446-a313922f3435/b29a0d36-b431-5d6c-9446-a313922f3435_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_1d4a59a130508e426f15c0834cf3ccbd.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b29a0d36-b431-5d6c-9446-a313922f3435
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048877150>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b29a0d36-b431-5d6c-9446-a313922f3435/b29a0d36-b431-5d6c-9446-a313922f3435_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/a9/4ba91eb41d827b71de51e95b93de2ec3/pa/MG43841_bc12cae187523623829ec8889e1e63bb.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b29a0d36-b431-5d6c-9446-a313922f3435
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_8f119c641cb36d14ba3b8a7563e30b71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484cb090>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_8f119c641cb36d14ba3b8a7563e30b71.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_efa1e1da0188aec50438d772420c242f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a96950>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_efa1e1da0188aec50438d772420c242f.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_1a399c6da1b4b28f5faf775f8654a6ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048894e50>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_1a399c6da1b4b28f5faf775f8654a6ff.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_6ba3b861d6dfcb06ec6b95ff90c6707a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2051 | hits on page: 40
2026-04-27 08:12:49 [auto1.es] INFO: Found listing with ID: RW97084
2026-04-27 08:12:49 [auto1.es] INFO: Scrape type for RW97084: 0
2026-04-27 08:12:49 [auto1.es] INFO: Found listing with ID: SH57645
2026-04-27 08:12:49 [auto1.es] INFO: Scrape type for SH57645: 2
2026-04-27 08:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed16619a-b800-590f-9df7-b93b24ec0164 with identifier: SH57645
2026-04-27 08:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed16619a-b800-590f-9df7-b93b24ec0164 with scrape type 2
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed16619a-b800-590f-9df7-b93b24ec0164 with scrape type 2
2026-04-27 08:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ed16619a-b800-590f-9df7-b93b24ec0164, identifier: SH57645
2026-04-27 08:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ed16619a-b800-590f-9df7-b93b24ec0164 with identifier: SH57645
2026-04-27 08:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ed16619a-b800-590f-9df7-b93b24ec0164 with identifier: SH57645
2026-04-27 08:12:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ed16619a-b800-590f-9df7-b93b24ec0164 with identifier: SH57645 to the API
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-04-27T15:47:26Z',
'fuel_type': 'diesel',
'id': 'ed16619a-b800-590f-9df7-b93b24ec0164',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH57645',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 186786,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Driver M',
'transmission': 'manual',
'trim': 'Driver M',
'year': 2016}
2026-04-27 08:12:50 [auto1.es] INFO: Saving data for SH57645: {'auction_closing_time': 1777304846.0, 'created_time': 1777018876.194723, 'has_photos': True, 'last_price_update_time': 1777277570.498432}
2026-04-27 08:12:50 [auto1.es] INFO: Found listing with ID: RL53928
2026-04-27 08:12:50 [auto1.es] INFO: Scrape type for RL53928: 1
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_9c47f0c565e95e4b6cfbf110ccca8d6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_ec6806faee55bf3025a90aa5189f3d2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_5cf5139807d4d2c0c4d4110494a0df6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898af50>
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_6ba3b861d6dfcb06ec6b95ff90c6707a.jpg saved to cache
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:50 [auto1.es] INFO: Found listing with ID: GW30711
2026-04-27 08:12:50 [auto1.es] INFO: Scrape type for GW30711: 1
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN53973> (referer: https://www.auto1.com/v1/car-details-view/LN53973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:50 [auto1.es] INFO: Found listing with ID: UG79716
2026-04-27 08:12:50 [auto1.es] INFO: Scrape type for UG79716: 1
2026-04-27 08:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:50 [auto1.es] INFO: Found listing with ID: HW17059
2026-04-27 08:12:50 [auto1.es] INFO: Scrape type for HW17059: 2
2026-04-27 08:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b9cf70f-42b7-5a84-a731-e0b01bbef765 with identifier: HW17059
2026-04-27 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b9cf70f-42b7-5a84-a731-e0b01bbef765 with scrape type 2
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b9cf70f-42b7-5a84-a731-e0b01bbef765 with scrape type 2
2026-04-27 08:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b9cf70f-42b7-5a84-a731-e0b01bbef765, identifier: HW17059
2026-04-27 08:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b9cf70f-42b7-5a84-a731-e0b01bbef765 with identifier: HW17059
2026-04-27 08:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b9cf70f-42b7-5a84-a731-e0b01bbef765 with identifier: HW17059
2026-04-27 08:12:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b9cf70f-42b7-5a84-a731-e0b01bbef765 with identifier: HW17059 to the API
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-04-27T15:33:28Z',
'fuel_type': 'diesel',
'id': '9b9cf70f-42b7-5a84-a731-e0b01bbef765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW17059',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Espace',
'odometer': 168184,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-02-22',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-04-27 08:12:51 [auto1.es] INFO: Saving data for HW17059: {'auction_closing_time': 1777304008.0, 'created_time': 1777021669.782042, 'has_photos': True, 'last_price_update_time': 1777277571.136164}
2026-04-27 08:12:51 [auto1.es] INFO: Found listing with ID: WK17115
2026-04-27 08:12:51 [auto1.es] INFO: Scrape type for WK17115: 1
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_93ef39e1ea43a152459dbe0fa9ee940f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048825150>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_9c47f0c565e95e4b6cfbf110ccca8d6e.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fd850>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_ec6806faee55bf3025a90aa5189f3d2a.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870a2d0>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_5cf5139807d4d2c0c4d4110494a0df6c.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e8e8c94-12df-5a5e-9616-77b2299669f8 with identifier: LN53973
2026-04-27 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e8e8c94-12df-5a5e-9616-77b2299669f8 with scrape type 1
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e8e8c94-12df-5a5e-9616-77b2299669f8
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_b3863d6dbfab9e5031372f62e958a2f7.jpg not downloaded yet
2026-04-27 08:12:51 [auto1.es] INFO: Found listing with ID: UG25415
2026-04-27 08:12:51 [auto1.es] INFO: Scrape type for UG25415: 1
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB20751> (referer: https://www.auto1.com/v1/car-details-view/BB20751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_8fe154eec649d54bf8e6278fcf134017.jpg not downloaded yet
2026-04-27 08:12:51 [auto1.es] INFO: Found listing with ID: FZ14379
2026-04-27 08:12:51 [auto1.es] INFO: Scrape type for FZ14379: 1
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_983139dc5c3953bf221344cb440ce7dc.jpg not downloaded yet
2026-04-27 08:12:51 [auto1.es] INFO: Found listing with ID: SJ01623
2026-04-27 08:12:51 [auto1.es] INFO: Scrape type for SJ01623: 2
2026-04-27 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3bae98-7372-5e20-8e0c-871f40eeac20 with identifier: SJ01623
2026-04-27 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3bae98-7372-5e20-8e0c-871f40eeac20 with scrape type 2
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3bae98-7372-5e20-8e0c-871f40eeac20 with scrape type 2
2026-04-27 08:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b3bae98-7372-5e20-8e0c-871f40eeac20, identifier: SJ01623
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487d7950>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_93ef39e1ea43a152459dbe0fa9ee940f.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b3bae98-7372-5e20-8e0c-871f40eeac20 with identifier: SJ01623
2026-04-27 08:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b3bae98-7372-5e20-8e0c-871f40eeac20 with identifier: SJ01623
2026-04-27 08:12:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b3bae98-7372-5e20-8e0c-871f40eeac20 with identifier: SJ01623 to the API
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:00:03Z',
'fuel_type': 'diesel',
'id': '8b3bae98-7372-5e20-8e0c-871f40eeac20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ01623',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'C5',
'odometer': 202864,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-08-30',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Premier',
'transmission': 'manual',
'trim': 'Premier',
'year': 2010}
2026-04-27 08:12:51 [auto1.es] INFO: Saving data for SJ01623: {'auction_closing_time': 1777302003.0, 'created_time': 1777021821.329193, 'has_photos': True, 'last_price_update_time': 1777277571.802043}
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_e656fc428f454419187878359dd9546d.jpg not downloaded yet
2026-04-27 08:12:51 [auto1.es] INFO: Found listing with ID: YT62251
2026-04-27 08:12:51 [auto1.es] INFO: Scrape type for YT62251: 1
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_b3863d6dbfab9e5031372f62e958a2f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_ddbebbeee38ec9beef3edf0134181e3a.jpg not downloaded yet
2026-04-27 08:12:51 [auto1.es] INFO: Found listing with ID: FC38329
2026-04-27 08:12:51 [auto1.es] INFO: Scrape type for FC38329: 2
2026-04-27 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8 with identifier: FC38329
2026-04-27 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8 with scrape type 2
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8 with scrape type 2
2026-04-27 08:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8, identifier: FC38329
2026-04-27 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28694659-1d83-5520-9f6d-db20195c649b with identifier: BB20751
2026-04-27 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28694659-1d83-5520-9f6d-db20195c649b with scrape type 1
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_1f7d6f7ed6c5ef391ada101289703687.jpg not downloaded yet
2026-04-27 08:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8 with identifier: FC38329
2026-04-27 08:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8 with identifier: FC38329
2026-04-27 08:12:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 958a289f-4d3f-5db6-9b33-e8d3b9c97cd8 with identifier: FC38329 to the API
2026-04-27 08:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:06:56Z',
'fuel_type': 'diesel',
'id': '958a289f-4d3f-5db6-9b33-e8d3b9c97cd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC38329',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': 'Partner',
'odometer': 197618,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-12-13',
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi L1',
'transmission': 'manual',
'trim': 'L1',
'year': 2012}
2026-04-27 08:12:52 [auto1.es] INFO: Saving data for FC38329: {'auction_closing_time': 1777302416.0, 'created_time': 1777019100.72513, 'has_photos': True, 'last_price_update_time': 1777277572.294149}
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_6cd2ae3b5275b78273d80de2f655b9a7.jpg not downloaded yet
2026-04-27 08:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_89e39030e902fc519c8507dccdacff0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:52 [auto1.es] INFO: Found listing with ID: TY76711
2026-04-27 08:12:52 [auto1.es] INFO: Scrape type for TY76711: 1
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_2e714a278dd9cc0819ce1fa8014926d1.jpg not downloaded yet
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_baf8b2931f98b070788059fa0f87a0b1.jpg not downloaded yet
2026-04-27 08:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_e656fc428f454419187878359dd9546d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:52 [auto1.es] INFO: Found listing with ID: JM18599
2026-04-27 08:12:52 [auto1.es] INFO: Scrape type for JM18599: 2
2026-04-27 08:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c53577-5f07-5c9a-82d8-5f481545ba83 with identifier: JM18599
2026-04-27 08:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c53577-5f07-5c9a-82d8-5f481545ba83 with scrape type 2
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08c53577-5f07-5c9a-82d8-5f481545ba83 with scrape type 2
2026-04-27 08:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08c53577-5f07-5c9a-82d8-5f481545ba83, identifier: JM18599
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_628a4de1a55e19bb02543401173f40df.jpg not downloaded yet
2026-04-27 08:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW09077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08c53577-5f07-5c9a-82d8-5f481545ba83 with identifier: JM18599
2026-04-27 08:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08c53577-5f07-5c9a-82d8-5f481545ba83 with identifier: JM18599
2026-04-27 08:12:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08c53577-5f07-5c9a-82d8-5f481545ba83 with identifier: JM18599 to the API
2026-04-27 08:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:42:54Z',
'fuel_type': 'petrol',
'id': '08c53577-5f07-5c9a-82d8-5f481545ba83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM18599',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 132802,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-01-04',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-04-27 08:12:53 [auto1.es] INFO: Saving data for JM18599: {'auction_closing_time': 1777304574.0, 'created_time': 1777018384.698976, 'has_photos': True, 'last_price_update_time': 1777277573.00488}
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_41885a3ad5e6d3f97ed39168083a8a25.jpg not downloaded yet
2026-04-27 08:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048857350>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e8e8c94-12df-5a5e-9616-77b2299669f8/2e8e8c94-12df-5a5e-9616-77b2299669f8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_b3863d6dbfab9e5031372f62e958a2f7.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e8e8c94-12df-5a5e-9616-77b2299669f8
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_1f7d6f7ed6c5ef391ada101289703687.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [auto1.es] INFO: Found listing with ID: TX02408
2026-04-27 08:12:53 [auto1.es] INFO: Scrape type for TX02408: 2
2026-04-27 08:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603685d2-0bca-571a-b9c6-db67d8dbece3 with identifier: TX02408
2026-04-27 08:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603685d2-0bca-571a-b9c6-db67d8dbece3 with scrape type 2
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 603685d2-0bca-571a-b9c6-db67d8dbece3 with scrape type 2
2026-04-27 08:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 603685d2-0bca-571a-b9c6-db67d8dbece3, identifier: TX02408
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_71d7e052f4ce067c0e483bb116be52d1.jpg not downloaded yet
2026-04-27 08:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 603685d2-0bca-571a-b9c6-db67d8dbece3 with identifier: TX02408
2026-04-27 08:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 603685d2-0bca-571a-b9c6-db67d8dbece3 with identifier: TX02408
2026-04-27 08:12:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 603685d2-0bca-571a-b9c6-db67d8dbece3 with identifier: TX02408 to the API
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 103,
'expiration_date': '2026-04-27T15:17:02Z',
'fuel_type': 'diesel',
'id': '603685d2-0bca-571a-b9c6-db67d8dbece3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX02408',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Qashqai+2',
'odometer': 191397,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-07-19',
'seller_name': None,
'title': 'Nissan Qashqai+2 1.5 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2009}
2026-04-27 08:12:53 [auto1.es] INFO: Saving data for TX02408: {'auction_closing_time': 1777303022.0, 'created_time': 1777018361.500953, 'has_photos': True, 'last_price_update_time': 1777277573.608353}
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_e597172670a7c87c0df698da7c8d2723.jpg not downloaded yet
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048940310>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb413681-89cf-50f9-9579-bcc8ca3603bf/fb413681-89cf-50f9-9579-bcc8ca3603bf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/16/5b1615163b8ec9c9ce84817050bec8bb/pa/BF69534_89e39030e902fc519c8507dccdacff0d.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb413681-89cf-50f9-9579-bcc8ca3603bf
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048399e10>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e8e8c94-12df-5a5e-9616-77b2299669f8/2e8e8c94-12df-5a5e-9616-77b2299669f8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_e656fc428f454419187878359dd9546d.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e8e8c94-12df-5a5e-9616-77b2299669f8
2026-04-27 08:12:53 [auto1.es] INFO: Found listing with ID: JJ72504
2026-04-27 08:12:53 [auto1.es] INFO: Scrape type for JJ72504: 2
2026-04-27 08:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90841ecb-3812-5250-a02f-a77cf8a7b55b with identifier: JJ72504
2026-04-27 08:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90841ecb-3812-5250-a02f-a77cf8a7b55b with scrape type 2
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90841ecb-3812-5250-a02f-a77cf8a7b55b with scrape type 2
2026-04-27 08:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90841ecb-3812-5250-a02f-a77cf8a7b55b, identifier: JJ72504
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_623a636c8c80beb5f93caa1b34730cfb.jpg not downloaded yet
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_2e714a278dd9cc0819ce1fa8014926d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90841ecb-3812-5250-a02f-a77cf8a7b55b with identifier: JJ72504
2026-04-27 08:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90841ecb-3812-5250-a02f-a77cf8a7b55b with identifier: JJ72504
2026-04-27 08:12:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90841ecb-3812-5250-a02f-a77cf8a7b55b with identifier: JJ72504 to the API
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-04-27T15:05:49Z',
'fuel_type': 'diesel',
'id': '90841ecb-3812-5250-a02f-a77cf8a7b55b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ72504',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 236266,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-03-26',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-04-27 08:12:54 [auto1.es] INFO: Saving data for JJ72504: {'auction_closing_time': 1777302349.0, 'created_time': 1777019402.025005, 'has_photos': True, 'last_price_update_time': 1777277574.150085}
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_ff5f871288f5d27c72334b00e89bc247.jpg not downloaded yet
2026-04-27 08:12:54 [auto1.es] INFO: Found listing with ID: LE09183
2026-04-27 08:12:54 [auto1.es] INFO: Scrape type for LE09183: 2
2026-04-27 08:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183
2026-04-27 08:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with scrape type 2
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with scrape type 2
2026-04-27 08:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5, identifier: LE09183
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_69a924aba47d432685f931791dd01a7d.jpg not downloaded yet
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fa5d0>
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_1f7d6f7ed6c5ef391ada101289703687.jpg saved to cache
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_628a4de1a55e19bb02543401173f40df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183
2026-04-27 08:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183
2026-04-27 08:12:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183 to the API
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:46:53Z',
'fuel_type': 'diesel',
'id': '5afb2734-c87a-5d0c-977e-d4c72abbd6f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE09183',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '308',
'odometer': 262896,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-11-30',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2007}
2026-04-27 08:12:54 [auto1.es] INFO: Saving data for LE09183: {'auction_closing_time': 1777304813.0, 'created_time': 1777018098.856968, 'has_photos': True, 'last_price_update_time': 1777277574.634088}
2026-04-27 08:12:54 [auto1.es] INFO: Found listing with ID: RV87631
2026-04-27 08:12:54 [auto1.es] INFO: Scrape type for RV87631: 2
2026-04-27 08:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7909e44-85e0-5023-95dc-9258803399d6 with identifier: RV87631
2026-04-27 08:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7909e44-85e0-5023-95dc-9258803399d6 with scrape type 2
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7909e44-85e0-5023-95dc-9258803399d6 with scrape type 2
2026-04-27 08:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7909e44-85e0-5023-95dc-9258803399d6, identifier: RV87631
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_5fde39431a4a00552933e21321eb83f8.jpg not downloaded yet
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484df790>
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_2e714a278dd9cc0819ce1fa8014926d1.jpg saved to cache
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_baf8b2931f98b070788059fa0f87a0b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7909e44-85e0-5023-95dc-9258803399d6 with identifier: RV87631
2026-04-27 08:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7909e44-85e0-5023-95dc-9258803399d6 with identifier: RV87631
2026-04-27 08:12:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7909e44-85e0-5023-95dc-9258803399d6 with identifier: RV87631 to the API
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:23:28Z',
'fuel_type': 'diesel',
'id': 'd7909e44-85e0-5023-95dc-9258803399d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV87631',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volvo',
'model': 'C30',
'odometer': 82749,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-05-24',
'seller_name': None,
'title': 'Volvo C30 1.6 DRIVe Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2010}
2026-04-27 08:12:55 [auto1.es] INFO: Saving data for RV87631: {'auction_closing_time': 1777303408.0, 'created_time': 1777018062.081165, 'has_photos': True, 'last_price_update_time': 1777277575.090143}
2026-04-27 08:12:55 [auto1.es] INFO: Found listing with ID: AV50831
2026-04-27 08:12:55 [auto1.es] INFO: Scrape type for AV50831: 2
2026-04-27 08:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0939c993-2bcb-594d-9fde-0679fe44880d with identifier: AV50831
2026-04-27 08:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0939c993-2bcb-594d-9fde-0679fe44880d with scrape type 2
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0939c993-2bcb-594d-9fde-0679fe44880d with scrape type 2
2026-04-27 08:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0939c993-2bcb-594d-9fde-0679fe44880d, identifier: AV50831
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_8d56e0a3b8d2f47276ac824707eec733.jpg not downloaded yet
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT69557> (referer: https://www.auto1.com/v1/car-details-view/AT69557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bc550>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_628a4de1a55e19bb02543401173f40df.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0939c993-2bcb-594d-9fde-0679fe44880d with identifier: AV50831
2026-04-27 08:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0939c993-2bcb-594d-9fde-0679fe44880d with identifier: AV50831
2026-04-27 08:12:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0939c993-2bcb-594d-9fde-0679fe44880d with identifier: AV50831 to the API
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 387,
'expiration_date': '2026-04-27T15:58:45Z',
'fuel_type': 'petrol',
'id': '0939c993-2bcb-594d-9fde-0679fe44880d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV50831',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Lexus',
'model': 'LS-Serie',
'odometer': 197991,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-07-17',
'seller_name': None,
'title': 'Lexus LS-Serie LS 460 Luxe',
'transmission': 'automatic',
'trim': 'Luxe',
'year': 2008}
2026-04-27 08:12:55 [auto1.es] INFO: Saving data for AV50831: {'auction_closing_time': 1777305525.0, 'created_time': 1777018086.177007, 'has_photos': True, 'last_price_update_time': 1777277575.567541}
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_ff5f871288f5d27c72334b00e89bc247.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [auto1.es] INFO: Found listing with ID: RR11699
2026-04-27 08:12:55 [auto1.es] INFO: Scrape type for RR11699: 1
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_9ae3e23b52e0beb8aaeaa0c348e6b142.jpg not downloaded yet
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fa810>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e8e8c94-12df-5a5e-9616-77b2299669f8/2e8e8c94-12df-5a5e-9616-77b2299669f8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_baf8b2931f98b070788059fa0f87a0b1.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e8e8c94-12df-5a5e-9616-77b2299669f8
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_69a924aba47d432685f931791dd01a7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.153(s), this was the 1st time calling it.
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.926080215599492 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:55 [auto1.es] INFO: Found listing with ID: CG21372
2026-04-27 08:12:55 [auto1.es] INFO: Scrape type for CG21372: 2
2026-04-27 08:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a with identifier: CG21372
2026-04-27 08:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a with scrape type 2
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a with scrape type 2
2026-04-27 08:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a, identifier: CG21372
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_7d8fb3b4b38419f0cb6fbe5d3c2e8790.jpg not downloaded yet
2026-04-27 08:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e315c7de-e11c-5cbe-848b-bfcb7402ae9d with identifier: AT69557
2026-04-27 08:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d with scrape type 1
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_c416e06983faf4c97649f7748b75eda6.jpg not downloaded yet
2026-04-27 08:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a with identifier: CG21372
2026-04-27 08:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a with identifier: CG21372
2026-04-27 08:12:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a with identifier: CG21372 to the API
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:24:20Z',
'fuel_type': 'petrol',
'id': '6b760c40-b2e1-5dc1-ba5d-2263dc8cf67a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG21372',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Corsa',
'odometer': 14381,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-02-26',
'seller_name': None,
'title': 'Opel Corsa 1.4 Selective',
'transmission': 'automatic',
'trim': 'Selective',
'year': 2018}
2026-04-27 08:12:56 [auto1.es] INFO: Saving data for CG21372: {'auction_closing_time': 1777303460.0, 'created_time': 1777020950.047708, 'has_photos': True, 'last_price_update_time': 1777277576.066748}
2026-04-27 08:12:56 [auto1.es] INFO: Found listing with ID: YF92363
2026-04-27 08:12:56 [auto1.es] INFO: Scrape type for YF92363: 2
2026-04-27 08:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b75386a-1dad-5113-83a7-fa36339d3ebb with identifier: YF92363
2026-04-27 08:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b75386a-1dad-5113-83a7-fa36339d3ebb with scrape type 2
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b75386a-1dad-5113-83a7-fa36339d3ebb with scrape type 2
2026-04-27 08:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b75386a-1dad-5113-83a7-fa36339d3ebb, identifier: YF92363
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_2cb7a674ffd8e4bbdea7aeee5afad598.jpg not downloaded yet
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_8d56e0a3b8d2f47276ac824707eec733.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_623a636c8c80beb5f93caa1b34730cfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b75386a-1dad-5113-83a7-fa36339d3ebb with identifier: YF92363
2026-04-27 08:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b75386a-1dad-5113-83a7-fa36339d3ebb with identifier: YF92363
2026-04-27 08:12:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b75386a-1dad-5113-83a7-fa36339d3ebb with identifier: YF92363 to the API
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:30:40Z',
'fuel_type': 'diesel',
'id': '2b75386a-1dad-5113-83a7-fa36339d3ebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF92363',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'Focus',
'odometer': 302812,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-08-23',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-04-27 08:12:56 [auto1.es] INFO: Saving data for YF92363: {'auction_closing_time': 1777303840.0, 'created_time': 1777020577.133332, 'has_photos': True, 'last_price_update_time': 1777277576.489926}
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bc6d0>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e8e8c94-12df-5a5e-9616-77b2299669f8/2e8e8c94-12df-5a5e-9616-77b2299669f8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/26/1a26eb615acd914f733fcbd0ec94fbe3/pa/LN53973_ff5f871288f5d27c72334b00e89bc247.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e8e8c94-12df-5a5e-9616-77b2299669f8
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a2890>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_69a924aba47d432685f931791dd01a7d.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:56 [auto1.es] INFO: Found listing with ID: NV17541
2026-04-27 08:12:56 [auto1.es] INFO: Scrape type for NV17541: 1
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_09ae1a2dd495cafa9c159cfd54ded320.jpg not downloaded yet
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT89838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:56 [auto1.es] INFO: Found listing with ID: ZK51481
2026-04-27 08:12:56 [auto1.es] INFO: Scrape type for ZK51481: 2
2026-04-27 08:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391f7a38-4759-5cae-a8e6-aab3a2ce7011 with identifier: ZK51481
2026-04-27 08:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391f7a38-4759-5cae-a8e6-aab3a2ce7011 with scrape type 2
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391f7a38-4759-5cae-a8e6-aab3a2ce7011 with scrape type 2
2026-04-27 08:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 391f7a38-4759-5cae-a8e6-aab3a2ce7011, identifier: ZK51481
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_f91827ddeac1b4baeb2e671d49affd82.jpg not downloaded yet
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fcf10>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_8d56e0a3b8d2f47276ac824707eec733.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892490>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_623a636c8c80beb5f93caa1b34730cfb.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 391f7a38-4759-5cae-a8e6-aab3a2ce7011 with identifier: ZK51481
2026-04-27 08:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 391f7a38-4759-5cae-a8e6-aab3a2ce7011 with identifier: ZK51481
2026-04-27 08:12:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 391f7a38-4759-5cae-a8e6-aab3a2ce7011 with identifier: ZK51481 to the API
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:02:23Z',
'fuel_type': 'diesel',
'id': '391f7a38-4759-5cae-a8e6-aab3a2ce7011',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51481',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Nissan',
'model': 'Juke',
'odometer': 258757,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-10-10',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2012}
2026-04-27 08:12:57 [auto1.es] INFO: Saving data for ZK51481: {'auction_closing_time': 1777302143.0, 'created_time': 1777019322.373507, 'has_photos': True, 'last_price_update_time': 1777277577.094466}
2026-04-27 08:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT01527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_5fde39431a4a00552933e21321eb83f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_7d8fb3b4b38419f0cb6fbe5d3c2e8790.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:57 [auto1.es] INFO: Found listing with ID: PC66277
2026-04-27 08:12:57 [auto1.es] INFO: Scrape type for PC66277: 1
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_abd6a06c22e7458efc5ee80c184e7cf6.jpg not downloaded yet
2026-04-27 08:12:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:57 [auto1.es] INFO: Found listing with ID: JS18549
2026-04-27 08:12:57 [auto1.es] INFO: Scrape type for JS18549: 1
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_5f28ec1e83831bfbd76fc2dcbc8295b5.jpg not downloaded yet
2026-04-27 08:12:57 [auto1.es] INFO: Found listing with ID: BS53195
2026-04-27 08:12:57 [auto1.es] INFO: Scrape type for BS53195: 1
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_9e67ecb30510ceac9a861f81de5161de.jpg not downloaded yet
2026-04-27 08:12:57 [auto1.es] INFO: Found listing with ID: TV63952
2026-04-27 08:12:57 [auto1.es] INFO: Scrape type for TV63952: 1
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_b924222afa60fa0ed7e1500563a6043a.jpg not downloaded yet
2026-04-27 08:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_c416e06983faf4c97649f7748b75eda6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:57 [auto1.es] INFO: Found listing with ID: SW23101
2026-04-27 08:12:57 [auto1.es] INFO: Scrape type for SW23101: 2
2026-04-27 08:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f850a61b-d98d-5fbd-8877-d1c33f7aa4a5 with identifier: SW23101
2026-04-27 08:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f850a61b-d98d-5fbd-8877-d1c33f7aa4a5 with scrape type 2
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f850a61b-d98d-5fbd-8877-d1c33f7aa4a5 with scrape type 2
2026-04-27 08:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f850a61b-d98d-5fbd-8877-d1c33f7aa4a5, identifier: SW23101
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_a08b54f2ee0dcfaa555dbbc1aa8ea7c4.jpg not downloaded yet
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f1c10>
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_5fde39431a4a00552933e21321eb83f8.jpg saved to cache
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482baf10>
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28694659-1d83-5520-9f6d-db20195c649b/28694659-1d83-5520-9f6d-db20195c649b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/95/3495aa22744908aac20942f6f968a3b6/pa/BB20751_7d8fb3b4b38419f0cb6fbe5d3c2e8790.jpg saved to cache
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28694659-1d83-5520-9f6d-db20195c649b
2026-04-27 08:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_2cb7a674ffd8e4bbdea7aeee5afad598.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f850a61b-d98d-5fbd-8877-d1c33f7aa4a5 with identifier: SW23101
2026-04-27 08:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f850a61b-d98d-5fbd-8877-d1c33f7aa4a5 with identifier: SW23101
2026-04-27 08:12:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f850a61b-d98d-5fbd-8877-d1c33f7aa4a5 with identifier: SW23101 to the API
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:48:26Z',
'fuel_type': 'petrol',
'id': 'f850a61b-d98d-5fbd-8877-d1c33f7aa4a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW23101',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'MINI',
'odometer': 142586,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-05-06',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 08:12:57 [auto1.es] INFO: Saving data for SW23101: {'auction_closing_time': 1777304906.0, 'created_time': 1777018251.698388, 'has_photos': True, 'last_price_update_time': 1777277577.797302}
2026-04-27 08:12:57 [auto1.es] INFO: Found listing with ID: KK58093
2026-04-27 08:12:57 [auto1.es] INFO: Scrape type for KK58093: 2
2026-04-27 08:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7461c4-4934-5f20-b49d-fe1100a53a89 with identifier: KK58093
2026-04-27 08:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7461c4-4934-5f20-b49d-fe1100a53a89 with scrape type 2
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac7461c4-4934-5f20-b49d-fe1100a53a89 with scrape type 2
2026-04-27 08:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac7461c4-4934-5f20-b49d-fe1100a53a89, identifier: KK58093
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_1ab12f2f23101acc73dfff9522c6ae27.jpg not downloaded yet
2026-04-27 08:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac7461c4-4934-5f20-b49d-fe1100a53a89 with identifier: KK58093
2026-04-27 08:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac7461c4-4934-5f20-b49d-fe1100a53a89 with identifier: KK58093
2026-04-27 08:12:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ac7461c4-4934-5f20-b49d-fe1100a53a89 with identifier: KK58093 to the API
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:51:40Z',
'fuel_type': 'diesel',
'id': 'ac7461c4-4934-5f20-b49d-fe1100a53a89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK58093',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 148076,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-10-09',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Excellence 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Excellence 4Motion BlueMotion Tech',
'year': 2011}
2026-04-27 08:12:58 [auto1.es] INFO: Saving data for KK58093: {'auction_closing_time': 1777305100.0, 'created_time': 1777020600.781755, 'has_photos': True, 'last_price_update_time': 1777277578.347507}
2026-04-27 08:12:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:12:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:12:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:12:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:12:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048572650>
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_c416e06983faf4c97649f7748b75eda6.jpg saved to cache
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_f91827ddeac1b4baeb2e671d49affd82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:58 [auto1.es] INFO: Found listing with ID: RA89344
2026-04-27 08:12:58 [auto1.es] INFO: Scrape type for RA89344: 1
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04898b4d0>
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_2cb7a674ffd8e4bbdea7aeee5afad598.jpg saved to cache
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_09ae1a2dd495cafa9c159cfd54ded320.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_b924222afa60fa0ed7e1500563a6043a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:58 [auto1.es] INFO: Found listing with ID: TJ35606
2026-04-27 08:12:58 [auto1.es] INFO: Scrape type for TJ35606: 2
2026-04-27 08:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6be210-0794-56a4-a47f-023bce1675c4 with identifier: TJ35606
2026-04-27 08:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6be210-0794-56a4-a47f-023bce1675c4 with scrape type 2
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6be210-0794-56a4-a47f-023bce1675c4 with scrape type 2
2026-04-27 08:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d6be210-0794-56a4-a47f-023bce1675c4, identifier: TJ35606
2026-04-27 08:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d6be210-0794-56a4-a47f-023bce1675c4 with identifier: TJ35606
2026-04-27 08:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d6be210-0794-56a4-a47f-023bce1675c4 with identifier: TJ35606
2026-04-27 08:12:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d6be210-0794-56a4-a47f-023bce1675c4 with identifier: TJ35606 to the API
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-04-27T15:57:43Z',
'fuel_type': 'petrol',
'id': '0d6be210-0794-56a4-a47f-023bce1675c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ35606',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3',
'odometer': 162053,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-07-29',
'seller_name': None,
'title': 'Audi A3 1.8 TFSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2007}
2026-04-27 08:12:58 [auto1.es] INFO: Saving data for TJ35606: {'auction_closing_time': 1777305463.0, 'created_time': 1777018234.470536, 'has_photos': True, 'last_price_update_time': 1777277578.875203}
2026-04-27 08:12:58 [auto1.es] INFO: Found listing with ID: XW60009
2026-04-27 08:12:58 [auto1.es] INFO: Scrape type for XW60009: 1
2026-04-27 08:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_1ab12f2f23101acc73dfff9522c6ae27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048933290>
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_f91827ddeac1b4baeb2e671d49affd82.jpg saved to cache
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485253d0>
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_09ae1a2dd495cafa9c159cfd54ded320.jpg saved to cache
2026-04-27 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bd7d0>
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_b924222afa60fa0ed7e1500563a6043a.jpg saved to cache
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: HA86042
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for HA86042: 1
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: JS38247
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for JS38247: 1
2026-04-27 08:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892590>
2026-04-27 08:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_1ab12f2f23101acc73dfff9522c6ae27.jpg saved to cache
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: GS67474
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for GS67474: 1
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: AV18747
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for AV18747: 1
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: FS34781
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for FS34781: 1
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: EU14206
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for EU14206: 2
2026-04-27 08:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86648dc-d31e-58b1-a967-71aeb38a3341 with identifier: EU14206
2026-04-27 08:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86648dc-d31e-58b1-a967-71aeb38a3341 with scrape type 2
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e86648dc-d31e-58b1-a967-71aeb38a3341 with scrape type 2
2026-04-27 08:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e86648dc-d31e-58b1-a967-71aeb38a3341, identifier: EU14206
2026-04-27 08:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e86648dc-d31e-58b1-a967-71aeb38a3341 with identifier: EU14206
2026-04-27 08:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e86648dc-d31e-58b1-a967-71aeb38a3341 with identifier: EU14206
2026-04-27 08:12:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e86648dc-d31e-58b1-a967-71aeb38a3341 with identifier: EU14206 to the API
2026-04-27 08:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:39:53Z',
'fuel_type': 'petrol',
'id': 'e86648dc-d31e-58b1-a967-71aeb38a3341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU14206',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '1er',
'odometer': 73275,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-12-27',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2017}
2026-04-27 08:12:59 [auto1.es] INFO: Saving data for EU14206: {'auction_closing_time': 1777304393.0, 'created_time': 1776941033.755526, 'has_photos': True, 'last_price_update_time': 1777277579.529482}
2026-04-27 08:12:59 [auto1.es] INFO: Found listing with ID: HX59990
2026-04-27 08:12:59 [auto1.es] INFO: Scrape type for HX59990: 1
2026-04-27 08:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV87391> (referer: https://www.auto1.com/v1/car-details-view/FV87391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92681f2b-f9fa-592f-bd33-ee62bd717aa0 with identifier: FV87391
2026-04-27 08:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0 with scrape type 1
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ae079e6ac3d638684fa0e3b12c5c4e4b.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_24aba22b06795bdccc47e6c85ab1c4b3.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_4617795d8180dbe3072b322d766491dd.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_c602c49f836179badfdd57baa257b1d2.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ce96ba1326763a039f9d9e5fd86ebbc9.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_effb3250f46092bba014a06a4182a430.jpg not downloaded yet
2026-04-27 08:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_a08b54f2ee0dcfaa555dbbc1aa8ea7c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_9e2e5952fa65d865b813027326ade3db.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_407159515a88c5b117c4ca6a4ef2f2b6.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_782ca913927b79f77252780fa7b436dd.jpg not downloaded yet
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_69b14dba71983427102d92da85b92d25.jpg not downloaded yet
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04867a810>
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_a08b54f2ee0dcfaa555dbbc1aa8ea7c4.jpg saved to cache
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_effb3250f46092bba014a06a4182a430.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481da110>
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_effb3250f46092bba014a06a4182a430.jpg saved to cache
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_69b14dba71983427102d92da85b92d25.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c3e10>
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_69b14dba71983427102d92da85b92d25.jpg saved to cache
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_782ca913927b79f77252780fa7b436dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048521550>
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_782ca913927b79f77252780fa7b436dd.jpg saved to cache
2026-04-27 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_407159515a88c5b117c4ca6a4ef2f2b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9850>
2026-04-27 08:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_407159515a88c5b117c4ca6a4ef2f2b6.jpg saved to cache
2026-04-27 08:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_9e2e5952fa65d865b813027326ade3db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207110>
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_9e2e5952fa65d865b813027326ade3db.jpg saved to cache
2026-04-27 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ce96ba1326763a039f9d9e5fd86ebbc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889f390>
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ce96ba1326763a039f9d9e5fd86ebbc9.jpg saved to cache
2026-04-27 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_c602c49f836179badfdd57baa257b1d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:02 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2051 | hits on page: 40
2026-04-27 08:13:02 [auto1.es] INFO: Found listing with ID: MA43187
2026-04-27 08:13:02 [auto1.es] INFO: Scrape type for MA43187: 1
2026-04-27 08:13:02 [auto1.es] INFO: Found listing with ID: TM93075
2026-04-27 08:13:02 [auto1.es] INFO: Scrape type for TM93075: 1
2026-04-27 08:13:02 [auto1.es] INFO: Found listing with ID: BV90112
2026-04-27 08:13:02 [auto1.es] INFO: Scrape type for BV90112: 2
2026-04-27 08:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c87af2-9628-5420-8fb5-572894e59331 with identifier: BV90112
2026-04-27 08:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c87af2-9628-5420-8fb5-572894e59331 with scrape type 2
2026-04-27 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22c87af2-9628-5420-8fb5-572894e59331 with scrape type 2
2026-04-27 08:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22c87af2-9628-5420-8fb5-572894e59331, identifier: BV90112
2026-04-27 08:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22c87af2-9628-5420-8fb5-572894e59331 with identifier: BV90112
2026-04-27 08:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22c87af2-9628-5420-8fb5-572894e59331 with identifier: BV90112
2026-04-27 08:13:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 22c87af2-9628-5420-8fb5-572894e59331 with identifier: BV90112 to the API
2026-04-27 08:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-04-27T15:50:59Z',
'fuel_type': 'hybrid',
'id': '22c87af2-9628-5420-8fb5-572894e59331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV90112',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'C-HR',
'odometer': 150809,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-02-19',
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2018}
2026-04-27 08:13:02 [auto1.es] INFO: Saving data for BV90112: {'auction_closing_time': 1777305059.0, 'created_time': 1777021820.990809, 'has_photos': True, 'last_price_update_time': 1777277582.908219}
2026-04-27 08:13:03 [auto1.es] INFO: Found listing with ID: LM76196
2026-04-27 08:13:03 [auto1.es] INFO: Scrape type for LM76196: 2
2026-04-27 08:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad47ad7d-1633-5350-80f3-e506b9c04e8f with identifier: LM76196
2026-04-27 08:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad47ad7d-1633-5350-80f3-e506b9c04e8f with scrape type 2
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad47ad7d-1633-5350-80f3-e506b9c04e8f with scrape type 2
2026-04-27 08:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad47ad7d-1633-5350-80f3-e506b9c04e8f, identifier: LM76196
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_24aba22b06795bdccc47e6c85ab1c4b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad47ad7d-1633-5350-80f3-e506b9c04e8f with identifier: LM76196
2026-04-27 08:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad47ad7d-1633-5350-80f3-e506b9c04e8f with identifier: LM76196
2026-04-27 08:13:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad47ad7d-1633-5350-80f3-e506b9c04e8f with identifier: LM76196 to the API
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-04-27T15:21:12Z',
'fuel_type': 'diesel',
'id': 'ad47ad7d-1633-5350-80f3-e506b9c04e8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM76196',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Chrysler',
'model': '300 C',
'odometer': 84266,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-11-08',
'seller_name': None,
'title': 'Chrysler 300 C 3.0 CRD',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-04-27 08:13:03 [auto1.es] INFO: Saving data for LM76196: {'auction_closing_time': 1777303272.0, 'created_time': 1777018530.841413, 'has_photos': True, 'last_price_update_time': 1777277583.405503}
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048679210>
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_c602c49f836179badfdd57baa257b1d2.jpg saved to cache
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:03 [auto1.es] INFO: Found listing with ID: XC82607
2026-04-27 08:13:03 [auto1.es] INFO: Scrape type for XC82607: 2
2026-04-27 08:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033e96b9-aecc-5d48-961f-f590b59bc02a with identifier: XC82607
2026-04-27 08:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033e96b9-aecc-5d48-961f-f590b59bc02a with scrape type 2
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033e96b9-aecc-5d48-961f-f590b59bc02a with scrape type 2
2026-04-27 08:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 033e96b9-aecc-5d48-961f-f590b59bc02a, identifier: XC82607
2026-04-27 08:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 033e96b9-aecc-5d48-961f-f590b59bc02a with identifier: XC82607
2026-04-27 08:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 033e96b9-aecc-5d48-961f-f590b59bc02a with identifier: XC82607
2026-04-27 08:13:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 033e96b9-aecc-5d48-961f-f590b59bc02a with identifier: XC82607 to the API
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:36:56Z',
'fuel_type': 'diesel',
'id': '033e96b9-aecc-5d48-961f-f590b59bc02a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC82607',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Leon',
'odometer': 153019,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-07-31',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2005}
2026-04-27 08:13:03 [auto1.es] INFO: Saving data for XC82607: {'auction_closing_time': 1777304216.0, 'created_time': 1777020924.047881, 'has_photos': True, 'last_price_update_time': 1777277583.830795}
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_4617795d8180dbe3072b322d766491dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:03 [auto1.es] INFO: Found listing with ID: RY34672
2026-04-27 08:13:03 [auto1.es] INFO: Scrape type for RY34672: 1
2026-04-27 08:13:03 [auto1.es] INFO: Found listing with ID: ZR59289
2026-04-27 08:13:03 [auto1.es] INFO: Scrape type for ZR59289: 1
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bf9d0>
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_24aba22b06795bdccc47e6c85ab1c4b3.jpg saved to cache
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:03 [auto1.es] INFO: Found listing with ID: AJ80010
2026-04-27 08:13:03 [auto1.es] INFO: Scrape type for AJ80010: 2
2026-04-27 08:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15caa874-ce67-592f-83d3-8d72e9edacb8 with identifier: AJ80010
2026-04-27 08:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15caa874-ce67-592f-83d3-8d72e9edacb8 with scrape type 2
2026-04-27 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15caa874-ce67-592f-83d3-8d72e9edacb8 with scrape type 2
2026-04-27 08:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15caa874-ce67-592f-83d3-8d72e9edacb8, identifier: AJ80010
2026-04-27 08:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15caa874-ce67-592f-83d3-8d72e9edacb8 with identifier: AJ80010
2026-04-27 08:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15caa874-ce67-592f-83d3-8d72e9edacb8 with identifier: AJ80010
2026-04-27 08:13:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15caa874-ce67-592f-83d3-8d72e9edacb8 with identifier: AJ80010 to the API
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 186,
'expiration_date': '2026-04-27T15:05:09Z',
'fuel_type': 'petrol',
'id': '15caa874-ce67-592f-83d3-8d72e9edacb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ80010',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mazda',
'model': '3',
'odometer': 47,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-06-22',
'seller_name': None,
'title': 'Mazda 3 2.0 e-Skyactiv-X Mild-Hybrid Evolution-X',
'transmission': 'manual',
'trim': 'Evolution-X',
'year': 2021}
2026-04-27 08:13:04 [auto1.es] INFO: Saving data for AJ80010: {'auction_closing_time': 1777302309.0, 'created_time': 1777018578.182628, 'has_photos': True, 'last_price_update_time': 1777277584.303388}
2026-04-27 08:13:04 [auto1.es] INFO: Found listing with ID: YR69751
2026-04-27 08:13:04 [auto1.es] INFO: Scrape type for YR69751: 1
2026-04-27 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT34146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891d410>
2026-04-27 08:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_4617795d8180dbe3072b322d766491dd.jpg saved to cache
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:13:04 [auto1.es] INFO: Found listing with ID: TZ63000
2026-04-27 08:13:04 [auto1.es] INFO: Scrape type for TZ63000: 2
2026-04-27 08:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8034301c-b458-5a39-8854-56f1c34e1eb4 with identifier: TZ63000
2026-04-27 08:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8034301c-b458-5a39-8854-56f1c34e1eb4 with scrape type 2
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8034301c-b458-5a39-8854-56f1c34e1eb4 with scrape type 2
2026-04-27 08:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8034301c-b458-5a39-8854-56f1c34e1eb4, identifier: TZ63000
2026-04-27 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8034301c-b458-5a39-8854-56f1c34e1eb4 with identifier: TZ63000
2026-04-27 08:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8034301c-b458-5a39-8854-56f1c34e1eb4 with identifier: TZ63000
2026-04-27 08:13:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8034301c-b458-5a39-8854-56f1c34e1eb4 with identifier: TZ63000 to the API
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:46:05Z',
'fuel_type': 'hybrid',
'id': '8034301c-b458-5a39-8854-56f1c34e1eb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ63000',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 38383,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-03-10',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2019}
2026-04-27 08:13:04 [auto1.es] INFO: Saving data for TZ63000: {'auction_closing_time': 1777304765.0, 'created_time': 1777021077.234211, 'has_photos': True, 'last_price_update_time': 1777277584.751368}
2026-04-27 08:13:04 [auto1.es] INFO: Found listing with ID: ED14239
2026-04-27 08:13:04 [auto1.es] INFO: Scrape type for ED14239: 1
2026-04-27 08:13:04 [auto1.es] INFO: Found listing with ID: ZF08662
2026-04-27 08:13:04 [auto1.es] INFO: Scrape type for ZF08662: 2
2026-04-27 08:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f with identifier: ZF08662
2026-04-27 08:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f with scrape type 2
2026-04-27 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f with scrape type 2
2026-04-27 08:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f, identifier: ZF08662
2026-04-27 08:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f with identifier: ZF08662
2026-04-27 08:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f with identifier: ZF08662
2026-04-27 08:13:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f677d0a-4e69-5dbd-99a4-a3f9b04d089f with identifier: ZF08662 to the API
2026-04-27 08:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-04-27T15:12:23Z',
'fuel_type': 'diesel',
'id': '5f677d0a-4e69-5dbd-99a4-a3f9b04d089f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF08662',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '207',
'odometer': 129640,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-04-07',
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2009}
2026-04-27 08:13:05 [auto1.es] INFO: Saving data for ZF08662: {'auction_closing_time': 1777302743.0, 'created_time': 1777018413.831424, 'has_photos': True, 'last_price_update_time': 1777277585.149131}
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: DF70017
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for DF70017: 1
2026-04-27 08:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK46924> (referer: https://www.auto1.com/v1/car-details-view/NK46924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: EP60983
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for EP60983: 1
2026-04-27 08:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: ZF48628
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for ZF48628: 1
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: SV04678
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for SV04678: 1
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: CF16262
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for CF16262: 1
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: RS08553
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for RS08553: 2
2026-04-27 08:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db635789-316d-5da2-b881-bd4ca5da7489 with identifier: RS08553
2026-04-27 08:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db635789-316d-5da2-b881-bd4ca5da7489 with scrape type 2
2026-04-27 08:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db635789-316d-5da2-b881-bd4ca5da7489 with scrape type 2
2026-04-27 08:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db635789-316d-5da2-b881-bd4ca5da7489, identifier: RS08553
2026-04-27 08:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db635789-316d-5da2-b881-bd4ca5da7489 with identifier: RS08553
2026-04-27 08:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db635789-316d-5da2-b881-bd4ca5da7489 with identifier: RS08553
2026-04-27 08:13:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db635789-316d-5da2-b881-bd4ca5da7489 with identifier: RS08553 to the API
2026-04-27 08:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:12:18Z',
'fuel_type': 'diesel',
'id': 'db635789-316d-5da2-b881-bd4ca5da7489',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS08553',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Corsa',
'odometer': 89576,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-10-30',
'seller_name': None,
'title': 'Opel Corsa 1.5 CDTI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2019}
2026-04-27 08:13:05 [auto1.es] INFO: Saving data for RS08553: {'auction_closing_time': 1777302738.0, 'created_time': 1777018177.185323, 'has_photos': True, 'last_price_update_time': 1777277585.627469}
2026-04-27 08:13:05 [auto1.es] INFO: Found listing with ID: UT90004
2026-04-27 08:13:05 [auto1.es] INFO: Scrape type for UT90004: 2
2026-04-27 08:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004
2026-04-27 08:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with scrape type 2
2026-04-27 08:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with scrape type 2
2026-04-27 08:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ef7c017-80d9-5808-a56b-bfc1db8f8607, identifier: UT90004
2026-04-27 08:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004
2026-04-27 08:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004
2026-04-27 08:13:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ef7c017-80d9-5808-a56b-bfc1db8f8607 with identifier: UT90004 to the API
2026-04-27 08:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 175,
'expiration_date': '2026-04-27T15:46:10Z',
'fuel_type': 'petrol',
'id': '5ef7c017-80d9-5808-a56b-bfc1db8f8607',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT90004',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'MINI',
'model': 'MINI',
'odometer': 163157,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-03-27',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-04-27 08:13:06 [auto1.es] INFO: Saving data for UT90004: {'auction_closing_time': 1777304770.0, 'created_time': 1777021925.283642, 'has_photos': True, 'last_price_update_time': 1777277586.195631}
2026-04-27 08:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG79716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20f0af04-bd99-5940-b8f9-a64cf2697980 with identifier: NK46924
2026-04-27 08:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f0af04-bd99-5940-b8f9-a64cf2697980 with scrape type 1
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_ea59e6c098955ceddbb6257092320fca.jpg not downloaded yet
2026-04-27 08:13:06 [auto1.es] INFO: Found listing with ID: VV61433
2026-04-27 08:13:06 [auto1.es] INFO: Scrape type for VV61433: 1
2026-04-27 08:13:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_31d2f5b41424d0fb2c5bf9e86d924171.jpg not downloaded yet
2026-04-27 08:13:06 [auto1.es] INFO: Found listing with ID: UN08955
2026-04-27 08:13:06 [auto1.es] INFO: Scrape type for UN08955: 2
2026-04-27 08:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f493e273-1270-5195-9ee5-4b985eacf07a with identifier: UN08955
2026-04-27 08:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f493e273-1270-5195-9ee5-4b985eacf07a with scrape type 2
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f493e273-1270-5195-9ee5-4b985eacf07a with scrape type 2
2026-04-27 08:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f493e273-1270-5195-9ee5-4b985eacf07a, identifier: UN08955
2026-04-27 08:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f493e273-1270-5195-9ee5-4b985eacf07a with identifier: UN08955
2026-04-27 08:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f493e273-1270-5195-9ee5-4b985eacf07a with identifier: UN08955
2026-04-27 08:13:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f493e273-1270-5195-9ee5-4b985eacf07a with identifier: UN08955 to the API
2026-04-27 08:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-04-27T15:33:26Z',
'fuel_type': 'diesel',
'id': 'f493e273-1270-5195-9ee5-4b985eacf07a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN08955',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': '3er',
'odometer': 147622,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-11-03',
'seller_name': None,
'title': 'BMW 3er 330d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-04-27 08:13:06 [auto1.es] INFO: Saving data for UN08955: {'auction_closing_time': 1777304006.0, 'created_time': 1776940985.490618, 'has_photos': True, 'last_price_update_time': 1777277586.636052}
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_bc30e901c8078e041cb13d704971df4b.jpg not downloaded yet
2026-04-27 08:13:06 [auto1.es] INFO: Found listing with ID: ZH33110
2026-04-27 08:13:06 [auto1.es] INFO: Scrape type for ZH33110: 1
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_cf1ce8ec2b108d0633f740c1a95570b9.jpg not downloaded yet
2026-04-27 08:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_ea59e6c098955ceddbb6257092320fca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:06 [auto1.es] INFO: Found listing with ID: NY78415
2026-04-27 08:13:06 [auto1.es] INFO: Scrape type for NY78415: 2
2026-04-27 08:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce with identifier: NY78415
2026-04-27 08:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce with scrape type 2
2026-04-27 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce with scrape type 2
2026-04-27 08:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce, identifier: NY78415
2026-04-27 08:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce with identifier: NY78415
2026-04-27 08:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce with identifier: NY78415
2026-04-27 08:13:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce with identifier: NY78415 to the API
2026-04-27 08:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 99,
'expiration_date': '2026-04-27T15:08:16Z',
'fuel_type': 'diesel',
'id': '5fe55f02-8bfe-5dbd-90f2-ae1024b9b4ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY78415',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 117041,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-12-21',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Aniversario Edition',
'transmission': 'manual',
'trim': '20 Aniversario Edition',
'year': 2017}
2026-04-27 08:13:07 [auto1.es] INFO: Saving data for NY78415: {'auction_closing_time': 1777302496.0, 'created_time': 1776940892.236187, 'has_photos': True, 'last_price_update_time': 1777277587.120739}
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_c795f8555a2c01ce59fe00d1eebe1d42.jpg not downloaded yet
2026-04-27 08:13:07 [auto1.es] INFO: Found listing with ID: HN20090
2026-04-27 08:13:07 [auto1.es] INFO: Scrape type for HN20090: 1
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_2d129d8b5b313e91f780e6190284a917.jpg not downloaded yet
2026-04-27 08:13:07 [auto1.es] INFO: Found listing with ID: FF25253
2026-04-27 08:13:07 [auto1.es] INFO: Scrape type for FF25253: 2
2026-04-27 08:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055bdfc1-8cd8-57a9-92c4-7f4447adeb93 with identifier: FF25253
2026-04-27 08:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055bdfc1-8cd8-57a9-92c4-7f4447adeb93 with scrape type 2
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 055bdfc1-8cd8-57a9-92c4-7f4447adeb93 with scrape type 2
2026-04-27 08:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 055bdfc1-8cd8-57a9-92c4-7f4447adeb93, identifier: FF25253
2026-04-27 08:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c0e90>
2026-04-27 08:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_ea59e6c098955ceddbb6257092320fca.jpg saved to cache
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 055bdfc1-8cd8-57a9-92c4-7f4447adeb93 with identifier: FF25253
2026-04-27 08:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 055bdfc1-8cd8-57a9-92c4-7f4447adeb93 with identifier: FF25253
2026-04-27 08:13:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 055bdfc1-8cd8-57a9-92c4-7f4447adeb93 with identifier: FF25253 to the API
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:07:35Z',
'fuel_type': 'diesel',
'id': '055bdfc1-8cd8-57a9-92c4-7f4447adeb93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF25253',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Saab',
'model': '9-3',
'odometer': 335622,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-05-10',
'seller_name': None,
'title': 'Saab 9-3 1.9 TiD Vector',
'transmission': 'manual',
'trim': 'Vector',
'year': 2007}
2026-04-27 08:13:07 [auto1.es] INFO: Saving data for FF25253: {'auction_closing_time': 1777302455.0, 'created_time': 1777018112.918338, 'has_photos': True, 'last_price_update_time': 1777277587.578785}
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_5bf4cb72a7db155c06e710953ae9945c.jpg not downloaded yet
2026-04-27 08:13:07 [auto1.es] INFO: Found listing with ID: WA17800
2026-04-27 08:13:07 [auto1.es] INFO: Scrape type for WA17800: 2
2026-04-27 08:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4476d28d-f12f-55bd-a46d-1b587ddd77b3 with identifier: WA17800
2026-04-27 08:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4476d28d-f12f-55bd-a46d-1b587ddd77b3 with scrape type 2
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4476d28d-f12f-55bd-a46d-1b587ddd77b3 with scrape type 2
2026-04-27 08:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4476d28d-f12f-55bd-a46d-1b587ddd77b3, identifier: WA17800
2026-04-27 08:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4476d28d-f12f-55bd-a46d-1b587ddd77b3 with identifier: WA17800
2026-04-27 08:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4476d28d-f12f-55bd-a46d-1b587ddd77b3 with identifier: WA17800
2026-04-27 08:13:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4476d28d-f12f-55bd-a46d-1b587ddd77b3 with identifier: WA17800 to the API
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:21:31Z',
'fuel_type': 'petrol',
'id': '4476d28d-f12f-55bd-a46d-1b587ddd77b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA17800',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Hyundai',
'model': 'Kona',
'odometer': 158334,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-01-22',
'seller_name': None,
'title': 'Hyundai Kona 1.0 TGDI Klass 2WD',
'transmission': 'manual',
'trim': 'Klass 2WD',
'year': 2019}
2026-04-27 08:13:08 [auto1.es] INFO: Saving data for WA17800: {'auction_closing_time': 1777303291.0, 'created_time': 1776940957.649538, 'has_photos': True, 'last_price_update_time': 1777277588.060556}
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_baf885de502a453eb89737fee5a97576.jpg not downloaded yet
2026-04-27 08:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV17541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:08 [auto1.es] INFO: Found listing with ID: YD38751
2026-04-27 08:13:08 [auto1.es] INFO: Scrape type for YD38751: 2
2026-04-27 08:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751
2026-04-27 08:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abb1501-a1f6-5fa2-afb8-87638f07952b with scrape type 2
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7abb1501-a1f6-5fa2-afb8-87638f07952b with scrape type 2
2026-04-27 08:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7abb1501-a1f6-5fa2-afb8-87638f07952b, identifier: YD38751
2026-04-27 08:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751
2026-04-27 08:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751
2026-04-27 08:13:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751 to the API
2026-04-27 08:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:34:25Z',
'fuel_type': 'diesel',
'id': '7abb1501-a1f6-5fa2-afb8-87638f07952b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD38751',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Jeep',
'model': 'Compass',
'odometer': 119057,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-03-13',
'seller_name': None,
'title': 'Jeep Compass 2.0 M-Jet Longitude 4WD',
'transmission': 'manual',
'trim': 'Longitude 4WD',
'year': 2018}
2026-04-27 08:13:08 [auto1.es] INFO: Saving data for YD38751: {'auction_closing_time': 1777304065.0, 'created_time': 1777018259.456191, 'has_photos': True, 'last_price_update_time': 1777277588.512888}
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_e6b180898e533572a5f7b5cfe592db5c.jpg not downloaded yet
2026-04-27 08:13:08 [auto1.es] INFO: Found listing with ID: YV80306
2026-04-27 08:13:08 [auto1.es] INFO: Scrape type for YV80306: 1
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_7b12f01951bfbd64493eeee2ed74142f.jpg not downloaded yet
2026-04-27 08:13:08 [auto1.es] INFO: Found listing with ID: HT16448
2026-04-27 08:13:08 [auto1.es] INFO: Scrape type for HT16448: 1
2026-04-27 08:13:08 [auto1.es] INFO: Found listing with ID: WD69426
2026-04-27 08:13:08 [auto1.es] INFO: Scrape type for WD69426: 2
2026-04-27 08:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2 with identifier: WD69426
2026-04-27 08:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2 with scrape type 2
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2 with scrape type 2
2026-04-27 08:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2, identifier: WD69426
2026-04-27 08:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2 with identifier: WD69426
2026-04-27 08:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2 with identifier: WD69426
2026-04-27 08:13:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2 with identifier: WD69426 to the API
2026-04-27 08:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:48:26Z',
'fuel_type': 'petrol',
'id': '83fa728f-45b6-54f0-ab8a-0ed8a25b7cb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD69426',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Megane',
'odometer': 46289,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-08-26',
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2020}
2026-04-27 08:13:08 [auto1.es] INFO: Saving data for WD69426: {'auction_closing_time': 1777304906.0, 'created_time': 1776940935.579105, 'has_photos': True, 'last_price_update_time': 1777277588.984345}
2026-04-27 08:13:09 [auto1.es] INFO: Found listing with ID: AA12665
2026-04-27 08:13:09 [auto1.es] INFO: Scrape type for AA12665: 2
2026-04-27 08:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e81ed6c-e776-5364-95f2-ba76ea0e640a with identifier: AA12665
2026-04-27 08:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e81ed6c-e776-5364-95f2-ba76ea0e640a with scrape type 2
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e81ed6c-e776-5364-95f2-ba76ea0e640a with scrape type 2
2026-04-27 08:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e81ed6c-e776-5364-95f2-ba76ea0e640a, identifier: AA12665
2026-04-27 08:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_baf885de502a453eb89737fee5a97576.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e81ed6c-e776-5364-95f2-ba76ea0e640a with identifier: AA12665
2026-04-27 08:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e81ed6c-e776-5364-95f2-ba76ea0e640a with identifier: AA12665
2026-04-27 08:13:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e81ed6c-e776-5364-95f2-ba76ea0e640a with identifier: AA12665 to the API
2026-04-27 08:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-04-27T15:00:18Z',
'fuel_type': 'diesel',
'id': '9e81ed6c-e776-5364-95f2-ba76ea0e640a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA12665',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Clio',
'odometer': 283771,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-06-30',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2009}
2026-04-27 08:13:09 [auto1.es] INFO: Saving data for AA12665: {'auction_closing_time': 1777302018.0, 'created_time': 1777020366.893999, 'has_photos': True, 'last_price_update_time': 1777277589.455845}
2026-04-27 08:13:09 [auto1.es] INFO: Found listing with ID: DR86630
2026-04-27 08:13:09 [auto1.es] INFO: Scrape type for DR86630: 2
2026-04-27 08:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630
2026-04-27 08:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 195e33b3-7d85-502f-a86f-4d03683d9578 with scrape type 2
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 195e33b3-7d85-502f-a86f-4d03683d9578 with scrape type 2
2026-04-27 08:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 195e33b3-7d85-502f-a86f-4d03683d9578, identifier: DR86630
2026-04-27 08:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630
2026-04-27 08:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630
2026-04-27 08:13:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630 to the API
2026-04-27 08:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:07:27Z',
'fuel_type': 'diesel',
'id': '195e33b3-7d85-502f-a86f-4d03683d9578',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR86630',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ssangyong',
'model': 'Korando',
'odometer': 117225,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-10-23',
'seller_name': None,
'title': 'Ssangyong Korando 2.0 TD C 4x2',
'transmission': 'manual',
'trim': 'C 4x2',
'year': 2014}
2026-04-27 08:13:09 [auto1.es] INFO: Saving data for DR86630: {'auction_closing_time': 1777302447.0, 'created_time': 1777020115.750729, 'has_photos': True, 'last_price_update_time': 1777277589.833144}
2026-04-27 08:13:09 [auto1.es] INFO: Found listing with ID: XC08614
2026-04-27 08:13:09 [auto1.es] INFO: Scrape type for XC08614: 2
2026-04-27 08:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c23fab-1c34-575e-8bbe-dec4089c4644 with identifier: XC08614
2026-04-27 08:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c23fab-1c34-575e-8bbe-dec4089c4644 with scrape type 2
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87c23fab-1c34-575e-8bbe-dec4089c4644 with scrape type 2
2026-04-27 08:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87c23fab-1c34-575e-8bbe-dec4089c4644, identifier: XC08614
2026-04-27 08:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87c23fab-1c34-575e-8bbe-dec4089c4644 with identifier: XC08614
2026-04-27 08:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87c23fab-1c34-575e-8bbe-dec4089c4644 with identifier: XC08614
2026-04-27 08:13:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87c23fab-1c34-575e-8bbe-dec4089c4644 with identifier: XC08614 to the API
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-04-27T15:55:26Z',
'fuel_type': 'petrol',
'id': '87c23fab-1c34-575e-8bbe-dec4089c4644',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC08614',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 212613,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-07-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 170 Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2005}
2026-04-27 08:13:10 [auto1.es] INFO: Saving data for XC08614: {'auction_closing_time': 1777305326.0, 'created_time': 1777021244.515522, 'has_photos': True, 'last_price_update_time': 1777277590.26945}
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483819d0>
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_baf885de502a453eb89737fee5a97576.jpg saved to cache
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: SR25857
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for SR25857: 1
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: XW94395
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for XW94395: 1
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: HD36050
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for HD36050: 1
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: MS83091
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for MS83091: 1
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: KA55967
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for KA55967: 2
2026-04-27 08:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c60f1af-891c-5274-892f-38923c4d43a4 with identifier: KA55967
2026-04-27 08:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c60f1af-891c-5274-892f-38923c4d43a4 with scrape type 2
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c60f1af-891c-5274-892f-38923c4d43a4 with scrape type 2
2026-04-27 08:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c60f1af-891c-5274-892f-38923c4d43a4, identifier: KA55967
2026-04-27 08:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c60f1af-891c-5274-892f-38923c4d43a4 with identifier: KA55967
2026-04-27 08:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c60f1af-891c-5274-892f-38923c4d43a4 with identifier: KA55967
2026-04-27 08:13:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c60f1af-891c-5274-892f-38923c4d43a4 with identifier: KA55967 to the API
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:16:20Z',
'fuel_type': 'petrol',
'id': '5c60f1af-891c-5274-892f-38923c4d43a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA55967',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 179412,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-03-08',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2010}
2026-04-27 08:13:10 [auto1.es] INFO: Saving data for KA55967: {'auction_closing_time': 1777302980.0, 'created_time': 1777020600.161711, 'has_photos': True, 'last_price_update_time': 1777277590.745568}
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: JN40104
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for JN40104: 1
2026-04-27 08:13:10 [auto1.es] INFO: Found listing with ID: FK25349
2026-04-27 08:13:10 [auto1.es] INFO: Scrape type for FK25349: 1
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA89344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN25285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX59990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT01527> (referer: https://www.auto1.com/v1/car-details-view/ZT01527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a8ee4b-83e9-59ea-b4c4-42f323199542 with identifier: ZT01527
2026-04-27 08:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a8ee4b-83e9-59ea-b4c4-42f323199542 with scrape type 1
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_816f2202b03d9ed1640ba3442ad1415b.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_068222ee5b025e775ae19dfe70c79573.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_b785ae76461777c22ca006148a59c04c.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_57ca96e5c34cf73281a63d9b5595143c.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_49b783ee86513f5ea851b86d8f5982bd.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_14bbff3173fdd9d60a2cded99fb9a193.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_59d32b0660c50e027113b0881dac90b2.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_229f53fc9b4f98b6791dc476dadf0ab4.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_f21c573ab338feabb91229ca880556e8.jpg not downloaded yet
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_d51758c96157c978116e8c47ea7d40ca.jpg not downloaded yet
2026-04-27 08:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM93075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_d51758c96157c978116e8c47ea7d40ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048806090>
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_d51758c96157c978116e8c47ea7d40ca.jpg saved to cache
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV63952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR69751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_f21c573ab338feabb91229ca880556e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF70017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e0990>
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_f21c573ab338feabb91229ca880556e8.jpg saved to cache
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_229f53fc9b4f98b6791dc476dadf0ab4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:13:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:13:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823c7d0>
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_229f53fc9b4f98b6791dc476dadf0ab4.jpg saved to cache
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW30711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_59d32b0660c50e027113b0881dac90b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528a50>
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_59d32b0660c50e027113b0881dac90b2.jpg saved to cache
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH33110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_14bbff3173fdd9d60a2cded99fb9a193.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b0c50>
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_14bbff3173fdd9d60a2cded99fb9a193.jpg saved to cache
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV17541> (referer: https://www.auto1.com/v1/car-details-view/NV17541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA89344> (referer: https://www.auto1.com/v1/car-details-view/RA89344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5d00079-18e8-5805-8441-bd68ab084327 with identifier: NV17541
2026-04-27 08:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d00079-18e8-5805-8441-bd68ab084327 with scrape type 1
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_8868360311fbb8a29976705eabc6b65d.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_22be531131146de33c8d335fe510235b.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_6bb5545bdc941102a075f872e36bfc9e.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6483446a-a314-51b3-9a97-1e7f8231c775 with identifier: RA89344
2026-04-27 08:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6483446a-a314-51b3-9a97-1e7f8231c775 with scrape type 1
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_61d84b0ef61db704207d201628b29a04.jpg not downloaded yet
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_57ca96e5c34cf73281a63d9b5595143c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_d4513ced97c011bf17d3b19d61691e78.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_112f58754afdc988b1c8d5fd434fa01f.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_46dcd89abdb1a954fa02ada29a518ef4.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_52217e8f7880c9ae3f209379463d7bc7.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bdbd3def3dc9de0bed1a1d6faee296f5.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_60ec2bca0868f58bce942d3603053f67.jpg not downloaded yet
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_4454e8226c43d21fd8087596193b4866.jpg not downloaded yet
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_61d84b0ef61db704207d201628b29a04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_493f621df17b3227a8d916a73fc02eaa.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_52aff2488d58e554d12193c45cf82687.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b3a9be9c4c387e7864f2d0468e130c5.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_043771969152d519ab279e3bfdb77b15.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ed02ff30896a1efbbb1bbad31263836a.jpg not downloaded yet
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048709490>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_57ca96e5c34cf73281a63d9b5595143c.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bc63bf862405fdfff0f31c3385bdcfbb.jpg not downloaded yet
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_b5e130003da22229cd47382836d91024.jpg not downloaded yet
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_4454e8226c43d21fd8087596193b4866.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b4fb02fa7625d9f7f6f7fb376cf8b7b.jpg not downloaded yet
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b5bd0>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_61d84b0ef61db704207d201628b29a04.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ef74d40bfc724578bec926d5c8364339.jpg not downloaded yet
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486612d0>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_4454e8226c43d21fd8087596193b4866.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bc63bf862405fdfff0f31c3385bdcfbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048852a50>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bc63bf862405fdfff0f31c3385bdcfbb.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ef74d40bfc724578bec926d5c8364339.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b4fb02fa7625d9f7f6f7fb376cf8b7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484de850>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ef74d40bfc724578bec926d5c8364339.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_b5e130003da22229cd47382836d91024.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488923d0>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b4fb02fa7625d9f7f6f7fb376cf8b7b.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:13:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:13:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048212f90>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_b5e130003da22229cd47382836d91024.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_49b783ee86513f5ea851b86d8f5982bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ed02ff30896a1efbbb1bbad31263836a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b3a9be9c4c387e7864f2d0468e130c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048941dd0>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_49b783ee86513f5ea851b86d8f5982bd.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484dfe90>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ed02ff30896a1efbbb1bbad31263836a.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:13:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:13:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823c3d0>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b3a9be9c4c387e7864f2d0468e130c5.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_043771969152d519ab279e3bfdb77b15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048571dd0>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_043771969152d519ab279e3bfdb77b15.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_493f621df17b3227a8d916a73fc02eaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486603d0>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_493f621df17b3227a8d916a73fc02eaa.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_60ec2bca0868f58bce942d3603053f67.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bdbd3def3dc9de0bed1a1d6faee296f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048213010>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_60ec2bca0868f58bce942d3603053f67.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048382a50>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bdbd3def3dc9de0bed1a1d6faee296f5.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_52217e8f7880c9ae3f209379463d7bc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH40382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483c2f10>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_52217e8f7880c9ae3f209379463d7bc7.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_46dcd89abdb1a954fa02ada29a518ef4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_112f58754afdc988b1c8d5fd434fa01f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488faa50>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_46dcd89abdb1a954fa02ada29a518ef4.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484deb50>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_112f58754afdc988b1c8d5fd434fa01f.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6483446a-a314-51b3-9a97-1e7f8231c775
2026-04-27 08:13:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6483446a-a314-51b3-9a97-1e7f8231c775, skipping ID generation
2026-04-27 08:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6483446a-a314-51b3-9a97-1e7f8231c775 with scrape type 1
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6483446a-a314-51b3-9a97-1e7f8231c775 sending to next pipeline
2026-04-27 08:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6483446a-a314-51b3-9a97-1e7f8231c775, identifier: RA89344
2026-04-27 08:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6483446a-a314-51b3-9a97-1e7f8231c775 with identifier: RA89344
2026-04-27 08:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6483446a-a314-51b3-9a97-1e7f8231c775 with identifier: RA89344
2026-04-27 08:13:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6483446a-a314-51b3-9a97-1e7f8231c775 with identifier: RA89344 to the API
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_112f58754afdc988b1c8d5fd434fa01f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Malaga',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 132,
'expiration_date': '2026-04-27T15:12:42Z',
'fuel_type': 'petrol',
'id': '6483446a-a314-51b3-9a97-1e7f8231c775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 36.7202,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA89344',
'listing': 'auction',
'location': 'ES, Málaga',
'location_confidence': 'geocoded',
'longitude': -4.4203,
'make': 'Kia',
'model': 'Sportage',
'odometer': 122899,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_61d84b0ef61db704207d201628b29a04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_112f58754afdc988b1c8d5fd434fa01f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_52217e8f7880c9ae3f209379463d7bc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2317695,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_60ec2bca0868f58bce942d3603053f67.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_493f621df17b3227a8d916a73fc02eaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289751,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b3a9be9c4c387e7864f2d0468e130c5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ed02ff30896a1efbbb1bbad31263836a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299850,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_b5e130003da22229cd47382836d91024.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_8b4fb02fa7625d9f7f6f7fb376cf8b7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6483446a-a314-51b3-9a97-1e7f8231c775/6483446a-a314-51b3-9a97-1e7f8231c775_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/8b/398b9491b76a9a9f4488539e63f579c8/pa/RA89344_ef74d40bfc724578bec926d5c8364339.jpg',
'Width': 800}],
'postal_code': '29001',
'price': 0,
'price_includes_vat': True,
'province': 'Málaga',
'province_code': 'ES-MA',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI X-Tech 2WD',
'transmission': 'manual',
'trim': 'X-Tech 2WD',
'year': 2017}
2026-04-27 08:13:21 [auto1.es] INFO: Saving data for RA89344: {'created_time': 1777277601.736663, 'last_price_update_time': 1777277601.736673, 'has_photos': True, 'auction_closing_time': 1777302762.0}
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_d4513ced97c011bf17d3b19d61691e78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_52aff2488d58e554d12193c45cf82687.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW09077> (referer: https://www.auto1.com/v1/car-details-view/NW09077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA43187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_8868360311fbb8a29976705eabc6b65d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e2210>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_d4513ced97c011bf17d3b19d61691e78.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7af50>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_52aff2488d58e554d12193c45cf82687.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077
2026-04-27 08:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with scrape type 1
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_d119a7cf7a958ed8cd89e0d81aada862.jpg not downloaded yet
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057232e90>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_8868360311fbb8a29976705eabc6b65d.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_22be531131146de33c8d335fe510235b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_6bb5545bdc941102a075f872e36bfc9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2159fb4268ba986a255106690234a934.jpg not downloaded yet
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_068222ee5b025e775ae19dfe70c79573.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_1fb45a7e85f5cdd1cf31674adac005e4.jpg not downloaded yet
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_93e73cdbd7e235e09c464d8aa42f543a.jpg not downloaded yet
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_af6c1b66f7f82b8982a5c29a9bc731bb.jpg not downloaded yet
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2ba4a8ad2e308acd6fd9732d722fb969.jpg not downloaded yet
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_816f2202b03d9ed1640ba3442ad1415b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_d119a7cf7a958ed8cd89e0d81aada862.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04889e210>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_22be531131146de33c8d335fe510235b.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048769ed0>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_6bb5545bdc941102a075f872e36bfc9e.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5d00079-18e8-5805-8441-bd68ab084327
2026-04-27 08:13:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5d00079-18e8-5805-8441-bd68ab084327, skipping ID generation
2026-04-27 08:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d00079-18e8-5805-8441-bd68ab084327 with scrape type 1
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5d00079-18e8-5805-8441-bd68ab084327 sending to next pipeline
2026-04-27 08:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a5d00079-18e8-5805-8441-bd68ab084327, identifier: NV17541
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ab6d0>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_068222ee5b025e775ae19dfe70c79573.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a5d00079-18e8-5805-8441-bd68ab084327 with identifier: NV17541
2026-04-27 08:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a5d00079-18e8-5805-8441-bd68ab084327 with identifier: NV17541
2026-04-27 08:13:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a5d00079-18e8-5805-8441-bd68ab084327 with identifier: NV17541 to the API
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_6bb5545bdc941102a075f872e36bfc9e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '1.7L',
'engine_horse_power': 102,
'expiration_date': '2026-04-27T15:44:35Z',
'fuel_type': 'diesel',
'id': 'a5d00079-18e8-5805-8441-bd68ab084327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV17541',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 105663,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_8868360311fbb8a29976705eabc6b65d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_22be531131146de33c8d335fe510235b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_6bb5545bdc941102a075f872e36bfc9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_d4513ced97c011bf17d3b19d61691e78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_46dcd89abdb1a954fa02ada29a518ef4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bdbd3def3dc9de0bed1a1d6faee296f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_4454e8226c43d21fd8087596193b4866.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_52aff2488d58e554d12193c45cf82687.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_043771969152d519ab279e3bfdb77b15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d00079-18e8-5805-8441-bd68ab084327/a5d00079-18e8-5805-8441-bd68ab084327_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/6e/716e75df447d9d031bd0228b16d9ceb7/pa/NV17541_bc63bf862405fdfff0f31c3385bdcfbb.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2020-11-15',
'seats_number': 2,
'seller_name': None,
'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
'transmission': 'manual',
'trim': 'FWD lang',
'year': 2020}
2026-04-27 08:13:22 [auto1.es] INFO: Saving data for NV17541: {'created_time': 1777277602.635077, 'last_price_update_time': 1777277602.635087, 'has_photos': True, 'auction_closing_time': 1777304675.0}
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2ba4a8ad2e308acd6fd9732d722fb969.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_af6c1b66f7f82b8982a5c29a9bc731bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42cd0>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_816f2202b03d9ed1640ba3442ad1415b.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a4190>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_d119a7cf7a958ed8cd89e0d81aada862.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS39417> (referer: https://www.auto1.com/v1/car-details-view/FS39417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048930e90>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2ba4a8ad2e308acd6fd9732d722fb969.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048339710>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_af6c1b66f7f82b8982a5c29a9bc731bb.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_1fb45a7e85f5cdd1cf31674adac005e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06517706-874a-57c6-a406-7c8c7b19a5f4 with identifier: FS39417
2026-04-27 08:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06517706-874a-57c6-a406-7c8c7b19a5f4 with scrape type 1
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_8a7fc7d74c0c7d51b722b0d03387ae2b.jpg not downloaded yet
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_49c111e3b630dc8df583c56b9871856c.jpg not downloaded yet
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_b785ae76461777c22ca006148a59c04c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_2328e8d152bc9151a8e5f2faf3cf5397.jpg not downloaded yet
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_1e967549f5ef2284dda306f50bead9cc.jpg not downloaded yet
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2159fb4268ba986a255106690234a934.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_d68ec26dd33076e78608a443a8f08bc0.jpg not downloaded yet
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_e13ef49b5aec408fd1a1e0dc77e32618.jpg not downloaded yet
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487adfd0>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_1fb45a7e85f5cdd1cf31674adac005e4.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_93e73cdbd7e235e09c464d8aa42f543a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_a8ef8d82b99501780001db06c1e2a93b.jpg not downloaded yet
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_49c111e3b630dc8df583c56b9871856c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_f2f62be809eb9be0b8b2ff77b4becc1e.jpg not downloaded yet
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834cc90>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_b785ae76461777c22ca006148a59c04c.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43a8ee4b-83e9-59ea-b4c4-42f323199542
2026-04-27 08:13:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43a8ee4b-83e9-59ea-b4c4-42f323199542, skipping ID generation
2026-04-27 08:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a8ee4b-83e9-59ea-b4c4-42f323199542 with scrape type 1
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43a8ee4b-83e9-59ea-b4c4-42f323199542 sending to next pipeline
2026-04-27 08:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 43a8ee4b-83e9-59ea-b4c4-42f323199542, identifier: ZT01527
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_dd57f97cded4ffb2a60c755ff5b9bb10.jpg not downloaded yet
2026-04-27 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 43a8ee4b-83e9-59ea-b4c4-42f323199542 with identifier: ZT01527
2026-04-27 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 43a8ee4b-83e9-59ea-b4c4-42f323199542 with identifier: ZT01527
2026-04-27 08:13:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 43a8ee4b-83e9-59ea-b4c4-42f323199542 with identifier: ZT01527 to the API
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_b785ae76461777c22ca006148a59c04c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'city': 'Girona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 132,
'expiration_date': '2026-04-27T15:42:58Z',
'fuel_type': 'petrol',
'id': '43a8ee4b-83e9-59ea-b4c4-42f323199542',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.984,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT01527',
'listing': 'auction',
'location': 'ES, Girona',
'location_confidence': 'geocoded',
'longitude': 2.8198,
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 206202,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_816f2202b03d9ed1640ba3442ad1415b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_068222ee5b025e775ae19dfe70c79573.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_b785ae76461777c22ca006148a59c04c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_57ca96e5c34cf73281a63d9b5595143c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_49b783ee86513f5ea851b86d8f5982bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_14bbff3173fdd9d60a2cded99fb9a193.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_59d32b0660c50e027113b0881dac90b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481427,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_229f53fc9b4f98b6791dc476dadf0ab4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_f21c573ab338feabb91229ca880556e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8ee4b-83e9-59ea-b4c4-42f323199542/43a8ee4b-83e9-59ea-b4c4-42f323199542_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f489b791a5e04f04bd52453d3eb1207d/pa/ZT01527_d51758c96157c978116e8c47ea7d40ca.jpg',
'Width': 800}],
'postal_code': '17001',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2016-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Essence BlueDrive 2WD',
'transmission': 'manual',
'trim': 'Essence BlueDrive 2WD',
'year': 2016}
2026-04-27 08:13:23 [auto1.es] INFO: Saving data for ZT01527: {'created_time': 1777277603.578189, 'last_price_update_time': 1777277603.5782, 'has_photos': True, 'auction_closing_time': 1777304578.0}
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892310>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2159fb4268ba986a255106690234a934.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_11c117520329bdbdc5116904a57a1191.jpg not downloaded yet
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK25349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_e13ef49b5aec408fd1a1e0dc77e32618.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e0650>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_93e73cdbd7e235e09c464d8aa42f543a.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3
2026-04-27 08:13:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3020176-0079-52a8-ad9f-efa2cd6e7ef3, skipping ID generation
2026-04-27 08:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with scrape type 1
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3 sending to next pipeline
2026-04-27 08:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3020176-0079-52a8-ad9f-efa2cd6e7ef3, identifier: NW09077
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048524210>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_49c111e3b630dc8df583c56b9871856c.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077
2026-04-27 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077
2026-04-27 08:13:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077 to the API
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_93e73cdbd7e235e09c464d8aa42f543a.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Rebolledo',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.1L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:17:10Z',
'fuel_type': 'diesel',
'id': 'f3020176-0079-52a8-ad9f-efa2cd6e7ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW09077',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 259797,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_d119a7cf7a958ed8cd89e0d81aada862.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2159fb4268ba986a255106690234a934.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_1fb45a7e85f5cdd1cf31674adac005e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_93e73cdbd7e235e09c464d8aa42f543a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_af6c1b66f7f82b8982a5c29a9bc731bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3020176-0079-52a8-ad9f-efa2cd6e7ef3/f3020176-0079-52a8-ad9f-efa2cd6e7ef3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/e5/86e52a11640aac67969d0a7fd80d51b5/pa/NW09077_2ba4a8ad2e308acd6fd9732d722fb969.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2004-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T Classic',
'transmission': 'automatic',
'trim': 'T Classic',
'year': 2004}
2026-04-27 08:13:24 [auto1.es] INFO: Saving data for NW09077: {'created_time': 1777277604.138463, 'last_price_update_time': 1777277604.138475, 'has_photos': True, 'auction_closing_time': 1777303030.0}
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_1e967549f5ef2284dda306f50bead9cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF70017> (referer: https://www.auto1.com/v1/car-details-view/DF70017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048892d10>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_e13ef49b5aec408fd1a1e0dc77e32618.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_dd57f97cded4ffb2a60c755ff5b9bb10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_a8ef8d82b99501780001db06c1e2a93b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884610>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_1e967549f5ef2284dda306f50bead9cc.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_f2f62be809eb9be0b8b2ff77b4becc1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_2328e8d152bc9151a8e5f2faf3cf5397.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 210e0493-0c26-5c8f-a118-0ad8f76c5dfc with identifier: DF70017
2026-04-27 08:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc with scrape type 1
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_4b19a6a42cf56679954eef4441d48fe5.jpg not downloaded yet
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481dac50>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_dd57f97cded4ffb2a60c755ff5b9bb10.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bd750>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_a8ef8d82b99501780001db06c1e2a93b.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_087c3eeb5d0b0469ab0d2e09707459bb.jpg not downloaded yet
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2dd0>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_f2f62be809eb9be0b8b2ff77b4becc1e.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f8b90>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_2328e8d152bc9151a8e5f2faf3cf5397.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_012a05d6ae84150f3da6557d52c0923c.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_34ac965bcbb156282d19492455c05ce0.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_07246bf164f7853d3ee50f145cb04671.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_27d09fd3b62ba657efd0fe02de0f1af0.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_bd8e718359ce6c8e27451077dcbf0c8c.jpg not downloaded yet
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_8a7fc7d74c0c7d51b722b0d03387ae2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_7613713ef6eba05926c37fbb0e66b2e8.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_5d00987ac001e6984cd3b24ec138a79a.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_c5b607693643d8745a4c10358685bd03.jpg not downloaded yet
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_bd8e718359ce6c8e27451077dcbf0c8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:13:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0573e7690>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_8a7fc7d74c0c7d51b722b0d03387ae2b.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_c5b607693643d8745a4c10358685bd03.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fa010>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_bd8e718359ce6c8e27451077dcbf0c8c.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7bd50>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_c5b607693643d8745a4c10358685bd03.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_5d00987ac001e6984cd3b24ec138a79a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_7613713ef6eba05926c37fbb0e66b2e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852d950>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_5d00987ac001e6984cd3b24ec138a79a.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_11c117520329bdbdc5116904a57a1191.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a3390>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_7613713ef6eba05926c37fbb0e66b2e8.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_07246bf164f7853d3ee50f145cb04671.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_34ac965bcbb156282d19492455c05ce0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_27d09fd3b62ba657efd0fe02de0f1af0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851390>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_11c117520329bdbdc5116904a57a1191.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a83f50>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_07246bf164f7853d3ee50f145cb04671.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b6b50>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_34ac965bcbb156282d19492455c05ce0.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048204f90>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_27d09fd3b62ba657efd0fe02de0f1af0.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_087c3eeb5d0b0469ab0d2e09707459bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM93075> (referer: https://www.auto1.com/v1/car-details-view/TM93075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_4b19a6a42cf56679954eef4441d48fe5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882af90>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_087c3eeb5d0b0469ab0d2e09707459bb.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 with identifier: TM93075
2026-04-27 08:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 with scrape type 1
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_e2b4cdc9cfaee207f07fb9fcaa74a0b9.jpg not downloaded yet
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_6beec6a0c9d66e338f0cf7476d0a1d31.jpg not downloaded yet
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_265704148dcdb56688b6d2c2e599562f.jpg not downloaded yet
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a79390>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_4b19a6a42cf56679954eef4441d48fe5.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_146fd000caa714f84fa5231d3e5ec112.jpg not downloaded yet
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_cf2db7ed7f9974d847a7515b0a3915ca.jpg not downloaded yet
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_88528a5840a45cc164c2db706bd90558.jpg not downloaded yet
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_df5569c278260d65642a57f87e7c6377.jpg not downloaded yet
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_393b1698712ed2d151866aeac493512e.jpg not downloaded yet
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_1c8e9727830dab6f5dd6ec5f9b4d1763.jpg not downloaded yet
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_ad3b2b667db16d0378acb8a117e3341b.jpg not downloaded yet
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_d68ec26dd33076e78608a443a8f08bc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_ad3b2b667db16d0378acb8a117e3341b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7b50>
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_d68ec26dd33076e78608a443a8f08bc0.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06517706-874a-57c6-a406-7c8c7b19a5f4
2026-04-27 08:13:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06517706-874a-57c6-a406-7c8c7b19a5f4, skipping ID generation
2026-04-27 08:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06517706-874a-57c6-a406-7c8c7b19a5f4 with scrape type 1
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06517706-874a-57c6-a406-7c8c7b19a5f4 sending to next pipeline
2026-04-27 08:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 06517706-874a-57c6-a406-7c8c7b19a5f4, identifier: FS39417
2026-04-27 08:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 06517706-874a-57c6-a406-7c8c7b19a5f4 with identifier: FS39417
2026-04-27 08:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 06517706-874a-57c6-a406-7c8c7b19a5f4 with identifier: FS39417
2026-04-27 08:13:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 06517706-874a-57c6-a406-7c8c7b19a5f4 with identifier: FS39417 to the API
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_d68ec26dd33076e78608a443a8f08bc0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'city': 'Valladolid',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 86,
'expiration_date': '2026-04-27T15:28:19Z',
'fuel_type': 'diesel',
'id': '06517706-874a-57c6-a406-7c8c7b19a5f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6505,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS39417',
'listing': 'auction',
'location': 'ES, Valladolid',
'location_confidence': 'geocoded',
'longitude': -4.7287,
'make': 'Renault',
'model': 'Clio',
'odometer': 31547,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599933,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_8a7fc7d74c0c7d51b722b0d03387ae2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_49c111e3b630dc8df583c56b9871856c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_2328e8d152bc9151a8e5f2faf3cf5397.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_1e967549f5ef2284dda306f50bead9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_d68ec26dd33076e78608a443a8f08bc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_e13ef49b5aec408fd1a1e0dc77e32618.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742482,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_a8ef8d82b99501780001db06c1e2a93b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_f2f62be809eb9be0b8b2ff77b4becc1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_dd57f97cded4ffb2a60c755ff5b9bb10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06517706-874a-57c6-a406-7c8c7b19a5f4/06517706-874a-57c6-a406-7c8c7b19a5f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/ed/acedc56e16555e60fea8160bbe09a737/pa/FS39417_11c117520329bdbdc5116904a57a1191.jpg',
'Width': 800}],
'postal_code': '47001',
'price': 0,
'price_includes_vat': True,
'province': 'Valladolid',
'province_code': 'ES-VA',
'region': 'Castilla - Leon',
'region_code': 'ES-CL',
'registration_date': '2020-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 BLUE dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2020}
2026-04-27 08:13:27 [auto1.es] INFO: Saving data for FS39417: {'created_time': 1777277607.01783, 'last_price_update_time': 1777277607.017843, 'has_photos': True, 'auction_closing_time': 1777303699.0}
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_1c8e9727830dab6f5dd6ec5f9b4d1763.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_012a05d6ae84150f3da6557d52c0923c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN25285> (referer: https://www.auto1.com/v1/car-details-view/XN25285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f24d0>
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_ad3b2b667db16d0378acb8a117e3341b.jpg saved to cache
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485259d0>
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_1c8e9727830dab6f5dd6ec5f9b4d1763.jpg saved to cache
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487aea50>
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_012a05d6ae84150f3da6557d52c0923c.jpg saved to cache
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc
2026-04-27 08:13:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 210e0493-0c26-5c8f-a118-0ad8f76c5dfc, skipping ID generation
2026-04-27 08:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc with scrape type 1
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 210e0493-0c26-5c8f-a118-0ad8f76c5dfc sending to next pipeline
2026-04-27 08:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 210e0493-0c26-5c8f-a118-0ad8f76c5dfc, identifier: DF70017
2026-04-27 08:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 210e0493-0c26-5c8f-a118-0ad8f76c5dfc with identifier: DF70017
2026-04-27 08:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 210e0493-0c26-5c8f-a118-0ad8f76c5dfc with identifier: DF70017
2026-04-27 08:13:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 210e0493-0c26-5c8f-a118-0ad8f76c5dfc with identifier: DF70017 to the API
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_012a05d6ae84150f3da6557d52c0923c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Malaga',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-27T15:36:20Z',
'fuel_type': 'petrol',
'id': '210e0493-0c26-5c8f-a118-0ad8f76c5dfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 36.7202,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF70017',
'listing': 'auction',
'location': 'ES, Málaga',
'location_confidence': 'geocoded',
'longitude': -4.4203,
'make': 'Fiat',
'model': '500',
'odometer': 23779,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_4b19a6a42cf56679954eef4441d48fe5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_087c3eeb5d0b0469ab0d2e09707459bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_012a05d6ae84150f3da6557d52c0923c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_34ac965bcbb156282d19492455c05ce0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_07246bf164f7853d3ee50f145cb04671.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_27d09fd3b62ba657efd0fe02de0f1af0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_bd8e718359ce6c8e27451077dcbf0c8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_7613713ef6eba05926c37fbb0e66b2e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_5d00987ac001e6984cd3b24ec138a79a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210e0493-0c26-5c8f-a118-0ad8f76c5dfc/210e0493-0c26-5c8f-a118-0ad8f76c5dfc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/e1/07e1f3676417ae5634f8fd32987dfb46/pa/DF70017_c5b607693643d8745a4c10358685bd03.jpg',
'Width': 800}],
'postal_code': '29001',
'price': 0,
'price_includes_vat': True,
'province': 'Málaga',
'province_code': 'ES-MA',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2016-06-02',
'seats_number': 5,
'seller_name': None,
'title': "Fiat 500 1.2 Vintage'57",
'transmission': 'manual',
'trim': "Vintage'57",
'year': 2016}
2026-04-27 08:13:27 [auto1.es] INFO: Saving data for DF70017: {'created_time': 1777277607.65178, 'last_price_update_time': 1777277607.651792, 'has_photos': True, 'auction_closing_time': 1777304180.0}
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_88528a5840a45cc164c2db706bd90558.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_393b1698712ed2d151866aeac493512e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ef9668-3874-54f5-a8ad-41820e08ffef with identifier: XN25285
2026-04-27 08:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ef9668-3874-54f5-a8ad-41820e08ffef with scrape type 1
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_db4044ddb66ce9ad585025acf20be6a1.jpg not downloaded yet
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b80a1b8f0211a3996269ade731eed748.jpg not downloaded yet
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_6bcb2962b4476c268ecddc95ff820583.jpg not downloaded yet
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b2bc55f2a5484cb7592b11062eaea0d9.jpg not downloaded yet
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b5b39566c5050cad67d21ea1f5694db0.jpg not downloaded yet
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_cf2db7ed7f9974d847a7515b0a3915ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_237d018db0a55fed5e84d29c3324618a.jpg not downloaded yet
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057362010>
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_88528a5840a45cc164c2db706bd90558.jpg saved to cache
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662dd0>
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_393b1698712ed2d151866aeac493512e.jpg saved to cache
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff064b43dd0>
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_cf2db7ed7f9974d847a7515b0a3915ca.jpg saved to cache
2026-04-27 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b5b39566c5050cad67d21ea1f5694db0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481ffdd0>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b5b39566c5050cad67d21ea1f5694db0.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_237d018db0a55fed5e84d29c3324618a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_df5569c278260d65642a57f87e7c6377.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b2bc55f2a5484cb7592b11062eaea0d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_6bcb2962b4476c268ecddc95ff820583.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834d310>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_237d018db0a55fed5e84d29c3324618a.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b80a1b8f0211a3996269ade731eed748.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481dbed0>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_df5569c278260d65642a57f87e7c6377.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483ebf90>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b2bc55f2a5484cb7592b11062eaea0d9.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048829dd0>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_6bcb2962b4476c268ecddc95ff820583.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7a990>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b80a1b8f0211a3996269ade731eed748.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_265704148dcdb56688b6d2c2e599562f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_146fd000caa714f84fa5231d3e5ec112.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b7c10>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_265704148dcdb56688b6d2c2e599562f.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA43187> (referer: https://www.auto1.com/v1/car-details-view/MA43187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c3290>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_146fd000caa714f84fa5231d3e5ec112.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_6beec6a0c9d66e338f0cf7476d0a1d31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09db5d79-2715-512d-abdf-65396f961f97 with identifier: MA43187
2026-04-27 08:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09db5d79-2715-512d-abdf-65396f961f97 with scrape type 1
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_68e6886975726dfc3430f5cfae630a29.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ade0a2c52d5e9d7c31190c930d55ddbd.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ca8e808cdcd32b448ae7aa69543b6aba.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_fc8a5d32312e2b7fe49faaccf3917fe4.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_5db5033e70daf8f04d26c95e0d09a541.jpg not downloaded yet
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_e2b4cdc9cfaee207f07fb9fcaa74a0b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_bd2f4cac1b5de312775b53dd4b4917ff.jpg not downloaded yet
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048884410>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_6beec6a0c9d66e338f0cf7476d0a1d31.jpg saved to cache
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_25c08db1de995c6db713d1f0b8176239.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_14a3cced09b29e4327d5b6f4f3e1ffe7.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6913faf3ff5893818e57508d0154b159.jpg not downloaded yet
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6fd40b1cb5f66a31a58646e97623eb95.jpg not downloaded yet
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c7590>
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_e2b4cdc9cfaee207f07fb9fcaa74a0b9.jpg saved to cache
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9
2026-04-27 08:13:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9, skipping ID generation
2026-04-27 08:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 with scrape type 1
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 sending to next pipeline
2026-04-27 08:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9, identifier: TM93075
2026-04-27 08:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 with identifier: TM93075
2026-04-27 08:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 with identifier: TM93075
2026-04-27 08:13:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 744db0bb-e7d3-585f-b4ea-8b3d214ecaf9 with identifier: TM93075 to the API
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_e2b4cdc9cfaee207f07fb9fcaa74a0b9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'El Rebolledo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-04-27T15:23:37Z',
'fuel_type': 'petrol',
'id': '744db0bb-e7d3-585f-b4ea-8b3d214ecaf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM93075',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Opel',
'model': 'Corsa',
'odometer': 41137,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_e2b4cdc9cfaee207f07fb9fcaa74a0b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_6beec6a0c9d66e338f0cf7476d0a1d31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_265704148dcdb56688b6d2c2e599562f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_146fd000caa714f84fa5231d3e5ec112.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_cf2db7ed7f9974d847a7515b0a3915ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_88528a5840a45cc164c2db706bd90558.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_df5569c278260d65642a57f87e7c6377.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_393b1698712ed2d151866aeac493512e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_1c8e9727830dab6f5dd6ec5f9b4d1763.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_744db0bb-e7d3-585f-b4ea-8b3d214ecaf9/744db0bb-e7d3-585f-b4ea-8b3d214ecaf9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/c4/c9c49b00b65fe690b0cf0a583de04b98/pa/TM93075_ad3b2b667db16d0378acb8a117e3341b.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2020-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2020}
2026-04-27 08:13:29 [auto1.es] INFO: Saving data for TM93075: {'created_time': 1777277609.533007, 'last_price_update_time': 1777277609.533016, 'has_photos': True, 'auction_closing_time': 1777303417.0}
2026-04-27 08:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_db4044ddb66ce9ad585025acf20be6a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_5db5033e70daf8f04d26c95e0d09a541.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048206550>
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_db4044ddb66ce9ad585025acf20be6a1.jpg saved to cache
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8ef9668-3874-54f5-a8ad-41820e08ffef
2026-04-27 08:13:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8ef9668-3874-54f5-a8ad-41820e08ffef, skipping ID generation
2026-04-27 08:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ef9668-3874-54f5-a8ad-41820e08ffef with scrape type 1
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8ef9668-3874-54f5-a8ad-41820e08ffef sending to next pipeline
2026-04-27 08:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8ef9668-3874-54f5-a8ad-41820e08ffef, identifier: XN25285
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884c7d0>
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_5db5033e70daf8f04d26c95e0d09a541.jpg saved to cache
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8ef9668-3874-54f5-a8ad-41820e08ffef with identifier: XN25285
2026-04-27 08:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8ef9668-3874-54f5-a8ad-41820e08ffef with identifier: XN25285
2026-04-27 08:13:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8ef9668-3874-54f5-a8ad-41820e08ffef with identifier: XN25285 to the API
2026-04-27 08:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_db4044ddb66ce9ad585025acf20be6a1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Ourense',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:41:53Z',
'fuel_type': 'diesel',
'id': 'e8ef9668-3874-54f5-a8ad-41820e08ffef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.3533,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN25285',
'listing': 'auction',
'location': 'ES, Ourense',
'location_confidence': 'geocoded',
'longitude': -7.8712,
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 283044,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_db4044ddb66ce9ad585025acf20be6a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b80a1b8f0211a3996269ade731eed748.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_6bcb2962b4476c268ecddc95ff820583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b2bc55f2a5484cb7592b11062eaea0d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_b5b39566c5050cad67d21ea1f5694db0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef9668-3874-54f5-a8ad-41820e08ffef/e8ef9668-3874-54f5-a8ad-41820e08ffef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/bd/98bd2dbdb78cc757f9e61dbfb3335940/pa/XN25285_237d018db0a55fed5e84d29c3324618a.jpg',
'Width': 800}],
'postal_code': '32001',
'price': 0,
'price_includes_vat': True,
'province': 'Ourense',
'province_code': 'ES-OR',
'region': 'Galicia',
'region_code': 'ES-GA',
'registration_date': '2015-09-30',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira Tourer 1.6 CDTI DPF Excellence',
'transmission': 'manual',
'trim': 'Excellence',
'year': 2015}
2026-04-27 08:13:30 [auto1.es] INFO: Saving data for XN25285: {'created_time': 1777277610.136737, 'last_price_update_time': 1777277610.136747, 'has_photos': True, 'auction_closing_time': 1777304513.0}
2026-04-27 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6913faf3ff5893818e57508d0154b159.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_14a3cced09b29e4327d5b6f4f3e1ffe7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048381550>
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6913faf3ff5893818e57508d0154b159.jpg saved to cache
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481fce90>
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_14a3cced09b29e4327d5b6f4f3e1ffe7.jpg saved to cache
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6fd40b1cb5f66a31a58646e97623eb95.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486a8450>
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6fd40b1cb5f66a31a58646e97623eb95.jpg saved to cache
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_bd2f4cac1b5de312775b53dd4b4917ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487aebd0>
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_bd2f4cac1b5de312775b53dd4b4917ff.jpg saved to cache
2026-04-27 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_fc8a5d32312e2b7fe49faaccf3917fe4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a81c90>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_fc8a5d32312e2b7fe49faaccf3917fe4.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ca8e808cdcd32b448ae7aa69543b6aba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX59990> (referer: https://www.auto1.com/v1/car-details-view/HX59990/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048824ed0>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ca8e808cdcd32b448ae7aa69543b6aba.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_68e6886975726dfc3430f5cfae630a29.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289c8906-e8d5-5be3-a305-390a492b0c79 with identifier: HX59990
2026-04-27 08:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289c8906-e8d5-5be3-a305-390a492b0c79 with scrape type 1
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_a4f02e97321267a9fc06d601ced510bc.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_52db06a1fc078ba9471636b1593a2f6b.jpg not downloaded yet
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_7b12f01951bfbd64493eeee2ed74142f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_2348a5fb2a1de176bb9f2e76aad306a1.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_65f3996a176b2decf97ce010ca91594b.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_f3ada63d932127e5daf7545b8bcdb891.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c4811564436c69ebdab02efd26df6fa9.jpg not downloaded yet
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481d9050>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_68e6886975726dfc3430f5cfae630a29.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_25c08db1de995c6db713d1f0b8176239.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_20abbe62f7cb9b3bb1282f2449d37657.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c858ea027c8afe3c2f7913f38c12e8a8.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_19f444cb938857b8f3ea0052f3906081.jpg not downloaded yet
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885d90>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_7b12f01951bfbd64493eeee2ed74142f.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_bdba0c05a5b9a0de7c6a48d6dcf68b13.jpg not downloaded yet
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048840290>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_25c08db1de995c6db713d1f0b8176239.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_52db06a1fc078ba9471636b1593a2f6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c4811564436c69ebdab02efd26df6fa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048207250>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_52db06a1fc078ba9471636b1593a2f6b.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_bdba0c05a5b9a0de7c6a48d6dcf68b13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a79490>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c4811564436c69ebdab02efd26df6fa9.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bfa90>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_bdba0c05a5b9a0de7c6a48d6dcf68b13.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c858ea027c8afe3c2f7913f38c12e8a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW30711> (referer: https://www.auto1.com/v1/car-details-view/GW30711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04891c850>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c858ea027c8afe3c2f7913f38c12e8a8.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 with identifier: GW30711
2026-04-27 08:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 with scrape type 1
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_11b3d61c71de086a78afe79feccec63b.jpg not downloaded yet
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_20abbe62f7cb9b3bb1282f2449d37657.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_5c96c4e717d105ee1917aa046146cb57.jpg not downloaded yet
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f9ddd1b6701462569ee13b32e52f2253.jpg not downloaded yet
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_9abb898be4ad8174ebb7379337358aaf.jpg not downloaded yet
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_f3ada63d932127e5daf7545b8bcdb891.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_b50a1c95c4d4fdac075ba230dc313cdc.jpg not downloaded yet
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f28b88c674b308897d9b3951f08cc64d.jpg not downloaded yet
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV63952> (referer: https://www.auto1.com/v1/car-details-view/TV63952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_11b3d61c71de086a78afe79feccec63b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048857dd0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_20abbe62f7cb9b3bb1282f2449d37657.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_9abb898be4ad8174ebb7379337358aaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048570a50>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_f3ada63d932127e5daf7545b8bcdb891.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f9ddd1b6701462569ee13b32e52f2253.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8863c4f2-f9bd-5d11-a538-484e89d6d618 with identifier: TV63952
2026-04-27 08:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8863c4f2-f9bd-5d11-a538-484e89d6d618 with scrape type 1
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_8df95e28ba6520e5dba01e1c354a733f.jpg not downloaded yet
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488baa50>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_11b3d61c71de086a78afe79feccec63b.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ade0a2c52d5e9d7c31190c930d55ddbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9433cc9bea1444f8cb514682940b3907.jpg not downloaded yet
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_b50a1c95c4d4fdac075ba230dc313cdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_c42271ee039404dfe18c9b3ab27fb1bd.jpg not downloaded yet
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484dc4d0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_9abb898be4ad8174ebb7379337358aaf.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_2325e8335d0315c18a3a0ba324fe4d3f.jpg not downloaded yet
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_5c96c4e717d105ee1917aa046146cb57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_36ff16cc977879ebbf9093a3a7dfe63c.jpg not downloaded yet
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048885a10>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f9ddd1b6701462569ee13b32e52f2253.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f28b88c674b308897d9b3951f08cc64d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_28f4b5499f91f9a5929a52ce8a7e58ab.jpg not downloaded yet
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9433cc9bea1444f8cb514682940b3907.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04833aa10>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ade0a2c52d5e9d7c31190c930d55ddbd.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09db5d79-2715-512d-abdf-65396f961f97
2026-04-27 08:13:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09db5d79-2715-512d-abdf-65396f961f97, skipping ID generation
2026-04-27 08:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09db5d79-2715-512d-abdf-65396f961f97 with scrape type 1
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09db5d79-2715-512d-abdf-65396f961f97 sending to next pipeline
2026-04-27 08:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09db5d79-2715-512d-abdf-65396f961f97, identifier: MA43187
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837c9d0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_b50a1c95c4d4fdac075ba230dc313cdc.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_65fdcad0bbdd07493e3296027e22b728.jpg not downloaded yet
2026-04-27 08:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09db5d79-2715-512d-abdf-65396f961f97 with identifier: MA43187
2026-04-27 08:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09db5d79-2715-512d-abdf-65396f961f97 with identifier: MA43187
2026-04-27 08:13:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 09db5d79-2715-512d-abdf-65396f961f97 with identifier: MA43187 to the API
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ade0a2c52d5e9d7c31190c930d55ddbd.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:50:49Z',
'fuel_type': 'diesel',
'id': '09db5d79-2715-512d-abdf-65396f961f97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA43187',
'listing': 'auction',
'location': 'ES',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 314616,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_68e6886975726dfc3430f5cfae630a29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ade0a2c52d5e9d7c31190c930d55ddbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_ca8e808cdcd32b448ae7aa69543b6aba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_fc8a5d32312e2b7fe49faaccf3917fe4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_5db5033e70daf8f04d26c95e0d09a541.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_bd2f4cac1b5de312775b53dd4b4917ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_25c08db1de995c6db713d1f0b8176239.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_14a3cced09b29e4327d5b6f4f3e1ffe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6913faf3ff5893818e57508d0154b159.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_09db5d79-2715-512d-abdf-65396f961f97/09db5d79-2715-512d-abdf-65396f961f97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/64/7464fa031e839a4f1c58d2e60f213722/pa/MA43187_6fd40b1cb5f66a31a58646e97623eb95.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2005-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Conceptline',
'transmission': 'manual',
'trim': 'Conceptline',
'year': 2005}
2026-04-27 08:13:33 [auto1.es] INFO: Saving data for MA43187: {'created_time': 1777277613.318731, 'last_price_update_time': 1777277613.318743, 'has_photos': True, 'auction_closing_time': 1777305049.0}
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_2325e8335d0315c18a3a0ba324fe4d3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_19f444cb938857b8f3ea0052f3906081.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9170ec14b72f2a95111fa9360ef80021.jpg not downloaded yet
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS83091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e30d0>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_5c96c4e717d105ee1917aa046146cb57.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048523c10>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f28b88c674b308897d9b3951f08cc64d.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889
2026-04-27 08:13:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9710e0a0-3098-5f3c-8d57-a10cb7ca6889, skipping ID generation
2026-04-27 08:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 with scrape type 1
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 sending to next pipeline
2026-04-27 08:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9710e0a0-3098-5f3c-8d57-a10cb7ca6889, identifier: GW30711
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487f2610>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9433cc9bea1444f8cb514682940b3907.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 with identifier: GW30711
2026-04-27 08:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 with identifier: GW30711
2026-04-27 08:13:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9710e0a0-3098-5f3c-8d57-a10cb7ca6889 with identifier: GW30711 to the API
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f28b88c674b308897d9b3951f08cc64d.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'La Roda De Andalucia',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:28:23Z',
'fuel_type': 'diesel',
'id': '9710e0a0-3098-5f3c-8d57-a10cb7ca6889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.2038,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW30711',
'listing': 'auction',
'location': 'ES, La Roda de Andalucía',
'location_confidence': 'geocoded',
'longitude': -4.778,
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 90198,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_11b3d61c71de086a78afe79feccec63b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_5c96c4e717d105ee1917aa046146cb57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f9ddd1b6701462569ee13b32e52f2253.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_9abb898be4ad8174ebb7379337358aaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_b50a1c95c4d4fdac075ba230dc313cdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9710e0a0-3098-5f3c-8d57-a10cb7ca6889/9710e0a0-3098-5f3c-8d57-a10cb7ca6889_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/47/a5474c2cca593521cab114aeefd30a04/pa/GW30711_f28b88c674b308897d9b3951f08cc64d.jpg',
'Width': 800}],
'postal_code': '41590',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2010-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2010}
2026-04-27 08:13:33 [auto1.es] INFO: Saving data for GW30711: {'created_time': 1777277613.968958, 'last_price_update_time': 1777277613.968968, 'has_photos': True, 'auction_closing_time': 1777303703.0}
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_8df95e28ba6520e5dba01e1c354a733f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [scrapy.extensions.logstats] INFO: Crawled 662 pages (at 49 pages/min), scraped 777 items (at 67 items/min)
2026-04-27 08:13:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_1aa84c863015a7f762838124f989483f.jpg not downloaded yet
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_c42271ee039404dfe18c9b3ab27fb1bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_36ff16cc977879ebbf9093a3a7dfe63c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482a0510>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_2325e8335d0315c18a3a0ba324fe4d3f.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851110>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_19f444cb938857b8f3ea0052f3906081.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_b3de62b904f95ef5fd7382270eb9498e.jpg not downloaded yet
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486c9850>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_8df95e28ba6520e5dba01e1c354a733f.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486ab210>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_c42271ee039404dfe18c9b3ab27fb1bd.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488e3b50>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_36ff16cc977879ebbf9093a3a7dfe63c.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_65fdcad0bbdd07493e3296027e22b728.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_a4f02e97321267a9fc06d601ced510bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK25349> (referer: https://www.auto1.com/v1/car-details-view/FK25349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484ebc90>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_65fdcad0bbdd07493e3296027e22b728.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c1590>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_a4f02e97321267a9fc06d601ced510bc.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_2348a5fb2a1de176bb9f2e76aad306a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_b3de62b904f95ef5fd7382270eb9498e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_1aa84c863015a7f762838124f989483f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca78127-6b71-5124-834f-8f1171f1faeb with identifier: FK25349
2026-04-27 08:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca78127-6b71-5124-834f-8f1171f1faeb with scrape type 1
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_16901d900cf75affc850d5b0b616c18a.jpg not downloaded yet
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_2d40c79274c7cd8e19f1d72eac743c9c.jpg not downloaded yet
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_dfa1308d88f3ad774401e9e01e11b868.jpg not downloaded yet
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c6e3bb5007fd856fa5e58cabc18041c4.jpg not downloaded yet
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c4ecc0b526a814ba4afedf089330686d.jpg not downloaded yet
2026-04-27 08:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_5bf4cb72a7db155c06e710953ae9945c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_7dd1e9ad8f371f0d808524aa76a80b0c.jpg not downloaded yet
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_5a96bd8fd500cd6281d424231ae976f4.jpg not downloaded yet
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_464557291d388c8b6b6fa98e1f8328a3.jpg not downloaded yet
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048867d10>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_2348a5fb2a1de176bb9f2e76aad306a1.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9170ec14b72f2a95111fa9360ef80021.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_33b7d2f3818efe99b5da12b775860e85.jpg not downloaded yet
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff057360f90>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_b3de62b904f95ef5fd7382270eb9498e.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0484b2090>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_1aa84c863015a7f762838124f989483f.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_e6b180898e533572a5f7b5cfe592db5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c6e3bb5007fd856fa5e58cabc18041c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_28f4b5499f91f9a5929a52ce8a7e58ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_4277e7fd0b6f02dc678b2ad58de456a6.jpg not downloaded yet
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870b010>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_5bf4cb72a7db155c06e710953ae9945c.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884c710>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9170ec14b72f2a95111fa9360ef80021.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048782b50>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_e6b180898e533572a5f7b5cfe592db5c.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c3050>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c6e3bb5007fd856fa5e58cabc18041c4.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048891c90>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_28f4b5499f91f9a5929a52ce8a7e58ab.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8863c4f2-f9bd-5d11-a538-484e89d6d618
2026-04-27 08:13:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8863c4f2-f9bd-5d11-a538-484e89d6d618, skipping ID generation
2026-04-27 08:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8863c4f2-f9bd-5d11-a538-484e89d6d618 with scrape type 1
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8863c4f2-f9bd-5d11-a538-484e89d6d618 sending to next pipeline
2026-04-27 08:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8863c4f2-f9bd-5d11-a538-484e89d6d618, identifier: TV63952
2026-04-27 08:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8863c4f2-f9bd-5d11-a538-484e89d6d618 with identifier: TV63952
2026-04-27 08:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8863c4f2-f9bd-5d11-a538-484e89d6d618 with identifier: TV63952
2026-04-27 08:13:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8863c4f2-f9bd-5d11-a538-484e89d6d618 with identifier: TV63952 to the API
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_28f4b5499f91f9a5929a52ce8a7e58ab.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'city': 'Viladecans',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:43:16Z',
'fuel_type': 'diesel',
'id': '8863c4f2-f9bd-5d11-a538-484e89d6d618',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3173,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV63952',
'listing': 'auction',
'location': 'ES, Viladecans,Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.0124,
'make': 'Renault',
'model': 'Scenic',
'odometer': 170787,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_8df95e28ba6520e5dba01e1c354a733f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9433cc9bea1444f8cb514682940b3907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_c42271ee039404dfe18c9b3ab27fb1bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_2325e8335d0315c18a3a0ba324fe4d3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_36ff16cc977879ebbf9093a3a7dfe63c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_28f4b5499f91f9a5929a52ce8a7e58ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_65fdcad0bbdd07493e3296027e22b728.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_9170ec14b72f2a95111fa9360ef80021.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_1aa84c863015a7f762838124f989483f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8863c4f2-f9bd-5d11-a538-484e89d6d618/8863c4f2-f9bd-5d11-a538-484e89d6d618_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/b4/61b445fbc037cceaf652db144bc4be27/pa/TV63952_b3de62b904f95ef5fd7382270eb9498e.jpg',
'Width': 800}],
'postal_code': '08840',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2013-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2013}
2026-04-27 08:13:36 [auto1.es] INFO: Saving data for TV63952: {'created_time': 1777277616.031724, 'last_price_update_time': 1777277616.031739, 'has_photos': True, 'auction_closing_time': 1777304596.0}
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c4ecc0b526a814ba4afedf089330686d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_464557291d388c8b6b6fa98e1f8328a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_7dd1e9ad8f371f0d808524aa76a80b0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR25857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885e790>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c4ecc0b526a814ba4afedf089330686d.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cbd50>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_464557291d388c8b6b6fa98e1f8328a3.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852bb10>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_7dd1e9ad8f371f0d808524aa76a80b0c.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_dfa1308d88f3ad774401e9e01e11b868.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_5a96bd8fd500cd6281d424231ae976f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_2d40c79274c7cd8e19f1d72eac743c9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_33b7d2f3818efe99b5da12b775860e85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a7e50>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_dfa1308d88f3ad774401e9e01e11b868.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483debd0>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_5a96bd8fd500cd6281d424231ae976f4.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_16901d900cf75affc850d5b0b616c18a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a6810>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_2d40c79274c7cd8e19f1d72eac743c9c.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488f8d10>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_33b7d2f3818efe99b5da12b775860e85.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a3350>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_16901d900cf75affc850d5b0b616c18a.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_65f3996a176b2decf97ce010ca91594b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823f890>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_65f3996a176b2decf97ce010ca91594b.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 289c8906-e8d5-5be3-a305-390a492b0c79
2026-04-27 08:13:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 289c8906-e8d5-5be3-a305-390a492b0c79, skipping ID generation
2026-04-27 08:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289c8906-e8d5-5be3-a305-390a492b0c79 with scrape type 1
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 289c8906-e8d5-5be3-a305-390a492b0c79 sending to next pipeline
2026-04-27 08:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 289c8906-e8d5-5be3-a305-390a492b0c79, identifier: HX59990
2026-04-27 08:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 289c8906-e8d5-5be3-a305-390a492b0c79 with identifier: HX59990
2026-04-27 08:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 289c8906-e8d5-5be3-a305-390a492b0c79 with identifier: HX59990
2026-04-27 08:13:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 289c8906-e8d5-5be3-a305-390a492b0c79 with identifier: HX59990 to the API
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_65f3996a176b2decf97ce010ca91594b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Girona',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:43:01Z',
'fuel_type': 'petrol',
'id': '289c8906-e8d5-5be3-a305-390a492b0c79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.984,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX59990',
'listing': 'auction',
'location': 'ES, Girona',
'location_confidence': 'geocoded',
'longitude': 2.8198,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 234902,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_a4f02e97321267a9fc06d601ced510bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_52db06a1fc078ba9471636b1593a2f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_2348a5fb2a1de176bb9f2e76aad306a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_65f3996a176b2decf97ce010ca91594b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_f3ada63d932127e5daf7545b8bcdb891.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c4811564436c69ebdab02efd26df6fa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_20abbe62f7cb9b3bb1282f2449d37657.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_c858ea027c8afe3c2f7913f38c12e8a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_19f444cb938857b8f3ea0052f3906081.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_289c8906-e8d5-5be3-a305-390a492b0c79/289c8906-e8d5-5be3-a305-390a492b0c79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/d6/bdd68e2ebb0505fd064356dd07766a59/pa/HX59990_bdba0c05a5b9a0de7c6a48d6dcf68b13.jpg',
'Width': 800}],
'postal_code': '17001',
'price': 0,
'price_includes_vat': True,
'province': 'Girona',
'province_code': 'ES-GI',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2018-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2018}
2026-04-27 08:13:37 [auto1.es] INFO: Saving data for HX59990: {'created_time': 1777277617.240876, 'last_price_update_time': 1777277617.240891, 'has_photos': True, 'auction_closing_time': 1777304581.0}
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_4277e7fd0b6f02dc678b2ad58de456a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_c795f8555a2c01ce59fe00d1eebe1d42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD36050/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_bc30e901c8078e041cb13d704971df4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fbd50>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_4277e7fd0b6f02dc678b2ad58de456a6.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bca78127-6b71-5124-834f-8f1171f1faeb
2026-04-27 08:13:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca78127-6b71-5124-834f-8f1171f1faeb, skipping ID generation
2026-04-27 08:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca78127-6b71-5124-834f-8f1171f1faeb with scrape type 1
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bca78127-6b71-5124-834f-8f1171f1faeb sending to next pipeline
2026-04-27 08:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bca78127-6b71-5124-834f-8f1171f1faeb, identifier: FK25349
2026-04-27 08:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bca78127-6b71-5124-834f-8f1171f1faeb with identifier: FK25349
2026-04-27 08:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bca78127-6b71-5124-834f-8f1171f1faeb with identifier: FK25349
2026-04-27 08:13:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bca78127-6b71-5124-834f-8f1171f1faeb with identifier: FK25349 to the API
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_4277e7fd0b6f02dc678b2ad58de456a6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'city': 'El Prat De Llobregat',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:46:53Z',
'fuel_type': 'diesel',
'id': 'bca78127-6b71-5124-834f-8f1171f1faeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3278,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK25349',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'location_confidence': 'geocoded',
'longitude': 2.0947,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 138175,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_16901d900cf75affc850d5b0b616c18a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_2d40c79274c7cd8e19f1d72eac743c9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_dfa1308d88f3ad774401e9e01e11b868.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c6e3bb5007fd856fa5e58cabc18041c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_c4ecc0b526a814ba4afedf089330686d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_7dd1e9ad8f371f0d808524aa76a80b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_5a96bd8fd500cd6281d424231ae976f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_464557291d388c8b6b6fa98e1f8328a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_33b7d2f3818efe99b5da12b775860e85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bca78127-6b71-5124-834f-8f1171f1faeb/bca78127-6b71-5124-834f-8f1171f1faeb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/c1/5cc125c2238fa714d2cee6b1086f6ed2/pa/FK25349_4277e7fd0b6f02dc678b2ad58de456a6.jpg',
'Width': 800}],
'postal_code': '08820',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2009-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2009}
2026-04-27 08:13:37 [auto1.es] INFO: Saving data for FK25349: {'created_time': 1777277617.807047, 'last_price_update_time': 1777277617.807057, 'has_photos': True, 'auction_closing_time': 1777304813.0}
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_2d129d8b5b313e91f780e6190284a917.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852be10>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_c795f8555a2c01ce59fe00d1eebe1d42.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_cf1ce8ec2b108d0633f740c1a95570b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843e450>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_bc30e901c8078e041cb13d704971df4b.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048234850>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_2d129d8b5b313e91f780e6190284a917.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d4110>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_cf1ce8ec2b108d0633f740c1a95570b9.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_31d2f5b41424d0fb2c5bf9e86d924171.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e7c50>
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_31d2f5b41424d0fb2c5bf9e86d924171.jpg saved to cache
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20f0af04-bd99-5940-b8f9-a64cf2697980
2026-04-27 08:13:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20f0af04-bd99-5940-b8f9-a64cf2697980, skipping ID generation
2026-04-27 08:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f0af04-bd99-5940-b8f9-a64cf2697980 with scrape type 1
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20f0af04-bd99-5940-b8f9-a64cf2697980 sending to next pipeline
2026-04-27 08:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20f0af04-bd99-5940-b8f9-a64cf2697980, identifier: NK46924
2026-04-27 08:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20f0af04-bd99-5940-b8f9-a64cf2697980 with identifier: NK46924
2026-04-27 08:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20f0af04-bd99-5940-b8f9-a64cf2697980 with identifier: NK46924
2026-04-27 08:13:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20f0af04-bd99-5940-b8f9-a64cf2697980 with identifier: NK46924 to the API
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_31d2f5b41424d0fb2c5bf9e86d924171.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Aldaya',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:41:01Z',
'fuel_type': 'diesel',
'id': '20f0af04-bd99-5940-b8f9-a64cf2697980',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK46924',
'listing': 'auction',
'location': 'ES, Aldaya',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A4',
'odometer': 340829,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_ea59e6c098955ceddbb6257092320fca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_31d2f5b41424d0fb2c5bf9e86d924171.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_bc30e901c8078e041cb13d704971df4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_cf1ce8ec2b108d0633f740c1a95570b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_c795f8555a2c01ce59fe00d1eebe1d42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_2d129d8b5b313e91f780e6190284a917.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_5bf4cb72a7db155c06e710953ae9945c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_baf885de502a453eb89737fee5a97576.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_e6b180898e533572a5f7b5cfe592db5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20f0af04-bd99-5940-b8f9-a64cf2697980/20f0af04-bd99-5940-b8f9-a64cf2697980_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/44/2344c7e24a6bdb6ae8b906211e47f1d0/pa/NK46924_7b12f01951bfbd64493eeee2ed74142f.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI clean diesel',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-04-27 08:13:39 [auto1.es] INFO: Saving data for NK46924: {'created_time': 1777277619.056617, 'last_price_update_time': 1777277619.056626, 'has_photos': True, 'auction_closing_time': 1777304461.0}
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW94395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH33110> (referer: https://www.auto1.com/v1/car-details-view/ZH33110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c45b7bb-1ddc-524f-97e3-b12956581d4c with identifier: ZH33110
2026-04-27 08:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c with scrape type 1
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_3904a4e22863680d05e66d6f4ab9d6b3.jpg not downloaded yet
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_fb817343f5f36d00e4b9a6c9d0e8d11f.jpg not downloaded yet
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_7269acbd4cb267cfe8c48efb09167cb1.jpg not downloaded yet
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_73f4e585efff2276cc4629158ff04541.jpg not downloaded yet
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_71882b9a271cc54d60fac8a9cedadd9f.jpg not downloaded yet
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_db80cb4e12890eb938ea7507b9cae5fd.jpg not downloaded yet
2026-04-27 08:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR25857> (referer: https://www.auto1.com/v1/car-details-view/SR25857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e11753c-4797-5761-b4a9-799138f49082 with identifier: SR25857
2026-04-27 08:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e11753c-4797-5761-b4a9-799138f49082 with scrape type 1
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_c55f1d81bd776c79fc4e7f86dcf5ab8a.jpg not downloaded yet
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_726b2d1796609ec19f83279ffb3f44e5.jpg not downloaded yet
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_e879d4ab81ced0401180170968ae65f0.jpg not downloaded yet
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_bc73da7f091465e78f54bfb8c65b3fd5.jpg not downloaded yet
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_d4309138f460929ddb26de8ce2b7c5d6.jpg not downloaded yet
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_37853ea6464d53cdfd13a8de4ba89b99.jpg not downloaded yet
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_3c0e7b1e3d42048dba520403112aabc9.jpg not downloaded yet
2026-04-27 08:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_a986f989f792650a98e06b156f1f3c4c.jpg not downloaded yet
2026-04-27 08:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_1caaa3d06b41fdca0860b89d5e6bd3b5.jpg not downloaded yet
2026-04-27 08:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_4a376301359fbc24a1009758a9edf20f.jpg not downloaded yet
2026-04-27 08:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_db80cb4e12890eb938ea7507b9cae5fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884db10>
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_db80cb4e12890eb938ea7507b9cae5fd.jpg saved to cache
2026-04-27 08:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_4a376301359fbc24a1009758a9edf20f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834eb90>
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_4a376301359fbc24a1009758a9edf20f.jpg saved to cache
2026-04-27 08:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_1caaa3d06b41fdca0860b89d5e6bd3b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048851dd0>
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_1caaa3d06b41fdca0860b89d5e6bd3b5.jpg saved to cache
2026-04-27 08:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_a986f989f792650a98e06b156f1f3c4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048253110>
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_a986f989f792650a98e06b156f1f3c4c.jpg saved to cache
2026-04-27 08:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_3c0e7b1e3d42048dba520403112aabc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048675f50>
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_3c0e7b1e3d42048dba520403112aabc9.jpg saved to cache
2026-04-27 08:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_37853ea6464d53cdfd13a8de4ba89b99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834f390>
2026-04-27 08:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_37853ea6464d53cdfd13a8de4ba89b99.jpg saved to cache
2026-04-27 08:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_d4309138f460929ddb26de8ce2b7c5d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870b190>
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_d4309138f460929ddb26de8ce2b7c5d6.jpg saved to cache
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_bc73da7f091465e78f54bfb8c65b3fd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04870e750>
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_bc73da7f091465e78f54bfb8c65b3fd5.jpg saved to cache
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_e879d4ab81ced0401180170968ae65f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048205310>
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_e879d4ab81ced0401180170968ae65f0.jpg saved to cache
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_726b2d1796609ec19f83279ffb3f44e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_c55f1d81bd776c79fc4e7f86dcf5ab8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481bf450>
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_726b2d1796609ec19f83279ffb3f44e5.jpg saved to cache
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP54763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885c910>
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_c55f1d81bd776c79fc4e7f86dcf5ab8a.jpg saved to cache
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e11753c-4797-5761-b4a9-799138f49082
2026-04-27 08:13:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e11753c-4797-5761-b4a9-799138f49082, skipping ID generation
2026-04-27 08:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e11753c-4797-5761-b4a9-799138f49082 with scrape type 1
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e11753c-4797-5761-b4a9-799138f49082 sending to next pipeline
2026-04-27 08:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e11753c-4797-5761-b4a9-799138f49082, identifier: SR25857
2026-04-27 08:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e11753c-4797-5761-b4a9-799138f49082 with identifier: SR25857
2026-04-27 08:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e11753c-4797-5761-b4a9-799138f49082 with identifier: SR25857
2026-04-27 08:13:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2e11753c-4797-5761-b4a9-799138f49082 with identifier: SR25857 to the API
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_c55f1d81bd776c79fc4e7f86dcf5ab8a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Vic',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2026-04-27T15:06:57Z',
'fuel_type': 'hybrid',
'id': '2e11753c-4797-5761-b4a9-799138f49082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.939,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR25857',
'listing': 'auction',
'location': 'ES, Vic',
'location_confidence': 'geocoded',
'longitude': 2.2454,
'make': 'Peugeot',
'model': '508',
'odometer': 289393,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_c55f1d81bd776c79fc4e7f86dcf5ab8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_726b2d1796609ec19f83279ffb3f44e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_e879d4ab81ced0401180170968ae65f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_bc73da7f091465e78f54bfb8c65b3fd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_d4309138f460929ddb26de8ce2b7c5d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_37853ea6464d53cdfd13a8de4ba89b99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_3c0e7b1e3d42048dba520403112aabc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_a986f989f792650a98e06b156f1f3c4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_1caaa3d06b41fdca0860b89d5e6bd3b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e11753c-4797-5761-b4a9-799138f49082/2e11753c-4797-5761-b4a9-799138f49082_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/ee/8deeeb7c6cd864f06c789afd0314233a/pa/SR25857_4a376301359fbc24a1009758a9edf20f.jpg',
'Width': 800}],
'postal_code': '08500',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2014-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 2.0 HDi Hybrid4 RXH',
'transmission': 'automatic',
'trim': 'RXH',
'year': 2014}
2026-04-27 08:13:54 [auto1.es] INFO: Saving data for SR25857: {'created_time': 1777277634.319506, 'last_price_update_time': 1777277634.319517, 'has_photos': True, 'auction_closing_time': 1777302417.0}
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV80306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_7269acbd4cb267cfe8c48efb09167cb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR69751> (referer: https://www.auto1.com/v1/car-details-view/YR69751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_71882b9a271cc54d60fac8a9cedadd9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_fb817343f5f36d00e4b9a6c9d0e8d11f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048567e10>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_7269acbd4cb267cfe8c48efb09167cb1.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d75c4a-bca5-574f-b86b-4c50d33b9ecd with identifier: YR69751
2026-04-27 08:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd with scrape type 1
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_178ce9746de04dca409d259a7e261a47.jpg not downloaded yet
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_73f4e585efff2276cc4629158ff04541.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_41135a9d1d0f54a1499acdbfddba093f.jpg not downloaded yet
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885cad0>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_71882b9a271cc54d60fac8a9cedadd9f.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_5faacfbe4bbcf0ea7f5eb89aea8386a4.jpg not downloaded yet
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_10682081a33e36a7a0c54ee8478f5b04.jpg not downloaded yet
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_3620b14832e654525a5668bff159b3f6.jpg not downloaded yet
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837fc90>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_fb817343f5f36d00e4b9a6c9d0e8d11f.jpg saved to cache
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_18d0a5bd53a4a2dc7d2030fd412f6edd.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_b716ff47f37ed736c226eb5eb410b9aa.jpg not downloaded yet
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885cdd0>
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_73f4e585efff2276cc4629158ff04541.jpg saved to cache
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_7a4cb52668b52888f8e08fe580b4360d.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_793708fc4630ba480ba52afdc93adbff.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_e962ab678df1425362ba87571957292a.jpg not downloaded yet
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV61433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_3904a4e22863680d05e66d6f4ab9d6b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_e962ab678df1425362ba87571957292a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048250d90>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_3904a4e22863680d05e66d6f4ab9d6b3.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c
2026-04-27 08:13:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c45b7bb-1ddc-524f-97e3-b12956581d4c, skipping ID generation
2026-04-27 08:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c with scrape type 1
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c45b7bb-1ddc-524f-97e3-b12956581d4c sending to next pipeline
2026-04-27 08:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c45b7bb-1ddc-524f-97e3-b12956581d4c, identifier: ZH33110
2026-04-27 08:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c45b7bb-1ddc-524f-97e3-b12956581d4c with identifier: ZH33110
2026-04-27 08:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c45b7bb-1ddc-524f-97e3-b12956581d4c with identifier: ZH33110
2026-04-27 08:13:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2c45b7bb-1ddc-524f-97e3-b12956581d4c with identifier: ZH33110 to the API
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_3904a4e22863680d05e66d6f4ab9d6b3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:57:49Z',
'fuel_type': 'diesel',
'id': '2c45b7bb-1ddc-524f-97e3-b12956581d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH33110',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Citroen',
'model': 'C4',
'odometer': 200605,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_3904a4e22863680d05e66d6f4ab9d6b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_fb817343f5f36d00e4b9a6c9d0e8d11f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_7269acbd4cb267cfe8c48efb09167cb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_73f4e585efff2276cc4629158ff04541.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_71882b9a271cc54d60fac8a9cedadd9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c45b7bb-1ddc-524f-97e3-b12956581d4c/2c45b7bb-1ddc-524f-97e3-b12956581d4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/4a/da4aefe06652bd1450db57ef7e333aa6/pa/ZH33110_db80cb4e12890eb938ea7507b9cae5fd.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2006-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 2.0 HDi VTS',
'transmission': 'manual',
'trim': 'VTS',
'year': 2006}
2026-04-27 08:13:56 [auto1.es] INFO: Saving data for ZH33110: {'created_time': 1777277636.562492, 'last_price_update_time': 1777277636.562504, 'has_photos': True, 'auction_closing_time': 1777305469.0}
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_793708fc4630ba480ba52afdc93adbff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488533d0>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_e962ab678df1425362ba87571957292a.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842a990>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_793708fc4630ba480ba52afdc93adbff.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_7a4cb52668b52888f8e08fe580b4360d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048567710>
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_7a4cb52668b52888f8e08fe580b4360d.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_b716ff47f37ed736c226eb5eb410b9aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff056e6bf10>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_b716ff47f37ed736c226eb5eb410b9aa.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH40382> (referer: https://www.auto1.com/v1/car-details-view/MH40382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b18def-1d4a-556a-a369-1756e98ad9a3 with identifier: MH40382
2026-04-27 08:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b18def-1d4a-556a-a369-1756e98ad9a3 with scrape type 1
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_a5b73a58e052438f9fa5025413eb64c7.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_397edeb1789594031ac6826b968fa022.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_7cb2f6f32d909c3e5f799482c9e30519.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_ba5e0e76a7f10897e1cca73e1a28efbb.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_6cd94635e1ab8ce18c10f8acbcca15e9.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_304624a2efb7fdf1723a5ef81079acd4.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_b800b119a88120c5443ac745d334ada8.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_464b1bc121f6c1e9669481cd95dd1212.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_773cd3d108fe1dfad61eef42d6577d4d.jpg not downloaded yet
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_8e1adbcdb99a45e835eecd0c0ffddfd0.jpg not downloaded yet
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_18d0a5bd53a4a2dc7d2030fd412f6edd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d5690>
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_18d0a5bd53a4a2dc7d2030fd412f6edd.jpg saved to cache
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_8e1adbcdb99a45e835eecd0c0ffddfd0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_3620b14832e654525a5668bff159b3f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ac1d0>
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_8e1adbcdb99a45e835eecd0c0ffddfd0.jpg saved to cache
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_773cd3d108fe1dfad61eef42d6577d4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42010>
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_3620b14832e654525a5668bff159b3f6.jpg saved to cache
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483d5310>
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_773cd3d108fe1dfad61eef42d6577d4d.jpg saved to cache
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_b800b119a88120c5443ac745d334ada8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cbd90>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_b800b119a88120c5443ac745d334ada8.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD36050> (referer: https://www.auto1.com/v1/car-details-view/HD36050/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36aee5d6-3720-5790-83bb-7e167916b06a with identifier: HD36050
2026-04-27 08:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aee5d6-3720-5790-83bb-7e167916b06a with scrape type 1
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_7a789a91d34ceed1c245c71694914aa1.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_dfd7cd6ad0d1e3ad63a9d5b9cdeb1cda.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_42c7f8cac9211acf5de95ae6dca2fbde.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_63b4404dcf45cc427cc154a0c6e65432.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_33263abada56f2719e9b988747702ad3.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_2ab5aa8e2042b9a5eef0b46dc0e1573e.jpg not downloaded yet
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_6cd94635e1ab8ce18c10f8acbcca15e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_b9d69cf10743503de661a60731b60e50.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_4854556945e5feafbaac43e2cad436e4.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_eea8651d79e68d212f0dfd1e63c813f1.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_3c23391ed13d13f222f5ffa94d1a4e98.jpg not downloaded yet
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528e10>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_6cd94635e1ab8ce18c10f8acbcca15e9.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_464b1bc121f6c1e9669481cd95dd1212.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e7490>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_464b1bc121f6c1e9669481cd95dd1212.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_304624a2efb7fdf1723a5ef81079acd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_3c23391ed13d13f222f5ffa94d1a4e98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV04678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_eea8651d79e68d212f0dfd1e63c813f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843f410>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_304624a2efb7fdf1723a5ef81079acd4.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_4854556945e5feafbaac43e2cad436e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048660850>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_3c23391ed13d13f222f5ffa94d1a4e98.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_63b4404dcf45cc427cc154a0c6e65432.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:14:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:14:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048852ed0>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_eea8651d79e68d212f0dfd1e63c813f1.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048826f50>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_4854556945e5feafbaac43e2cad436e4.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_42c7f8cac9211acf5de95ae6dca2fbde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7a710>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_63b4404dcf45cc427cc154a0c6e65432.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_2ab5aa8e2042b9a5eef0b46dc0e1573e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04885d690>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_42c7f8cac9211acf5de95ae6dca2fbde.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cae10>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_2ab5aa8e2042b9a5eef0b46dc0e1573e.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_dfd7cd6ad0d1e3ad63a9d5b9cdeb1cda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_7a789a91d34ceed1c245c71694914aa1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048209750>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_dfd7cd6ad0d1e3ad63a9d5b9cdeb1cda.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843c510>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_7a789a91d34ceed1c245c71694914aa1.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_ba5e0e76a7f10897e1cca73e1a28efbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048610850>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_ba5e0e76a7f10897e1cca73e1a28efbb.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_33263abada56f2719e9b988747702ad3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_b9d69cf10743503de661a60731b60e50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_a5b73a58e052438f9fa5025413eb64c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481db510>
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_33263abada56f2719e9b988747702ad3.jpg saved to cache
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235690>
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_b9d69cf10743503de661a60731b60e50.jpg saved to cache
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36aee5d6-3720-5790-83bb-7e167916b06a
2026-04-27 08:14:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36aee5d6-3720-5790-83bb-7e167916b06a, skipping ID generation
2026-04-27 08:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aee5d6-3720-5790-83bb-7e167916b06a with scrape type 1
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36aee5d6-3720-5790-83bb-7e167916b06a sending to next pipeline
2026-04-27 08:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36aee5d6-3720-5790-83bb-7e167916b06a, identifier: HD36050
2026-04-27 08:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36aee5d6-3720-5790-83bb-7e167916b06a with identifier: HD36050
2026-04-27 08:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36aee5d6-3720-5790-83bb-7e167916b06a with identifier: HD36050
2026-04-27 08:14:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36aee5d6-3720-5790-83bb-7e167916b06a with identifier: HD36050 to the API
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_b9d69cf10743503de661a60731b60e50.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Valencia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-27T15:25:38Z',
'fuel_type': 'diesel',
'id': '36aee5d6-3720-5790-83bb-7e167916b06a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 39.4698,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD36050',
'listing': 'auction',
'location': 'ES, Valencia',
'location_confidence': 'geocoded',
'longitude': -0.3774,
'make': 'Ford',
'model': 'Focus',
'odometer': 113003,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_7a789a91d34ceed1c245c71694914aa1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_dfd7cd6ad0d1e3ad63a9d5b9cdeb1cda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_42c7f8cac9211acf5de95ae6dca2fbde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_63b4404dcf45cc427cc154a0c6e65432.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_33263abada56f2719e9b988747702ad3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_2ab5aa8e2042b9a5eef0b46dc0e1573e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_b9d69cf10743503de661a60731b60e50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_4854556945e5feafbaac43e2cad436e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435679,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_eea8651d79e68d212f0dfd1e63c813f1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36aee5d6-3720-5790-83bb-7e167916b06a/36aee5d6-3720-5790-83bb-7e167916b06a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/08/4308b33c80bd321a598046f8392b438e/pa/HD36050_3c23391ed13d13f222f5ffa94d1a4e98.jpg',
'Width': 800}],
'postal_code': '46001',
'price': 0,
'price_includes_vat': True,
'province': 'Valencia',
'province_code': 'ES-V',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2011-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-04-27 08:14:03 [auto1.es] INFO: Saving data for HD36050: {'created_time': 1777277643.070069, 'last_price_update_time': 1777277643.070089, 'has_photos': True, 'auction_closing_time': 1777303538.0}
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_397edeb1789594031ac6826b968fa022.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_7cb2f6f32d909c3e5f799482c9e30519.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF48628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c1f50>
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_a5b73a58e052438f9fa5025413eb64c7.jpg saved to cache
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_10682081a33e36a7a0c54ee8478f5b04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_178ce9746de04dca409d259a7e261a47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048866310>
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_397edeb1789594031ac6826b968fa022.jpg saved to cache
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048566cd0>
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_7cb2f6f32d909c3e5f799482c9e30519.jpg saved to cache
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31b18def-1d4a-556a-a369-1756e98ad9a3
2026-04-27 08:14:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31b18def-1d4a-556a-a369-1756e98ad9a3, skipping ID generation
2026-04-27 08:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b18def-1d4a-556a-a369-1756e98ad9a3 with scrape type 1
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31b18def-1d4a-556a-a369-1756e98ad9a3 sending to next pipeline
2026-04-27 08:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31b18def-1d4a-556a-a369-1756e98ad9a3, identifier: MH40382
2026-04-27 08:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31b18def-1d4a-556a-a369-1756e98ad9a3 with identifier: MH40382
2026-04-27 08:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31b18def-1d4a-556a-a369-1756e98ad9a3 with identifier: MH40382
2026-04-27 08:14:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31b18def-1d4a-556a-a369-1756e98ad9a3 with identifier: MH40382 to the API
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_7cb2f6f32d909c3e5f799482c9e30519.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'Araia',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 122,
'expiration_date': '2026-04-27T15:59:52Z',
'fuel_type': 'diesel',
'id': '31b18def-1d4a-556a-a369-1756e98ad9a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 42.8904,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH40382',
'listing': 'auction',
'location': 'ES, Araia',
'location_confidence': 'geocoded',
'longitude': -2.3153,
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 57084,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_a5b73a58e052438f9fa5025413eb64c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_397edeb1789594031ac6826b968fa022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_7cb2f6f32d909c3e5f799482c9e30519.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_ba5e0e76a7f10897e1cca73e1a28efbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_6cd94635e1ab8ce18c10f8acbcca15e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_304624a2efb7fdf1723a5ef81079acd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_b800b119a88120c5443ac745d334ada8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_464b1bc121f6c1e9669481cd95dd1212.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_773cd3d108fe1dfad61eef42d6577d4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_31b18def-1d4a-556a-a369-1756e98ad9a3/31b18def-1d4a-556a-a369-1756e98ad9a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/61/2f6152511de1583731e08791cd7cb81e/pa/MH40382_8e1adbcdb99a45e835eecd0c0ffddfd0.jpg',
'Width': 800}],
'postal_code': '01250',
'price': 0,
'price_includes_vat': True,
'province': 'Álava',
'province_code': 'ES-VI',
'region': 'Pais Vasco',
'region_code': 'ES-PV',
'registration_date': '2023-02-23',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi',
'transmission': 'automatic',
'trim': 'Maxi',
'year': 2023}
2026-04-27 08:14:05 [auto1.es] INFO: Saving data for MH40382: {'created_time': 1777277645.053999, 'last_price_update_time': 1777277645.054013, 'has_photos': True, 'auction_closing_time': 1777305592.0}
2026-04-27 08:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_5faacfbe4bbcf0ea7f5eb89aea8386a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_41135a9d1d0f54a1499acdbfddba093f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048853450>
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_10682081a33e36a7a0c54ee8478f5b04.jpg saved to cache
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487afe50>
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_178ce9746de04dca409d259a7e261a47.jpg saved to cache
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662410>
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_5faacfbe4bbcf0ea7f5eb89aea8386a4.jpg saved to cache
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048826910>
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_41135a9d1d0f54a1499acdbfddba093f.jpg saved to cache
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd
2026-04-27 08:14:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44d75c4a-bca5-574f-b86b-4c50d33b9ecd, skipping ID generation
2026-04-27 08:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd with scrape type 1
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44d75c4a-bca5-574f-b86b-4c50d33b9ecd sending to next pipeline
2026-04-27 08:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44d75c4a-bca5-574f-b86b-4c50d33b9ecd, identifier: YR69751
2026-04-27 08:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44d75c4a-bca5-574f-b86b-4c50d33b9ecd with identifier: YR69751
2026-04-27 08:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44d75c4a-bca5-574f-b86b-4c50d33b9ecd with identifier: YR69751
2026-04-27 08:14:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 44d75c4a-bca5-574f-b86b-4c50d33b9ecd with identifier: YR69751 to the API
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_41135a9d1d0f54a1499acdbfddba093f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-27T15:47:10Z',
'fuel_type': 'petrol',
'id': '44d75c4a-bca5-574f-b86b-4c50d33b9ecd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR69751',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Audi',
'model': 'A5',
'odometer': 202138,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_178ce9746de04dca409d259a7e261a47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_41135a9d1d0f54a1499acdbfddba093f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_5faacfbe4bbcf0ea7f5eb89aea8386a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2051209,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_10682081a33e36a7a0c54ee8478f5b04.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_3620b14832e654525a5668bff159b3f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_18d0a5bd53a4a2dc7d2030fd412f6edd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_b716ff47f37ed736c226eb5eb410b9aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_7a4cb52668b52888f8e08fe580b4360d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_793708fc4630ba480ba52afdc93adbff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44d75c4a-bca5-574f-b86b-4c50d33b9ecd/44d75c4a-bca5-574f-b86b-4c50d33b9ecd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/f5/d4f5b632be5f59350df8a328791fe2d2/pa/YR69751_e962ab678df1425362ba87571957292a.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2008-11-02',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A5 2.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 08:14:05 [auto1.es] INFO: Saving data for YR69751: {'created_time': 1777277645.725106, 'last_price_update_time': 1777277645.72512, 'has_photos': True, 'auction_closing_time': 1777304830.0}
2026-04-27 08:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV80306> (referer: https://www.auto1.com/v1/car-details-view/YV80306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd8b2236-5cf0-5cf0-8082-740601791136 with identifier: YV80306
2026-04-27 08:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd8b2236-5cf0-5cf0-8082-740601791136 with scrape type 1
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8affdbb48daf1c58eb4667405fb5db1d.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_0cb6d3f4035bd7e0df8f64afd3da2396.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8f490867a7e77770353d33518ab87e15.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_505d306be63143a8cb4188ec7faeca07.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_eb05deb68232c3b34c9f43ea1ada6446.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_6f1b8faec9f4b7e29cbaaa58f9e3728e.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_4b51f115fbb63885ac100092025a216f.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_e86b3eb5b85bca29bf2c391bf5fa7977.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_3f51882635120173ddb32fcbc88cdb23.jpg not downloaded yet
2026-04-27 08:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_d03da48e9a77b5be7f5b3973e0e8253c.jpg not downloaded yet
2026-04-27 08:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW94395> (referer: https://www.auto1.com/v1/car-details-view/XW94395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395
2026-04-27 08:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with scrape type 1
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_6f2aafae7303cf874f429cee5a66add2.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_bc05a94ff16ecaaaf19ce2751c36fb3c.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_fa88f9e6207b735c583231050cee70a3.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_77d8604db8731d56acba2ac0dd466bbb.jpg not downloaded yet
2026-04-27 08:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_d03da48e9a77b5be7f5b3973e0e8253c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_3c77daf6a4f73ccf3deb36d64731e97d.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_70e5902483e34c749e3d9ef882419965.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4507628719f8d1ac6e85be1f04714681.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4b82956370218c613e793479a7179663.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_8e8361654fbb1cb04e296a26018ad86f.jpg not downloaded yet
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_cb7233cc5d0a77c0552622a56ee53eee.jpg not downloaded yet
2026-04-27 08:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a7b010>
2026-04-27 08:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_d03da48e9a77b5be7f5b3973e0e8253c.jpg saved to cache
2026-04-27 08:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP60983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_cb7233cc5d0a77c0552622a56ee53eee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048591890>
2026-04-27 08:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_cb7233cc5d0a77c0552622a56ee53eee.jpg saved to cache
2026-04-27 08:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_77d8604db8731d56acba2ac0dd466bbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04852bfd0>
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_77d8604db8731d56acba2ac0dd466bbb.jpg saved to cache
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_8e8361654fbb1cb04e296a26018ad86f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a4a350>
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_8e8361654fbb1cb04e296a26018ad86f.jpg saved to cache
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP54763> (referer: https://www.auto1.com/v1/car-details-view/ZP54763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68da4ca-0705-50ac-b733-2073530413c2 with identifier: ZP54763
2026-04-27 08:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68da4ca-0705-50ac-b733-2073530413c2 with scrape type 1
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_254988fb14ad7f2de591a6d8e4cb7886.jpg not downloaded yet
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_bb09e6c3acda7af3eba02d95e2357349.jpg not downloaded yet
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_efae87a30af1f14bfb3712e43dbc428a.jpg not downloaded yet
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_6027520fcc0145e44261f80cdf2a53d0.jpg not downloaded yet
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_4afbabcf686aa1289e8a8068b3a528f8.jpg not downloaded yet
2026-04-27 08:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_a5dde87be876f0c9055e7798b10c5ebf.jpg not downloaded yet
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4507628719f8d1ac6e85be1f04714681.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048828cd0>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4507628719f8d1ac6e85be1f04714681.jpg saved to cache
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4b82956370218c613e793479a7179663.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_a5dde87be876f0c9055e7798b10c5ebf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_4afbabcf686aa1289e8a8068b3a528f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048827510>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4b82956370218c613e793479a7179663.jpg saved to cache
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528190>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_a5dde87be876f0c9055e7798b10c5ebf.jpg saved to cache
2026-04-27 08:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837d610>
2026-04-27 08:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_4afbabcf686aa1289e8a8068b3a528f8.jpg saved to cache
2026-04-27 08:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_efae87a30af1f14bfb3712e43dbc428a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483b6210>
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_efae87a30af1f14bfb3712e43dbc428a.jpg saved to cache
2026-04-27 08:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_6027520fcc0145e44261f80cdf2a53d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a49950>
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_6027520fcc0145e44261f80cdf2a53d0.jpg saved to cache
2026-04-27 08:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_bb09e6c3acda7af3eba02d95e2357349.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c38d0>
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_bb09e6c3acda7af3eba02d95e2357349.jpg saved to cache
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_70e5902483e34c749e3d9ef882419965.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_254988fb14ad7f2de591a6d8e4cb7886.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04823d550>
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_70e5902483e34c749e3d9ef882419965.jpg saved to cache
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488c2150>
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_254988fb14ad7f2de591a6d8e4cb7886.jpg saved to cache
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d68da4ca-0705-50ac-b733-2073530413c2
2026-04-27 08:14:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d68da4ca-0705-50ac-b733-2073530413c2, skipping ID generation
2026-04-27 08:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68da4ca-0705-50ac-b733-2073530413c2 with scrape type 1
2026-04-27 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d68da4ca-0705-50ac-b733-2073530413c2 sending to next pipeline
2026-04-27 08:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d68da4ca-0705-50ac-b733-2073530413c2, identifier: ZP54763
2026-04-27 08:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d68da4ca-0705-50ac-b733-2073530413c2 with identifier: ZP54763
2026-04-27 08:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d68da4ca-0705-50ac-b733-2073530413c2 with identifier: ZP54763
2026-04-27 08:14:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d68da4ca-0705-50ac-b733-2073530413c2 with identifier: ZP54763 to the API
2026-04-27 08:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_254988fb14ad7f2de591a6d8e4cb7886.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Barcelona',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:29:47Z',
'fuel_type': 'diesel',
'id': 'd68da4ca-0705-50ac-b733-2073530413c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.3799,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP54763',
'listing': 'auction',
'location': 'ES, Barcelona',
'location_confidence': 'geocoded',
'longitude': 2.1687,
'make': 'Seat',
'model': 'Altea',
'odometer': 260116,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_254988fb14ad7f2de591a6d8e4cb7886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_bb09e6c3acda7af3eba02d95e2357349.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_efae87a30af1f14bfb3712e43dbc428a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_6027520fcc0145e44261f80cdf2a53d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_4afbabcf686aa1289e8a8068b3a528f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d68da4ca-0705-50ac-b733-2073530413c2/d68da4ca-0705-50ac-b733-2073530413c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/cd/09cdabdadaa67294943ee65d69b9b256/pa/ZP54763_a5dde87be876f0c9055e7798b10c5ebf.jpg',
'Width': 800}],
'postal_code': '08001',
'price': 0,
'price_includes_vat': True,
'province': 'Barcelona',
'province_code': 'ES-B',
'region': 'Cataluna',
'region_code': 'ES-CT',
'registration_date': '2004-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Altea 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2004}
2026-04-27 08:14:15 [auto1.es] INFO: Saving data for ZP54763: {'created_time': 1777277655.286966, 'last_price_update_time': 1777277655.286978, 'has_photos': True, 'auction_closing_time': 1777303787.0}
2026-04-27 08:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_3c77daf6a4f73ccf3deb36d64731e97d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_fa88f9e6207b735c583231050cee70a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a5f10>
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_3c77daf6a4f73ccf3deb36d64731e97d.jpg saved to cache
2026-04-27 08:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0497112d0>
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_fa88f9e6207b735c583231050cee70a3.jpg saved to cache
2026-04-27 08:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_6f2aafae7303cf874f429cee5a66add2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048234750>
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_6f2aafae7303cf874f429cee5a66add2.jpg saved to cache
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_3f51882635120173ddb32fcbc88cdb23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_bc05a94ff16ecaaaf19ce2751c36fb3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a811d0>
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_3f51882635120173ddb32fcbc88cdb23.jpg saved to cache
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529410>
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_bc05a94ff16ecaaaf19ce2751c36fb3c.jpg saved to cache
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83
2026-04-27 08:14:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebafa893-f5d7-5c65-9f8d-35b704ffcf83, skipping ID generation
2026-04-27 08:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with scrape type 1
2026-04-27 08:14:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83 sending to next pipeline
2026-04-27 08:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ebafa893-f5d7-5c65-9f8d-35b704ffcf83, identifier: XW94395
2026-04-27 08:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395
2026-04-27 08:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395
2026-04-27 08:14:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395 to the API
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_bc05a94ff16ecaaaf19ce2751c36fb3c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 180,
'category': None,
'city': 'Sevilla',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:01:33Z',
'fuel_type': 'diesel',
'id': 'ebafa893-f5d7-5c65-9f8d-35b704ffcf83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 37.3885,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW94395',
'listing': 'auction',
'location': 'ES, Sevilla',
'location_confidence': 'geocoded',
'longitude': -5.9977,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 62376,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_6f2aafae7303cf874f429cee5a66add2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_bc05a94ff16ecaaaf19ce2751c36fb3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_fa88f9e6207b735c583231050cee70a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_77d8604db8731d56acba2ac0dd466bbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_3c77daf6a4f73ccf3deb36d64731e97d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_70e5902483e34c749e3d9ef882419965.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4507628719f8d1ac6e85be1f04714681.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_4b82956370218c613e793479a7179663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_8e8361654fbb1cb04e296a26018ad86f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebafa893-f5d7-5c65-9f8d-35b704ffcf83/ebafa893-f5d7-5c65-9f8d-35b704ffcf83_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/45/7445a8c21b94e848e6fca257783af245/pa/XW94395_cb7233cc5d0a77c0552622a56ee53eee.jpg',
'Width': 800}],
'postal_code': '41001',
'price': 0,
'price_includes_vat': True,
'province': 'Sevilla',
'province_code': 'ES-SE',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2021-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque D150 Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-04-27 08:14:17 [auto1.es] INFO: Saving data for XW94395: {'created_time': 1777277657.06901, 'last_price_update_time': 1777277657.069025, 'has_photos': True, 'auction_closing_time': 1777302093.0}
2026-04-27 08:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_4b51f115fbb63885ac100092025a216f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487ac990>
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_4b51f115fbb63885ac100092025a216f.jpg saved to cache
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_6f1b8faec9f4b7e29cbaaa58f9e3728e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980a50>
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_6f1b8faec9f4b7e29cbaaa58f9e3728e.jpg saved to cache
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_e86b3eb5b85bca29bf2c391bf5fa7977.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483dcd10>
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_e86b3eb5b85bca29bf2c391bf5fa7977.jpg saved to cache
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_505d306be63143a8cb4188ec7faeca07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048676310>
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_505d306be63143a8cb4188ec7faeca07.jpg saved to cache
2026-04-27 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_eb05deb68232c3b34c9f43ea1ada6446.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882ac50>
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_eb05deb68232c3b34c9f43ea1ada6446.jpg saved to cache
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_0cb6d3f4035bd7e0df8f64afd3da2396.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04882a690>
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_0cb6d3f4035bd7e0df8f64afd3da2396.jpg saved to cache
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8f490867a7e77770353d33518ab87e15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8affdbb48daf1c58eb4667405fb5db1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048428450>
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8f490867a7e77770353d33518ab87e15.jpg saved to cache
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04834e910>
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8affdbb48daf1c58eb4667405fb5db1d.jpg saved to cache
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd8b2236-5cf0-5cf0-8082-740601791136
2026-04-27 08:14:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd8b2236-5cf0-5cf0-8082-740601791136, skipping ID generation
2026-04-27 08:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd8b2236-5cf0-5cf0-8082-740601791136 with scrape type 1
2026-04-27 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd8b2236-5cf0-5cf0-8082-740601791136 sending to next pipeline
2026-04-27 08:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd8b2236-5cf0-5cf0-8082-740601791136, identifier: YV80306
2026-04-27 08:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd8b2236-5cf0-5cf0-8082-740601791136 with identifier: YV80306
2026-04-27 08:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd8b2236-5cf0-5cf0-8082-740601791136 with identifier: YV80306
2026-04-27 08:14:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bd8b2236-5cf0-5cf0-8082-740601791136 with identifier: YV80306 to the API
2026-04-27 08:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8affdbb48daf1c58eb4667405fb5db1d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'city': 'El Rebolledo',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:37:52Z',
'fuel_type': 'petrol',
'id': 'bd8b2236-5cf0-5cf0-8082-740601791136',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 38.35,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV80306',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'location_confidence': 'geocoded',
'longitude': -0.6167,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 150778,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8affdbb48daf1c58eb4667405fb5db1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_0cb6d3f4035bd7e0df8f64afd3da2396.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_8f490867a7e77770353d33518ab87e15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_505d306be63143a8cb4188ec7faeca07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_eb05deb68232c3b34c9f43ea1ada6446.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_6f1b8faec9f4b7e29cbaaa58f9e3728e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_4b51f115fbb63885ac100092025a216f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_e86b3eb5b85bca29bf2c391bf5fa7977.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_3f51882635120173ddb32fcbc88cdb23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd8b2236-5cf0-5cf0-8082-740601791136/bd8b2236-5cf0-5cf0-8082-740601791136_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/52/405290384975ab58ab5459dee00bf766/pa/YV80306_d03da48e9a77b5be7f5b3973e0e8253c.jpg',
'Width': 800}],
'postal_code': '03113',
'price': 0,
'price_includes_vat': True,
'province': 'Alicante',
'province_code': 'ES-A',
'region': 'Comunidad Valenciana',
'region_code': 'ES-VC',
'registration_date': '2014-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Advance BlueMotion Tech',
'transmission': 'manual',
'trim': 'Advance BlueMotion Tech',
'year': 2014}
2026-04-27 08:14:19 [auto1.es] INFO: Saving data for YV80306: {'created_time': 1777277659.280933, 'last_price_update_time': 1777277659.280944, 'has_photos': True, 'auction_closing_time': 1777304272.0}
2026-04-27 08:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV04678> (referer: https://www.auto1.com/v1/car-details-view/SV04678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8769130-fe3a-57c1-866a-b4549f203a40 with identifier: SV04678
2026-04-27 08:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8769130-fe3a-57c1-866a-b4549f203a40 with scrape type 1
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_7a6ef8d34a27819ae658b6358c012786.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5f485b8e168ce02f4cefaabee42329fd.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_b340bd42103bc59944ab060860b9cd05.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_2d6e000a2ae96870f98f144296b23e51.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_c4ef63eda7ac8524a5c6f0a3e11cedec.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_0546be8425a0fad08a3cafc2606f8555.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_642d45215183332033b1bcfe363843c3.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_6ed219993227ed7fa7e342e888acd5e7.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_ceca28b192f2d5d5159ceb058eea0daa.jpg not downloaded yet
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5dfa7fc20e85bea946bec59448dedb92.jpg not downloaded yet
2026-04-27 08:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ae079e6ac3d638684fa0e3b12c5c4e4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048893a90>
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ae079e6ac3d638684fa0e3b12c5c4e4b.jpg saved to cache
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0
2026-04-27 08:14:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92681f2b-f9fa-592f-bd33-ee62bd717aa0, skipping ID generation
2026-04-27 08:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0 with scrape type 1
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92681f2b-f9fa-592f-bd33-ee62bd717aa0 sending to next pipeline
2026-04-27 08:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92681f2b-f9fa-592f-bd33-ee62bd717aa0, identifier: FV87391
2026-04-27 08:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92681f2b-f9fa-592f-bd33-ee62bd717aa0 with identifier: FV87391
2026-04-27 08:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92681f2b-f9fa-592f-bd33-ee62bd717aa0 with identifier: FV87391
2026-04-27 08:14:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92681f2b-f9fa-592f-bd33-ee62bd717aa0 with identifier: FV87391 to the API
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ae079e6ac3d638684fa0e3b12c5c4e4b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'city': 'A Cañiza Pontevedra',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:24:14Z',
'fuel_type': 'petrol',
'id': '92681f2b-f9fa-592f-bd33-ee62bd717aa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV87391',
'listing': 'auction',
'location': 'ES, A Cañiza Pontevedra',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 33646,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ae079e6ac3d638684fa0e3b12c5c4e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_24aba22b06795bdccc47e6c85ab1c4b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_4617795d8180dbe3072b322d766491dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_c602c49f836179badfdd57baa257b1d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_ce96ba1326763a039f9d9e5fd86ebbc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_effb3250f46092bba014a06a4182a430.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_9e2e5952fa65d865b813027326ade3db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_407159515a88c5b117c4ca6a4ef2f2b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_782ca913927b79f77252780fa7b436dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92681f2b-f9fa-592f-bd33-ee62bd717aa0/92681f2b-f9fa-592f-bd33-ee62bd717aa0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/a1/4ea159d7b5e89d3a9d09ff0373f39dc3/pa/FV87391_69b14dba71983427102d92da85b92d25.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2021-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2021}
2026-04-27 08:14:20 [auto1.es] INFO: Saving data for FV87391: {'created_time': 1777277660.490698, 'last_price_update_time': 1777277660.490709, 'has_photos': True, 'auction_closing_time': 1777303454.0}
2026-04-27 08:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5dfa7fc20e85bea946bec59448dedb92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048828c10>
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5dfa7fc20e85bea946bec59448dedb92.jpg saved to cache
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_ceca28b192f2d5d5159ceb058eea0daa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_6ed219993227ed7fa7e342e888acd5e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04843ca50>
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_ceca28b192f2d5d5159ceb058eea0daa.jpg saved to cache
2026-04-27 08:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0572f8050>
2026-04-27 08:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_6ed219993227ed7fa7e342e888acd5e7.jpg saved to cache
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_642d45215183332033b1bcfe363843c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048205e50>
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_642d45215183332033b1bcfe363843c3.jpg saved to cache
2026-04-27 08:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_0546be8425a0fad08a3cafc2606f8555.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a42390>
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_0546be8425a0fad08a3cafc2606f8555.jpg saved to cache
2026-04-27 08:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_c4ef63eda7ac8524a5c6f0a3e11cedec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0482060d0>
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_c4ef63eda7ac8524a5c6f0a3e11cedec.jpg saved to cache
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_2d6e000a2ae96870f98f144296b23e51.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a96d90>
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_2d6e000a2ae96870f98f144296b23e51.jpg saved to cache
2026-04-27 08:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_b340bd42103bc59944ab060860b9cd05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5f485b8e168ce02f4cefaabee42329fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488912d0>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_b340bd42103bc59944ab060860b9cd05.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048590a50>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5f485b8e168ce02f4cefaabee42329fd.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV61433> (referer: https://www.auto1.com/v1/car-details-view/VV61433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1917808-a3f5-52c3-b125-c0e3b2a3a782 with identifier: VV61433
2026-04-27 08:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1917808-a3f5-52c3-b125-c0e3b2a3a782 with scrape type 1
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_960e036796efe868c6430481e9da4061.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_710866375e60025165b8655846ad59ab.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c4fce8fdd2a6fe49aa76c0ad7789b13c.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_b41f85e821ba7cc78171685d9ffaa78b.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c09a90288ab1b5dccda7b1236b71c58a.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_0d1e1b313253ace42d7347cd43f3489b.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_cfe8890a2b0e686ab4a3dc79009fb66e.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_99f605b59d401601f58a1ebbb7fb1631.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_502c69e1ef1cf739f92e255e8b406248.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_98a93c20c2c008b02b6a41cc49ef7359.jpg not downloaded yet
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_7a6ef8d34a27819ae658b6358c012786.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c0cd0>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_7a6ef8d34a27819ae658b6358c012786.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8769130-fe3a-57c1-866a-b4549f203a40
2026-04-27 08:14:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8769130-fe3a-57c1-866a-b4549f203a40, skipping ID generation
2026-04-27 08:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8769130-fe3a-57c1-866a-b4549f203a40 with scrape type 1
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8769130-fe3a-57c1-866a-b4549f203a40 sending to next pipeline
2026-04-27 08:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b8769130-fe3a-57c1-866a-b4549f203a40, identifier: SV04678
2026-04-27 08:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b8769130-fe3a-57c1-866a-b4549f203a40 with identifier: SV04678
2026-04-27 08:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b8769130-fe3a-57c1-866a-b4549f203a40 with identifier: SV04678
2026-04-27 08:14:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b8769130-fe3a-57c1-866a-b4549f203a40 with identifier: SV04678 to the API
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_7a6ef8d34a27819ae658b6358c012786.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Valladolid',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO N\\/A',
'engine': '2.4L',
'engine_horse_power': 170,
'expiration_date': '2026-04-27T15:10:35Z',
'fuel_type': 'petrol',
'id': 'b8769130-fe3a-57c1-866a-b4549f203a40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6505,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV04678',
'listing': 'auction',
'location': 'ES, Valladolid',
'location_confidence': 'geocoded',
'longitude': -4.7287,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 274113,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_7a6ef8d34a27819ae658b6358c012786.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5f485b8e168ce02f4cefaabee42329fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_b340bd42103bc59944ab060860b9cd05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_2d6e000a2ae96870f98f144296b23e51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_c4ef63eda7ac8524a5c6f0a3e11cedec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_0546be8425a0fad08a3cafc2606f8555.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_642d45215183332033b1bcfe363843c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_6ed219993227ed7fa7e342e888acd5e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_ceca28b192f2d5d5159ceb058eea0daa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8769130-fe3a-57c1-866a-b4549f203a40/b8769130-fe3a-57c1-866a-b4549f203a40_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/b2/2db29e9ae7444986632c558473dfac9d/pa/SV04678_5dfa7fc20e85bea946bec59448dedb92.jpg',
'Width': 800}],
'postal_code': '47001',
'price': 0,
'price_includes_vat': True,
'province': 'Valladolid',
'province_code': 'ES-VA',
'region': 'Castilla - Leon',
'region_code': 'ES-CL',
'registration_date': '1999-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 240 Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 1999}
2026-04-27 08:14:28 [auto1.es] INFO: Saving data for SV04678: {'created_time': 1777277668.012468, 'last_price_update_time': 1777277668.012478, 'has_photos': True, 'auction_closing_time': 1777302635.0}
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_98a93c20c2c008b02b6a41cc49ef7359.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0487a7e50>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_98a93c20c2c008b02b6a41cc49ef7359.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED14239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_502c69e1ef1cf739f92e255e8b406248.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_99f605b59d401601f58a1ebbb7fb1631.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048852ad0>
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_502c69e1ef1cf739f92e255e8b406248.jpg saved to cache
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485669d0>
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_99f605b59d401601f58a1ebbb7fb1631.jpg saved to cache
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF48628> (referer: https://www.auto1.com/v1/car-details-view/ZF48628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_0d1e1b313253ace42d7347cd43f3489b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55138443-f64f-52e2-aa1e-55ee15bb95ef with identifier: ZF48628
2026-04-27 08:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55138443-f64f-52e2-aa1e-55ee15bb95ef with scrape type 1
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_e969084d5ea2e986e8f20dfcfa94e7cb.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_4b733f9bc646b947a705935a27674620.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_eef6a9550850506bdb91a9788f375eaf.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_0e4e38b7f5bee99145aa01edefb61a49.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6da15fc95b5a84390ecfe368ee048ea6.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_cbfa35482c6a71f59bd193405028ae1e.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_8b6ff8c752caf2dc06727c8fe7e045a0.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6a40dc9c958f4e6a2f0fad9d5ce21a3f.jpg not downloaded yet
2026-04-27 08:14:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:14:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:14:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048827a50>
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_0d1e1b313253ace42d7347cd43f3489b.jpg saved to cache
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_04d339f30d1b5a3a2e3388cdf5f24051.jpg not downloaded yet
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_67b4073a1bda113743003d79c0f64585.jpg not downloaded yet
2026-04-27 08:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_cfe8890a2b0e686ab4a3dc79009fb66e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048866650>
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_cfe8890a2b0e686ab4a3dc79009fb66e.jpg saved to cache
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_67b4073a1bda113743003d79c0f64585.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a48290>
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_67b4073a1bda113743003d79c0f64585.jpg saved to cache
2026-04-27 08:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c09a90288ab1b5dccda7b1236b71c58a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048969c50>
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c09a90288ab1b5dccda7b1236b71c58a.jpg saved to cache
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6a40dc9c958f4e6a2f0fad9d5ce21a3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048566290>
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6a40dc9c958f4e6a2f0fad9d5ce21a3f.jpg saved to cache
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_8b6ff8c752caf2dc06727c8fe7e045a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048528090>
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_8b6ff8c752caf2dc06727c8fe7e045a0.jpg saved to cache
2026-04-27 08:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_04d339f30d1b5a3a2e3388cdf5f24051.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048864190>
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_04d339f30d1b5a3a2e3388cdf5f24051.jpg saved to cache
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6da15fc95b5a84390ecfe368ee048ea6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048211950>
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6da15fc95b5a84390ecfe368ee048ea6.jpg saved to cache
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR59289/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_eef6a9550850506bdb91a9788f375eaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048980710>
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_eef6a9550850506bdb91a9788f375eaf.jpg saved to cache
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_cbfa35482c6a71f59bd193405028ae1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_4b733f9bc646b947a705935a27674620.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c06d0>
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_cbfa35482c6a71f59bd193405028ae1e.jpg saved to cache
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048981990>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_4b733f9bc646b947a705935a27674620.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_0e4e38b7f5bee99145aa01edefb61a49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048675d90>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_0e4e38b7f5bee99145aa01edefb61a49.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY34672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_b41f85e821ba7cc78171685d9ffaa78b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488a1790>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_b41f85e821ba7cc78171685d9ffaa78b.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c4fce8fdd2a6fe49aa76c0ad7789b13c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a803d0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c4fce8fdd2a6fe49aa76c0ad7789b13c.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:33 [scrapy.extensions.logstats] INFO: Crawled 683 pages (at 21 pages/min), scraped 791 items (at 14 items/min)
2026-04-27 08:14:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_e969084d5ea2e986e8f20dfcfa94e7cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_960e036796efe868c6430481e9da4061.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048a40e50>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_e969084d5ea2e986e8f20dfcfa94e7cb.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55138443-f64f-52e2-aa1e-55ee15bb95ef
2026-04-27 08:14:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55138443-f64f-52e2-aa1e-55ee15bb95ef, skipping ID generation
2026-04-27 08:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55138443-f64f-52e2-aa1e-55ee15bb95ef with scrape type 1
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55138443-f64f-52e2-aa1e-55ee15bb95ef sending to next pipeline
2026-04-27 08:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55138443-f64f-52e2-aa1e-55ee15bb95ef, identifier: ZF48628
2026-04-27 08:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55138443-f64f-52e2-aa1e-55ee15bb95ef with identifier: ZF48628
2026-04-27 08:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55138443-f64f-52e2-aa1e-55ee15bb95ef with identifier: ZF48628
2026-04-27 08:14:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 55138443-f64f-52e2-aa1e-55ee15bb95ef with identifier: ZF48628 to the API
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_e969084d5ea2e986e8f20dfcfa94e7cb.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Jerez De La Frontera',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-04-27T15:53:42Z',
'fuel_type': 'diesel',
'id': '55138443-f64f-52e2-aa1e-55ee15bb95ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 36.6865,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF48628',
'listing': 'auction',
'location': 'ES, Jerez de la Frontera',
'location_confidence': 'geocoded',
'longitude': -6.1361,
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 161330,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_e969084d5ea2e986e8f20dfcfa94e7cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_4b733f9bc646b947a705935a27674620.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_eef6a9550850506bdb91a9788f375eaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_0e4e38b7f5bee99145aa01edefb61a49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6da15fc95b5a84390ecfe368ee048ea6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_cbfa35482c6a71f59bd193405028ae1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_8b6ff8c752caf2dc06727c8fe7e045a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_6a40dc9c958f4e6a2f0fad9d5ce21a3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_04d339f30d1b5a3a2e3388cdf5f24051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_55138443-f64f-52e2-aa1e-55ee15bb95ef/55138443-f64f-52e2-aa1e-55ee15bb95ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/89/ce897511bc26b6dd728ec0956dfff8ab/pa/ZF48628_67b4073a1bda113743003d79c0f64585.jpg',
'Width': 800}],
'postal_code': '11401',
'price': 0,
'price_includes_vat': True,
'province': 'Cádiz',
'province_code': 'ES-CA',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2017-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-04-27 08:14:34 [auto1.es] INFO: Saving data for ZF48628: {'created_time': 1777277674.888633, 'last_price_update_time': 1777277674.888642, 'has_photos': True, 'auction_closing_time': 1777305222.0}
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_710866375e60025165b8655846ad59ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP60983> (referer: https://www.auto1.com/v1/car-details-view/EP60983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:14:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0485647d0>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_960e036796efe868c6430481e9da4061.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048210c90>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_710866375e60025165b8655846ad59ab.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1917808-a3f5-52c3-b125-c0e3b2a3a782
2026-04-27 08:14:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1917808-a3f5-52c3-b125-c0e3b2a3a782, skipping ID generation
2026-04-27 08:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1917808-a3f5-52c3-b125-c0e3b2a3a782 with scrape type 1
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1917808-a3f5-52c3-b125-c0e3b2a3a782 sending to next pipeline
2026-04-27 08:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1917808-a3f5-52c3-b125-c0e3b2a3a782, identifier: VV61433
2026-04-27 08:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1917808-a3f5-52c3-b125-c0e3b2a3a782 with identifier: VV61433
2026-04-27 08:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1917808-a3f5-52c3-b125-c0e3b2a3a782 with identifier: VV61433
2026-04-27 08:14:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1917808-a3f5-52c3-b125-c0e3b2a3a782 with identifier: VV61433 to the API
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_710866375e60025165b8655846ad59ab.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Roces',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:44:16Z',
'fuel_type': 'petrol',
'id': 'c1917808-a3f5-52c3-b125-c0e3b2a3a782',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV61433',
'listing': 'auction',
'location': 'ES, Roces',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '308',
'odometer': 90489,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499299,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_960e036796efe868c6430481e9da4061.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_710866375e60025165b8655846ad59ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c4fce8fdd2a6fe49aa76c0ad7789b13c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_b41f85e821ba7cc78171685d9ffaa78b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_c09a90288ab1b5dccda7b1236b71c58a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445956,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_0d1e1b313253ace42d7347cd43f3489b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_cfe8890a2b0e686ab4a3dc79009fb66e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_99f605b59d401601f58a1ebbb7fb1631.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_502c69e1ef1cf739f92e255e8b406248.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c1917808-a3f5-52c3-b125-c0e3b2a3a782/c1917808-a3f5-52c3-b125-c0e3b2a3a782_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/3c/bb3c24b214b55dd62b712f2fc85edc17/pa/VV61433_98a93c20c2c008b02b6a41cc49ef7359.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-08-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-04-27 08:14:35 [auto1.es] INFO: Saving data for VV61433: {'created_time': 1777277675.465044, 'last_price_update_time': 1777277675.465053, 'has_photos': True, 'auction_closing_time': 1777304656.0}
2026-04-27 08:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d with identifier: EP60983
2026-04-27 08:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d with scrape type 1
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_1bf7718632f6816043f8497feb3300ff.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_0cbe9ed459c5507a0ec78ed24df98b7e.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9f751325645316d3382bd7450ad8b685.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9da7a23f2a0382f0fe35d8bf789b183e.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_30a1165e506f24e3f6cc25d2c8d65a3c.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9ba509ca1571f178f8a53afc17e4a0ae.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_313da445fa0de858058a52e315760735.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_08aec27687b47e05dd69e2b87c98569f.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_f64b60c0892fe63ad29497c3df18d762.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_7cfa5343f66b7c7d861e048cdd31e475.jpg not downloaded yet
2026-04-27 08:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT34146> (referer: https://www.auto1.com/v1/car-details-view/XT34146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd676cd1-09ff-5257-ad9c-9394848abfc4 with identifier: XT34146
2026-04-27 08:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd676cd1-09ff-5257-ad9c-9394848abfc4 with scrape type 1
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_a2f9288d6867d82a18286a75aacee985.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f15954e46c9d11b54d94979b5498f1e4.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_c32747a52336e3051f26656a74a0b996.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_6e3a621480b72e868013b81024aa8693.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_8cd43bf39446097e09dfa1e2d6310a93.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f0aa1c5f75660757dfd58f2019edcf49.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_b98524dad4a2ad6817534ed60f9a2635.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_5c8518a209365b99f111d28d257829c3.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_75ba58dcf6f76d13c6c4875f7d1c8e25.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_4a33095792047372094d784e2f5a6430.jpg not downloaded yet
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_7cfa5343f66b7c7d861e048cdd31e475.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_4a33095792047372094d784e2f5a6430.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048235990>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_7cfa5343f66b7c7d861e048cdd31e475.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS34781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048339b50>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_4a33095792047372094d784e2f5a6430.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_75ba58dcf6f76d13c6c4875f7d1c8e25.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cbc50>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_75ba58dcf6f76d13c6c4875f7d1c8e25.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_5c8518a209365b99f111d28d257829c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048887510>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_5c8518a209365b99f111d28d257829c3.jpg saved to cache
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_b98524dad4a2ad6817534ed60f9a2635.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048662410>
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_b98524dad4a2ad6817534ed60f9a2635.jpg saved to cache
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f0aa1c5f75660757dfd58f2019edcf49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048592390>
2026-04-27 08:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f0aa1c5f75660757dfd58f2019edcf49.jpg saved to cache
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_8cd43bf39446097e09dfa1e2d6310a93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2e90>
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_8cd43bf39446097e09dfa1e2d6310a93.jpg saved to cache
2026-04-27 08:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_6e3a621480b72e868013b81024aa8693.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_c32747a52336e3051f26656a74a0b996.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e6d50>
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_6e3a621480b72e868013b81024aa8693.jpg saved to cache
2026-04-27 08:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0488fa550>
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_c32747a52336e3051f26656a74a0b996.jpg saved to cache
2026-04-27 08:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f15954e46c9d11b54d94979b5498f1e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_a2f9288d6867d82a18286a75aacee985.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c41d0>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f15954e46c9d11b54d94979b5498f1e4.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 08:14:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 08:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 08:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c4650>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_a2f9288d6867d82a18286a75aacee985.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd676cd1-09ff-5257-ad9c-9394848abfc4
2026-04-27 08:14:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd676cd1-09ff-5257-ad9c-9394848abfc4, skipping ID generation
2026-04-27 08:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd676cd1-09ff-5257-ad9c-9394848abfc4 with scrape type 1
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd676cd1-09ff-5257-ad9c-9394848abfc4 sending to next pipeline
2026-04-27 08:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd676cd1-09ff-5257-ad9c-9394848abfc4, identifier: XT34146
2026-04-27 08:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd676cd1-09ff-5257-ad9c-9394848abfc4 with identifier: XT34146
2026-04-27 08:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd676cd1-09ff-5257-ad9c-9394848abfc4 with identifier: XT34146
2026-04-27 08:14:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd676cd1-09ff-5257-ad9c-9394848abfc4 with identifier: XT34146 to the API
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_a2f9288d6867d82a18286a75aacee985.jpg>
{'auction_title': '',
'c_o_2_emission_value': 348,
'category': None,
'city': 'Zaragoza',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '5.0L',
'engine_horse_power': 510,
'expiration_date': '2026-04-27T15:42:24Z',
'fuel_type': 'petrol',
'id': 'dd676cd1-09ff-5257-ad9c-9394848abfc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': 41.6516,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT34146',
'listing': 'auction',
'location': 'ES, Zaragoza',
'location_confidence': 'geocoded',
'longitude': -0.8771,
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 229283,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568591,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_a2f9288d6867d82a18286a75aacee985.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f15954e46c9d11b54d94979b5498f1e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_c32747a52336e3051f26656a74a0b996.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_6e3a621480b72e868013b81024aa8693.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_8cd43bf39446097e09dfa1e2d6310a93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_f0aa1c5f75660757dfd58f2019edcf49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596255,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_b98524dad4a2ad6817534ed60f9a2635.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_5c8518a209365b99f111d28d257829c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_75ba58dcf6f76d13c6c4875f7d1c8e25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd676cd1-09ff-5257-ad9c-9394848abfc4/dd676cd1-09ff-5257-ad9c-9394848abfc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d37742239ed004da89e5eaf0fc888f87/pa/XT34146_4a33095792047372094d784e2f5a6430.jpg',
'Width': 800}],
'postal_code': '50001',
'price': 0,
'price_includes_vat': True,
'province': 'Zaragoza',
'province_code': 'ES-Z',
'region': 'Aragon',
'region_code': 'ES-AR',
'registration_date': '2011-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 5.0 V8 Supercharged',
'transmission': 'automatic',
'trim': 'Supercharged',
'year': 2011}
2026-04-27 08:14:44 [auto1.es] INFO: Saving data for XT34146: {'created_time': 1777277684.127098, 'last_price_update_time': 1777277684.127108, 'has_photos': True, 'auction_closing_time': 1777304544.0}
2026-04-27 08:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_f64b60c0892fe63ad29497c3df18d762.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837ee10>
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_f64b60c0892fe63ad29497c3df18d762.jpg saved to cache
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_08aec27687b47e05dd69e2b87c98569f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_313da445fa0de858058a52e315760735.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e6590>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_08aec27687b47e05dd69e2b87c98569f.jpg saved to cache
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9ba509ca1571f178f8a53afc17e4a0ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483e4f10>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_313da445fa0de858058a52e315760735.jpg saved to cache
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e0c90>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9ba509ca1571f178f8a53afc17e4a0ae.jpg saved to cache
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV18747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9da7a23f2a0382f0fe35d8bf789b183e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481e1990>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9da7a23f2a0382f0fe35d8bf789b183e.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_30a1165e506f24e3f6cc25d2c8d65a3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048709950>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_30a1165e506f24e3f6cc25d2c8d65a3c.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9f751325645316d3382bd7450ad8b685.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04842a990>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9f751325645316d3382bd7450ad8b685.jpg saved to cache
2026-04-27 08:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_0cbe9ed459c5507a0ec78ed24df98b7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_1bf7718632f6816043f8497feb3300ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04837cf10>
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_0cbe9ed459c5507a0ec78ed24df98b7e.jpg saved to cache
2026-04-27 08:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0481c2fd0>
2026-04-27 08:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_1bf7718632f6816043f8497feb3300ff.jpg saved to cache
2026-04-27 08:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d
2026-04-27 08:14:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d, skipping ID generation
2026-04-27 08:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d with scrape type 1
2026-04-27 08:14:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d sending to next pipeline
2026-04-27 08:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d, identifier: EP60983
2026-04-27 08:14:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d with identifier: EP60983
2026-04-27 08:14:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d with identifier: EP60983
2026-04-27 08:14:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d with identifier: EP60983 to the API
2026-04-27 08:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_1bf7718632f6816043f8497feb3300ff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'city': 'Cordoba',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:29:28Z',
'fuel_type': 'diesel',
'id': '2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 37.8916,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP60983',
'listing': 'auction',
'location': 'ES, Córdoba',
'location_confidence': 'geocoded',
'longitude': -4.7727,
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 116683,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_1bf7718632f6816043f8497feb3300ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_0cbe9ed459c5507a0ec78ed24df98b7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9f751325645316d3382bd7450ad8b685.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9da7a23f2a0382f0fe35d8bf789b183e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_30a1165e506f24e3f6cc25d2c8d65a3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_9ba509ca1571f178f8a53afc17e4a0ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_313da445fa0de858058a52e315760735.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_08aec27687b47e05dd69e2b87c98569f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_f64b60c0892fe63ad29497c3df18d762.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d/2c89b6ec-7cb9-54d8-ae8f-1cbeec5e291d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a690e93b5e71993ac540dc1335324/pa/EP60983_7cfa5343f66b7c7d861e048cdd31e475.jpg',
'Width': 800}],
'postal_code': '14001',
'price': 0,
'price_includes_vat': True,
'province': 'Córdoba',
'province_code': 'ES-CO',
'region': 'Andalucia',
'region_code': 'ES-AN',
'registration_date': '2022-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Ambition 4x4',
'transmission': 'automatic',
'trim': 'Ambition 4x4',
'year': 2022}
2026-04-27 08:14:48 [auto1.es] INFO: Saving data for EP60983: {'created_time': 1777277688.545143, 'last_price_update_time': 1777277688.545155, 'has_photos': True, 'auction_closing_time': 1777303768.0}
2026-04-27 08:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED14239> (referer: https://www.auto1.com/v1/car-details-view/ED14239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_9e67ecb30510ceac9a861f81de5161de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4 with identifier: ED14239
2026-04-27 08:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4 with scrape type 1
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_d30ae7c48cdd52f042820d0831dc97cf.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_3e74f14fc51a465345b82c082664ecec.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_b1dfe7be9dcb0094217aa4cdb3073d2c.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_8f439813a9243bdab5b10ddac3645128.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_a478761acaa14f09e3fc8acc8c9892e8.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_a9810811fa67b85eea481983701b0e8d.jpg not downloaded yet
2026-04-27 08:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048708910>
2026-04-27 08:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e315c7de-e11c-5cbe-848b-bfcb7402ae9d/e315c7de-e11c-5cbe-848b-bfcb7402ae9d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e6/f2e6e2b6888a833d504032e2c34cdbcb/pa/AT69557_9e67ecb30510ceac9a861f81de5161de.jpg saved to cache
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e315c7de-e11c-5cbe-848b-bfcb7402ae9d
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_303202b8528157bd5b391c8c261f739a.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_40d928899c0c7bf50a03122f39db278f.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_52ec172da0f251942ee257441bad0060.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_37f7187843e20c5427d4ffa0a2c83925.jpg not downloaded yet
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN20090/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_37f7187843e20c5427d4ffa0a2c83925.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0486cb950>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4/b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_37f7187843e20c5427d4ffa0a2c83925.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR59289> (referer: https://www.auto1.com/v1/car-details-view/ZR59289/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54116b52-1974-5805-87e8-cd4c55d507b7 with identifier: ZR59289
2026-04-27 08:14:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54116b52-1974-5805-87e8-cd4c55d507b7 with scrape type 1
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54116b52-1974-5805-87e8-cd4c55d507b7
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_dde5fd1a08b08d25b8fc00ea913e0ea2.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_3775d24eea7ca037d682cc357c278c34.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_a6c84de6d298f3896d297c32e86f730b.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_20d58130da3b75a87e821cf9907f8586.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_ca34bc8611d2921239a5efb773e697da.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_75feaf49b837140ad957513121639b87.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_0f28c2d2e2c222a430bdfd69a1da9381.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_899465c4a2150995011b983841ccf48c.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_3d24eb18cf2c9363d9765273975ffbcb.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_4826149c546a7370de7cf61003935435.jpg not downloaded yet
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_52ec172da0f251942ee257441bad0060.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048529850>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4/b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2ffd40a3e3ef216e5e1082f867112f/pa/ED14239_52ec172da0f251942ee257441bad0060.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1bbb1d3-aaa6-5fd4-b77a-9a86bfb108c4
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:55 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2057 | hits on page: 40
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: XW94395
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for XW94395: 0
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: HD36050
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for HD36050: 0
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: MS83091
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: KA55967
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for KA55967: 0
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: JN40104
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: FK25349
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for FK25349: 0
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: BM47543
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for BM47543: 2
2026-04-27 08:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b8b6fc-1185-51c3-abee-f6a8be65d404 with identifier: BM47543
2026-04-27 08:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b8b6fc-1185-51c3-abee-f6a8be65d404 with scrape type 2
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9b8b6fc-1185-51c3-abee-f6a8be65d404 with scrape type 2
2026-04-27 08:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e9b8b6fc-1185-51c3-abee-f6a8be65d404, identifier: BM47543
2026-04-27 08:14:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e9b8b6fc-1185-51c3-abee-f6a8be65d404 with identifier: BM47543
2026-04-27 08:14:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e9b8b6fc-1185-51c3-abee-f6a8be65d404 with identifier: BM47543
2026-04-27 08:14:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e9b8b6fc-1185-51c3-abee-f6a8be65d404 with identifier: BM47543 to the API
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-04-27T15:28:31Z',
'fuel_type': 'petrol',
'id': 'e9b8b6fc-1185-51c3-abee-f6a8be65d404',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM47543',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 192804,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-10-30',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start&Stop',
'transmission': 'manual',
'trim': 'Dynamic Start&Stop',
'year': 2017}
2026-04-27 08:14:55 [auto1.es] INFO: Saving data for BM47543: {'auction_closing_time': 1777303711.0, 'created_time': 1777020110.243937, 'has_photos': True, 'last_price_update_time': 1777277695.676292}
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: PR10825
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for PR10825: 1
2026-04-27 08:14:55 [auto1.es] INFO: Found listing with ID: MT81581
2026-04-27 08:14:55 [auto1.es] INFO: Scrape type for MT81581: 2
2026-04-27 08:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842019a3-97a0-55a3-94b7-4fe4b17fb665 with identifier: MT81581
2026-04-27 08:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842019a3-97a0-55a3-94b7-4fe4b17fb665 with scrape type 2
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 842019a3-97a0-55a3-94b7-4fe4b17fb665 with scrape type 2
2026-04-27 08:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 842019a3-97a0-55a3-94b7-4fe4b17fb665, identifier: MT81581
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS67474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 842019a3-97a0-55a3-94b7-4fe4b17fb665 with identifier: MT81581
2026-04-27 08:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 842019a3-97a0-55a3-94b7-4fe4b17fb665 with identifier: MT81581
2026-04-27 08:14:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 842019a3-97a0-55a3-94b7-4fe4b17fb665 with identifier: MT81581 to the API
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:03:16Z',
'fuel_type': 'petrol',
'id': '842019a3-97a0-55a3-94b7-4fe4b17fb665',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT81581',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Mokka X',
'odometer': 188654,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2018-05-31',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Excellence',
'transmission': 'automatic',
'trim': 'Excellence',
'year': 2018}
2026-04-27 08:14:56 [auto1.es] INFO: Saving data for MT81581: {'auction_closing_time': 1777302196.0, 'created_time': 1777021745.243457, 'has_photos': True, 'last_price_update_time': 1777277696.637387}
2026-04-27 08:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:56 [auto1.es] INFO: Found listing with ID: AB49059
2026-04-27 08:14:56 [auto1.es] INFO: Scrape type for AB49059: 2
2026-04-27 08:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e206f3-05c0-519f-95eb-5965eb2ea9d4 with identifier: AB49059
2026-04-27 08:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e206f3-05c0-519f-95eb-5965eb2ea9d4 with scrape type 2
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e206f3-05c0-519f-95eb-5965eb2ea9d4 with scrape type 2
2026-04-27 08:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14e206f3-05c0-519f-95eb-5965eb2ea9d4, identifier: AB49059
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_4826149c546a7370de7cf61003935435.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_3d24eb18cf2c9363d9765273975ffbcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14e206f3-05c0-519f-95eb-5965eb2ea9d4 with identifier: AB49059
2026-04-27 08:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14e206f3-05c0-519f-95eb-5965eb2ea9d4 with identifier: AB49059
2026-04-27 08:14:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14e206f3-05c0-519f-95eb-5965eb2ea9d4 with identifier: AB49059 to the API
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:55:26Z',
'fuel_type': 'petrol',
'id': '14e206f3-05c0-519f-95eb-5965eb2ea9d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB49059',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '3008',
'odometer': 106644,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-08-24',
'seller_name': None,
'title': 'Peugeot 3008 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-04-27 08:14:57 [auto1.es] INFO: Saving data for AB49059: {'auction_closing_time': 1777305326.0, 'created_time': 1777018301.259123, 'has_photos': True, 'last_price_update_time': 1777277697.052351}
2026-04-27 08:14:57 [auto1.es] INFO: Found listing with ID: UG65696
2026-04-27 08:14:57 [auto1.es] INFO: Scrape type for UG65696: 1
2026-04-27 08:14:57 [auto1.es] INFO: Found listing with ID: KN53869
2026-04-27 08:14:57 [auto1.es] INFO: Scrape type for KN53869: 1
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0483df890>
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54116b52-1974-5805-87e8-cd4c55d507b7/54116b52-1974-5805-87e8-cd4c55d507b7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_4826149c546a7370de7cf61003935435.jpg saved to cache
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54116b52-1974-5805-87e8-cd4c55d507b7
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04884c190>
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54116b52-1974-5805-87e8-cd4c55d507b7/54116b52-1974-5805-87e8-cd4c55d507b7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_3d24eb18cf2c9363d9765273975ffbcb.jpg saved to cache
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54116b52-1974-5805-87e8-cd4c55d507b7
2026-04-27 08:14:57 [auto1.es] INFO: Found listing with ID: SN64789
2026-04-27 08:14:57 [auto1.es] INFO: Scrape type for SN64789: 2
2026-04-27 08:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13469f86-7dbe-5dee-8205-ec09f80752f5 with identifier: SN64789
2026-04-27 08:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13469f86-7dbe-5dee-8205-ec09f80752f5 with scrape type 2
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13469f86-7dbe-5dee-8205-ec09f80752f5 with scrape type 2
2026-04-27 08:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13469f86-7dbe-5dee-8205-ec09f80752f5, identifier: SN64789
2026-04-27 08:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13469f86-7dbe-5dee-8205-ec09f80752f5 with identifier: SN64789
2026-04-27 08:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13469f86-7dbe-5dee-8205-ec09f80752f5 with identifier: SN64789
2026-04-27 08:14:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13469f86-7dbe-5dee-8205-ec09f80752f5 with identifier: SN64789 to the API
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:55:02Z',
'fuel_type': 'petrol',
'id': '13469f86-7dbe-5dee-8205-ec09f80752f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN64789',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Astra',
'odometer': 182044,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-07-26',
'seller_name': None,
'title': 'Opel Astra 1.6 Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2007}
2026-04-27 08:14:57 [auto1.es] INFO: Saving data for SN64789: {'auction_closing_time': 1777305302.0, 'created_time': 1777018112.228656, 'has_photos': True, 'last_price_update_time': 1777277697.632022}
2026-04-27 08:14:57 [auto1.es] INFO: Found listing with ID: HG47154
2026-04-27 08:14:57 [auto1.es] INFO: Scrape type for HG47154: 2
2026-04-27 08:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154
2026-04-27 08:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce875944-c62c-53ab-b114-e78bfa1c380f with scrape type 2
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce875944-c62c-53ab-b114-e78bfa1c380f with scrape type 2
2026-04-27 08:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce875944-c62c-53ab-b114-e78bfa1c380f, identifier: HG47154
2026-04-27 08:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_899465c4a2150995011b983841ccf48c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154
2026-04-27 08:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154
2026-04-27 08:14:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154 to the API
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-04-27T15:16:27Z',
'fuel_type': 'diesel',
'id': 'ce875944-c62c-53ab-b114-e78bfa1c380f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG47154',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Scenic',
'odometer': 326123,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2010-08-31',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2010}
2026-04-27 08:14:58 [auto1.es] INFO: Saving data for HG47154: {'auction_closing_time': 1777302987.0, 'created_time': 1777021544.032881, 'has_photos': True, 'last_price_update_time': 1777277698.053911}
2026-04-27 08:14:58 [auto1.es] INFO: Found listing with ID: MD93554
2026-04-27 08:14:58 [auto1.es] INFO: Scrape type for MD93554: 1
2026-04-27 08:14:58 [auto1.es] INFO: Found listing with ID: GU28850
2026-04-27 08:14:58 [auto1.es] INFO: Scrape type for GU28850: 1
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048610310>
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54116b52-1974-5805-87e8-cd4c55d507b7/54116b52-1974-5805-87e8-cd4c55d507b7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/c0/02c0e72773c89836a78ec176cf1fafe8/pa/ZR59289_899465c4a2150995011b983841ccf48c.jpg saved to cache
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54116b52-1974-5805-87e8-cd4c55d507b7
2026-04-27 08:14:58 [auto1.es] INFO: Found listing with ID: SB91629
2026-04-27 08:14:58 [auto1.es] INFO: Scrape type for SB91629: 2
2026-04-27 08:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6 with identifier: SB91629
2026-04-27 08:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6 with scrape type 2
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6 with scrape type 2
2026-04-27 08:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6, identifier: SB91629
2026-04-27 08:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6 with identifier: SB91629
2026-04-27 08:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6 with identifier: SB91629
2026-04-27 08:14:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6 with identifier: SB91629 to the API
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-04-27T15:55:03Z',
'fuel_type': 'diesel',
'id': 'b3ac99dd-8e5a-514e-8e1e-f10f4f8dfbe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB91629',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Rio',
'odometer': 94868,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-03-08',
'seller_name': None,
'title': 'Kia Rio 1.1 CRDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-04-27 08:14:58 [auto1.es] INFO: Saving data for SB91629: {'auction_closing_time': 1777305303.0, 'created_time': 1777020610.545386, 'has_photos': True, 'last_price_update_time': 1777277698.54373}
2026-04-27 08:14:58 [auto1.es] INFO: Found listing with ID: NM27698
2026-04-27 08:14:58 [auto1.es] INFO: Scrape type for NM27698: 2
2026-04-27 08:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6d28dd-805b-5323-b765-0553337b7e6d with identifier: NM27698
2026-04-27 08:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6d28dd-805b-5323-b765-0553337b7e6d with scrape type 2
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6d28dd-805b-5323-b765-0553337b7e6d with scrape type 2
2026-04-27 08:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca6d28dd-805b-5323-b765-0553337b7e6d, identifier: NM27698
2026-04-27 08:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca6d28dd-805b-5323-b765-0553337b7e6d with identifier: NM27698
2026-04-27 08:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca6d28dd-805b-5323-b765-0553337b7e6d with identifier: NM27698
2026-04-27 08:14:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ca6d28dd-805b-5323-b765-0553337b7e6d with identifier: NM27698 to the API
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:24:39Z',
'fuel_type': 'petrol',
'id': 'ca6d28dd-805b-5323-b765-0553337b7e6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM27698',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Corsa',
'odometer': 103238,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-12-28',
'seller_name': None,
'title': 'Opel Corsa 1.4 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2006}
2026-04-27 08:14:59 [auto1.es] INFO: Saving data for NM27698: {'auction_closing_time': 1777303479.0, 'created_time': 1777021390.541014, 'has_photos': True, 'last_price_update_time': 1777277699.006624}
2026-04-27 08:14:59 [auto1.es] INFO: Found listing with ID: CB35812
2026-04-27 08:14:59 [auto1.es] INFO: Scrape type for CB35812: 2
2026-04-27 08:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d1ff0fa-48ed-523e-a4c8-655960be3f53 with identifier: CB35812
2026-04-27 08:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d1ff0fa-48ed-523e-a4c8-655960be3f53 with scrape type 2
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d1ff0fa-48ed-523e-a4c8-655960be3f53 with scrape type 2
2026-04-27 08:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d1ff0fa-48ed-523e-a4c8-655960be3f53, identifier: CB35812
2026-04-27 08:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d1ff0fa-48ed-523e-a4c8-655960be3f53 with identifier: CB35812
2026-04-27 08:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d1ff0fa-48ed-523e-a4c8-655960be3f53 with identifier: CB35812
2026-04-27 08:14:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d1ff0fa-48ed-523e-a4c8-655960be3f53 with identifier: CB35812 to the API
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:37:39Z',
'fuel_type': 'diesel',
'id': '5d1ff0fa-48ed-523e-a4c8-655960be3f53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB35812',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Kia',
'model': 'Sportage',
'odometer': 293301,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2007-02-05',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2007}
2026-04-27 08:14:59 [auto1.es] INFO: Saving data for CB35812: {'auction_closing_time': 1777304259.0, 'created_time': 1777018272.358951, 'has_photos': True, 'last_price_update_time': 1777277699.671844}
2026-04-27 08:14:59 [auto1.es] INFO: Found listing with ID: PZ38883
2026-04-27 08:14:59 [auto1.es] INFO: Scrape type for PZ38883: 1
2026-04-27 08:14:59 [auto1.es] INFO: Found listing with ID: AT13789
2026-04-27 08:14:59 [auto1.es] INFO: Scrape type for AT13789: 2
2026-04-27 08:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cab6f73-2a15-5f68-8f27-4408c15710b8 with identifier: AT13789
2026-04-27 08:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cab6f73-2a15-5f68-8f27-4408c15710b8 with scrape type 2
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cab6f73-2a15-5f68-8f27-4408c15710b8 with scrape type 2
2026-04-27 08:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6cab6f73-2a15-5f68-8f27-4408c15710b8, identifier: AT13789
2026-04-27 08:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6cab6f73-2a15-5f68-8f27-4408c15710b8 with identifier: AT13789
2026-04-27 08:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6cab6f73-2a15-5f68-8f27-4408c15710b8 with identifier: AT13789
2026-04-27 08:14:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6cab6f73-2a15-5f68-8f27-4408c15710b8 with identifier: AT13789 to the API
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:15:06Z',
'fuel_type': 'diesel',
'id': '6cab6f73-2a15-5f68-8f27-4408c15710b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT13789',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 159746,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2013-11-20',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-04-27 08:15:00 [auto1.es] INFO: Saving data for AT13789: {'auction_closing_time': 1777302906.0, 'created_time': 1777019369.186713, 'has_photos': True, 'last_price_update_time': 1777277700.168532}
2026-04-27 08:15:00 [auto1.es] INFO: Found listing with ID: DC37414
2026-04-27 08:15:00 [auto1.es] INFO: Scrape type for DC37414: 1
2026-04-27 08:15:00 [auto1.es] INFO: Found listing with ID: WX87683
2026-04-27 08:15:00 [auto1.es] INFO: Scrape type for WX87683: 2
2026-04-27 08:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 878b0a85-5539-5074-a861-c63275429be7 with identifier: WX87683
2026-04-27 08:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 878b0a85-5539-5074-a861-c63275429be7 with scrape type 2
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 878b0a85-5539-5074-a861-c63275429be7 with scrape type 2
2026-04-27 08:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 878b0a85-5539-5074-a861-c63275429be7, identifier: WX87683
2026-04-27 08:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 878b0a85-5539-5074-a861-c63275429be7 with identifier: WX87683
2026-04-27 08:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 878b0a85-5539-5074-a861-c63275429be7 with identifier: WX87683
2026-04-27 08:15:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 878b0a85-5539-5074-a861-c63275429be7 with identifier: WX87683 to the API
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:41:59Z',
'fuel_type': 'diesel',
'id': '878b0a85-5539-5074-a861-c63275429be7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX87683',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Ford',
'model': 'S-Max',
'odometer': 187434,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-12-28',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2008}
2026-04-27 08:15:00 [auto1.es] INFO: Saving data for WX87683: {'auction_closing_time': 1777304519.0, 'created_time': 1777020648.794165, 'has_photos': True, 'last_price_update_time': 1777277700.635188}
2026-04-27 08:15:00 [auto1.es] INFO: Found listing with ID: DV31670
2026-04-27 08:15:00 [auto1.es] INFO: Scrape type for DV31670: 2
2026-04-27 08:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4981e4ac-9584-57c8-893e-b094dd4d244c with identifier: DV31670
2026-04-27 08:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4981e4ac-9584-57c8-893e-b094dd4d244c with scrape type 2
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4981e4ac-9584-57c8-893e-b094dd4d244c with scrape type 2
2026-04-27 08:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4981e4ac-9584-57c8-893e-b094dd4d244c, identifier: DV31670
2026-04-27 08:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4981e4ac-9584-57c8-893e-b094dd4d244c with identifier: DV31670
2026-04-27 08:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4981e4ac-9584-57c8-893e-b094dd4d244c with identifier: DV31670
2026-04-27 08:15:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4981e4ac-9584-57c8-893e-b094dd4d244c with identifier: DV31670 to the API
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-04-27T15:40:51Z',
'fuel_type': 'petrol',
'id': '4981e4ac-9584-57c8-893e-b094dd4d244c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV31670',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 99066,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-12-01',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Sport BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport BlueMotion Tech',
'year': 2014}
2026-04-27 08:15:01 [auto1.es] INFO: Saving data for DV31670: {'auction_closing_time': 1777304451.0, 'created_time': 1777021724.439342, 'has_photos': True, 'last_price_update_time': 1777277701.205475}
2026-04-27 08:15:01 [auto1.es] INFO: Found listing with ID: WZ10661
2026-04-27 08:15:01 [auto1.es] INFO: Scrape type for WZ10661: 1
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG79716> (referer: https://www.auto1.com/v1/car-details-view/UG79716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:01 [auto1.es] INFO: Found listing with ID: WW38851
2026-04-27 08:15:01 [auto1.es] INFO: Scrape type for WW38851: 2
2026-04-27 08:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287015c6-0019-5e34-9016-5962e8daba74 with identifier: WW38851
2026-04-27 08:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287015c6-0019-5e34-9016-5962e8daba74 with scrape type 2
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287015c6-0019-5e34-9016-5962e8daba74 with scrape type 2
2026-04-27 08:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 287015c6-0019-5e34-9016-5962e8daba74, identifier: WW38851
2026-04-27 08:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 287015c6-0019-5e34-9016-5962e8daba74 with identifier: WW38851
2026-04-27 08:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 287015c6-0019-5e34-9016-5962e8daba74 with identifier: WW38851
2026-04-27 08:15:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 287015c6-0019-5e34-9016-5962e8daba74 with identifier: WW38851 to the API
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-04-27T15:51:22Z',
'fuel_type': 'diesel',
'id': '287015c6-0019-5e34-9016-5962e8daba74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW38851',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '307',
'odometer': 114115,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2004-09-19',
'seller_name': None,
'title': 'Peugeot 307 1.6 HDi XS',
'transmission': 'manual',
'trim': 'XS',
'year': 2004}
2026-04-27 08:15:01 [auto1.es] INFO: Saving data for WW38851: {'auction_closing_time': 1777305082.0, 'created_time': 1777021240.750228, 'has_photos': True, 'last_price_update_time': 1777277701.692316}
2026-04-27 08:15:01 [auto1.es] INFO: Found listing with ID: WL62838
2026-04-27 08:15:01 [auto1.es] INFO: Scrape type for WL62838: 1
2026-04-27 08:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93fc58b8-0546-5937-aaa2-c54309946c95 with identifier: UG79716
2026-04-27 08:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93fc58b8-0546-5937-aaa2-c54309946c95 with scrape type 1
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93fc58b8-0546-5937-aaa2-c54309946c95
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_887c70bcbd2414bd19333d8fc71f34ed.jpg not downloaded yet
2026-04-27 08:15:01 [auto1.es] INFO: Found listing with ID: UA78050
2026-04-27 08:15:01 [auto1.es] INFO: Scrape type for UA78050: 1
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS38247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_1e21f45223efdb167b523362f0d80ce5.jpg not downloaded yet
2026-04-27 08:15:01 [auto1.es] INFO: Found listing with ID: LC72658
2026-04-27 08:15:01 [auto1.es] INFO: Scrape type for LC72658: 1
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_514f5a99ca5a0e9b2955f0d795f34438.jpg not downloaded yet
2026-04-27 08:15:01 [auto1.es] INFO: Found listing with ID: UE32558
2026-04-27 08:15:01 [auto1.es] INFO: Scrape type for UE32558: 2
2026-04-27 08:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f2de05-cebc-5f73-b1e3-f52b70d199ff with identifier: UE32558
2026-04-27 08:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f2de05-cebc-5f73-b1e3-f52b70d199ff with scrape type 2
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1f2de05-cebc-5f73-b1e3-f52b70d199ff with scrape type 2
2026-04-27 08:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1f2de05-cebc-5f73-b1e3-f52b70d199ff, identifier: UE32558
2026-04-27 08:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1f2de05-cebc-5f73-b1e3-f52b70d199ff with identifier: UE32558
2026-04-27 08:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1f2de05-cebc-5f73-b1e3-f52b70d199ff with identifier: UE32558
2026-04-27 08:15:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1f2de05-cebc-5f73-b1e3-f52b70d199ff with identifier: UE32558 to the API
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-04-27T15:15:53Z',
'fuel_type': 'diesel',
'id': 'd1f2de05-cebc-5f73-b1e3-f52b70d199ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE32558',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'BMW',
'model': 'X4',
'odometer': 395532,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2017-04-24',
'seller_name': None,
'title': 'BMW X4 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-04-27 08:15:02 [auto1.es] INFO: Saving data for UE32558: {'auction_closing_time': 1777302953.0, 'created_time': 1777018420.668051, 'has_photos': True, 'last_price_update_time': 1777277702.35564}
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_176842eb2f7a8ae70d0ac68d8e94c557.jpg not downloaded yet
2026-04-27 08:15:02 [auto1.es] INFO: Found listing with ID: AY36461
2026-04-27 08:15:02 [auto1.es] INFO: Scrape type for AY36461: 1
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_887c70bcbd2414bd19333d8fc71f34ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_f7bef7063d1eb923d78b3a8e4342b6cf.jpg not downloaded yet
2026-04-27 08:15:02 [auto1.es] INFO: Found listing with ID: BK24542
2026-04-27 08:15:02 [auto1.es] INFO: Scrape type for BK24542: 2
2026-04-27 08:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8755c43-cd86-51e0-a4b7-09b23fb9b1cc with identifier: BK24542
2026-04-27 08:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8755c43-cd86-51e0-a4b7-09b23fb9b1cc with scrape type 2
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8755c43-cd86-51e0-a4b7-09b23fb9b1cc with scrape type 2
2026-04-27 08:15:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a8755c43-cd86-51e0-a4b7-09b23fb9b1cc, identifier: BK24542
2026-04-27 08:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a8755c43-cd86-51e0-a4b7-09b23fb9b1cc with identifier: BK24542
2026-04-27 08:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a8755c43-cd86-51e0-a4b7-09b23fb9b1cc with identifier: BK24542
2026-04-27 08:15:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a8755c43-cd86-51e0-a4b7-09b23fb9b1cc with identifier: BK24542 to the API
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-04-27T15:31:00Z',
'fuel_type': 'diesel',
'id': 'a8755c43-cd86-51e0-a4b7-09b23fb9b1cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK24542',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 103745,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-06-06',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-04-27 08:15:02 [auto1.es] INFO: Saving data for BK24542: {'auction_closing_time': 1777303860.0, 'created_time': 1777021178.716314, 'has_photos': True, 'last_price_update_time': 1777277702.925473}
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_b1ec2a452ece76d0725082fddd35d9e6.jpg not downloaded yet
2026-04-27 08:15:02 [auto1.es] INFO: Found listing with ID: TN22940
2026-04-27 08:15:02 [auto1.es] INFO: Scrape type for TN22940: 2
2026-04-27 08:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51f6f1c7-915b-5f54-ba55-4ba39b13ccda with identifier: TN22940
2026-04-27 08:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f6f1c7-915b-5f54-ba55-4ba39b13ccda with scrape type 2
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51f6f1c7-915b-5f54-ba55-4ba39b13ccda with scrape type 2
2026-04-27 08:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51f6f1c7-915b-5f54-ba55-4ba39b13ccda, identifier: TN22940
2026-04-27 08:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51f6f1c7-915b-5f54-ba55-4ba39b13ccda with identifier: TN22940
2026-04-27 08:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51f6f1c7-915b-5f54-ba55-4ba39b13ccda with identifier: TN22940
2026-04-27 08:15:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51f6f1c7-915b-5f54-ba55-4ba39b13ccda with identifier: TN22940 to the API
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-04-27T15:56:29Z',
'fuel_type': 'diesel',
'id': '51f6f1c7-915b-5f54-ba55-4ba39b13ccda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN22940',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Peugeot',
'model': '5008',
'odometer': 85907,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-12-27',
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-04-27 08:15:03 [auto1.es] INFO: Saving data for TN22940: {'auction_closing_time': 1777305389.0, 'created_time': 1777021780.022486, 'has_photos': True, 'last_price_update_time': 1777277703.341962}
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_223b565a39dec8d943a58304154b1a66.jpg not downloaded yet
2026-04-27 08:15:03 [auto1.es] INFO: Found listing with ID: LG52328
2026-04-27 08:15:03 [auto1.es] INFO: Scrape type for LG52328: 1
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF16262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff04841f5d0>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fc58b8-0546-5937-aaa2-c54309946c95/93fc58b8-0546-5937-aaa2-c54309946c95_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_887c70bcbd2414bd19333d8fc71f34ed.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93fc58b8-0546-5937-aaa2-c54309946c95
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_42d151b3a6392ad60830ed98078a8f50.jpg not downloaded yet
2026-04-27 08:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:03 [auto1.es] INFO: Found listing with ID: FH18425
2026-04-27 08:15:03 [auto1.es] INFO: Scrape type for FH18425: 2
2026-04-27 08:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5 with identifier: FH18425
2026-04-27 08:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5 with scrape type 2
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5 with scrape type 2
2026-04-27 08:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5, identifier: FH18425
2026-04-27 08:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5 with identifier: FH18425
2026-04-27 08:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5 with identifier: FH18425
2026-04-27 08:15:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4fb0a3b4-eb19-5265-8ce6-f067410f5ca5 with identifier: FH18425 to the API
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-04-27T15:18:06Z',
'fuel_type': 'diesel',
'id': '4fb0a3b4-eb19-5265-8ce6-f067410f5ca5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH18425',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 301005,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-04-16',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 320 CDI 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2009}
2026-04-27 08:15:03 [auto1.es] INFO: Saving data for FH18425: {'auction_closing_time': 1777303086.0, 'created_time': 1777020481.783611, 'has_photos': True, 'last_price_update_time': 1777277703.844791}
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_1a7521a85f30a05b85c5161c62603b8c.jpg not downloaded yet
2026-04-27 08:15:03 [auto1.es] INFO: Found listing with ID: FW44773
2026-04-27 08:15:03 [auto1.es] INFO: Scrape type for FW44773: 2
2026-04-27 08:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69437882-0198-5e3c-9411-f297fdc32066 with identifier: FW44773
2026-04-27 08:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69437882-0198-5e3c-9411-f297fdc32066 with scrape type 2
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69437882-0198-5e3c-9411-f297fdc32066 with scrape type 2
2026-04-27 08:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69437882-0198-5e3c-9411-f297fdc32066, identifier: FW44773
2026-04-27 08:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA86042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69437882-0198-5e3c-9411-f297fdc32066 with identifier: FW44773
2026-04-27 08:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69437882-0198-5e3c-9411-f297fdc32066 with identifier: FW44773
2026-04-27 08:15:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 69437882-0198-5e3c-9411-f297fdc32066 with identifier: FW44773 to the API
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-04-27T15:45:46Z',
'fuel_type': 'diesel',
'id': '69437882-0198-5e3c-9411-f297fdc32066',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW44773',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 133880,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-01-03',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 SE',
'transmission': 'automatic',
'trim': 'TDV6 SE',
'year': 2011}
2026-04-27 08:15:04 [auto1.es] INFO: Saving data for FW44773: {'auction_closing_time': 1777304746.0, 'created_time': 1777021516.540924, 'has_photos': True, 'last_price_update_time': 1777277704.353715}
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_45f99a9d3fcdc8a74af89318ff7836ce.jpg not downloaded yet
2026-04-27 08:15:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_223b565a39dec8d943a58304154b1a66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:04 [auto1.es] INFO: Found listing with ID: MJ15003
2026-04-27 08:15:04 [auto1.es] INFO: Scrape type for MJ15003: 2
2026-04-27 08:15:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003
2026-04-27 08:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b42db28-016c-588d-85a4-310ff8cd81b9 with scrape type 2
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b42db28-016c-588d-85a4-310ff8cd81b9 with scrape type 2
2026-04-27 08:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b42db28-016c-588d-85a4-310ff8cd81b9, identifier: MJ15003
2026-04-27 08:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003
2026-04-27 08:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003
2026-04-27 08:15:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003 to the API
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 181,
'expiration_date': '2026-04-27T15:28:21Z',
'fuel_type': 'petrol',
'id': '0b42db28-016c-588d-85a4-310ff8cd81b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ15003',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Grandland X',
'odometer': 75072,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Opel Grandland X 1.6 Turbo Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2019}
2026-04-27 08:15:04 [auto1.es] INFO: Saving data for MJ15003: {'auction_closing_time': 1777303701.0, 'created_time': 1777021880.335136, 'has_photos': True, 'last_price_update_time': 1777277704.774815}
2026-04-27 08:15:04 [auto1.es] INFO: Found listing with ID: BZ57473
2026-04-27 08:15:04 [auto1.es] INFO: Scrape type for BZ57473: 1
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048659850>
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fc58b8-0546-5937-aaa2-c54309946c95/93fc58b8-0546-5937-aaa2-c54309946c95_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_223b565a39dec8d943a58304154b1a66.jpg saved to cache
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93fc58b8-0546-5937-aaa2-c54309946c95
2026-04-27 08:15:04 [auto1.es] INFO: Found listing with ID: FH96205
2026-04-27 08:15:04 [auto1.es] INFO: Scrape type for FH96205: 2
2026-04-27 08:15:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 780a6e75-6485-5ac6-973c-9dd2caba1305 with identifier: FH96205
2026-04-27 08:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 780a6e75-6485-5ac6-973c-9dd2caba1305 with scrape type 2
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 780a6e75-6485-5ac6-973c-9dd2caba1305 with scrape type 2
2026-04-27 08:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 780a6e75-6485-5ac6-973c-9dd2caba1305, identifier: FH96205
2026-04-27 08:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 780a6e75-6485-5ac6-973c-9dd2caba1305 with identifier: FH96205
2026-04-27 08:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 780a6e75-6485-5ac6-973c-9dd2caba1305 with identifier: FH96205
2026-04-27 08:15:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 780a6e75-6485-5ac6-973c-9dd2caba1305 with identifier: FH96205 to the API
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-04-27T15:04:09Z',
'fuel_type': 'diesel',
'id': '780a6e75-6485-5ac6-973c-9dd2caba1305',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH96205',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 220974,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-07-19',
'seller_name': None,
'title': 'Volkswagen Jetta 2.0 TDI Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2006}
2026-04-27 08:15:05 [auto1.es] INFO: Saving data for FH96205: {'auction_closing_time': 1777302249.0, 'created_time': 1777018347.475527, 'has_photos': True, 'last_price_update_time': 1777277705.273435}
2026-04-27 08:15:05 [auto1.es] INFO: Found listing with ID: XB27462
2026-04-27 08:15:05 [auto1.es] INFO: Scrape type for XB27462: 2
2026-04-27 08:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc79398-54ad-55ba-b899-d7f2444829ba with identifier: XB27462
2026-04-27 08:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc79398-54ad-55ba-b899-d7f2444829ba with scrape type 2
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc79398-54ad-55ba-b899-d7f2444829ba with scrape type 2
2026-04-27 08:15:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dc79398-54ad-55ba-b899-d7f2444829ba, identifier: XB27462
2026-04-27 08:15:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dc79398-54ad-55ba-b899-d7f2444829ba with identifier: XB27462
2026-04-27 08:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dc79398-54ad-55ba-b899-d7f2444829ba with identifier: XB27462
2026-04-27 08:15:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dc79398-54ad-55ba-b899-d7f2444829ba with identifier: XB27462 to the API
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-04-27T15:23:12Z',
'fuel_type': 'diesel',
'id': '0dc79398-54ad-55ba-b899-d7f2444829ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB27462',
'listing': 'auction',
'location_confidence': None,
'longitude': None,
'make': 'Renault',
'model': 'Scenic',
'odometer': 273940,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'postal_code': None,
'price': 0,
'price_includes_vat': False,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2009-05-28',
'seller_name': None,
'title': 'Renault Scenic 1.9 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2009}
2026-04-27 08:15:05 [auto1.es] INFO: Saving data for XB27462: {'auction_closing_time': 1777303392.0, 'created_time': 1777018332.493963, 'has_photos': True, 'last_price_update_time': 1777277705.712538}
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_1a7521a85f30a05b85c5161c62603b8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048592810>
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fc58b8-0546-5937-aaa2-c54309946c95/93fc58b8-0546-5937-aaa2-c54309946c95_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_1a7521a85f30a05b85c5161c62603b8c.jpg saved to cache
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93fc58b8-0546-5937-aaa2-c54309946c95
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_42d151b3a6392ad60830ed98078a8f50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff048988790>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fc58b8-0546-5937-aaa2-c54309946c95/93fc58b8-0546-5937-aaa2-c54309946c95_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/11/69118f0bcec3c9c232d61fd925690165/pa/UG79716_42d151b3a6392ad60830ed98078a8f50.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93fc58b8-0546-5937-aaa2-c54309946c95
2026-04-27 08:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS53195/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:33 [scrapy.extensions.logstats] INFO: Crawled 697 pages (at 14 pages/min), scraped 815 items (at 24 items/min)
2026-04-27 08:15:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 380MiB
2026-04-27 08:15:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.559(s), this was the 1st time calling it.
2026-04-27 08:15:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.499277489249255 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.293(s), this was the 1st time calling it.
2026-04-27 08:15:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.510503589879434 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.143(s), this was the 1st time calling it.
2026-04-27 08:15:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.400188425154302 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.